-- Logs begin at Wed 2022-06-22 11:40:37 UTC, end at Wed 2022-06-22 13:18:18 UTC. -- Jun 22 12:09:05.158674 dv-cinder-846977-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 22 12:09:05.166632 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 12:09:05 2022] *** Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: nodename: dv-cinder-846977-1-iscsi Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: machine: x86_64 Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: clock source: unix Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: pcre jit disabled Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: detected number of CPU cores: 4 Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: current working directory: / Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: detected binary path: /usr/bin/uwsgi-core Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: your processes number limit is 47680 Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: your memory page size is 4096 bytes Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: detected max file descriptor number: 2048 Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: lock engine: pthread robust mutexes Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: thunder lock: enabled Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 22 12:09:05.172044 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 12:09:05.215310 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: Python main interpreter initialized at 0x556fa41a39c0 Jun 22 12:09:05.215310 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: python threads support enabled Jun 22 12:09:05.215310 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: your server socket listen backlog is limited to 100 connections Jun 22 12:09:05.215310 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: your mercy for graceful operations on workers is 90 seconds Jun 22 12:09:05.215781 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 12:09:05.215781 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: *** Operational MODE: preforking *** Jun 22 12:09:05.216046 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: *** uWSGI is running in multiple interpreter mode *** Jun 22 12:09:05.216140 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: spawned uWSGI master process (pid: 80163) Jun 22 12:09:05.216277 dv-cinder-846977-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 22 12:09:05.218556 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: spawned uWSGI worker 1 (pid: 80175, cores: 1) Jun 22 12:09:05.218556 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: spawned uWSGI worker 2 (pid: 80176, cores: 1) Jun 22 12:09:05.218556 dv-cinder-846977-1-iscsi devstack@keystone.service[80163]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 12:09:10.735163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 12:09:10.735163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: from cryptography.utils import int_from_bytes Jun 22 12:09:10.735954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 12:09:10.735954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: from cryptography.utils import int_from_bytes Jun 22 12:09:10.736096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 12:09:10.736096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: from cryptography.utils import int_from_bytes Jun 22 12:09:10.736096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 12:09:10.736096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: from cryptography.utils import int_from_bytes Jun 22 12:09:10.784875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 12:09:10.785095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 12:09:10.785183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 12:09:10.785278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] command line args: [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 12:09:10.785360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 12:09:10.785501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 12:09:10.785590 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] command line args: [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 12:09:10.785669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ================================================================================ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 12:09:10.785782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 12:09:10.785927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] admin_token = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.786086 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ================================================================================ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 12:09:10.786171 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] config_dir = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.786247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] admin_token = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.786349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.786433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config_dir = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.786533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] config_source = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.786626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.786705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] debug = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.786800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config_source = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.786884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.787164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] debug = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.787164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.787315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.787455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.787534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.787606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.787666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.787837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.787918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.788245 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.788348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.788348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_config_append = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.788472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.788531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.788587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_config_append = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.788643 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_dir = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.788698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.788857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.788939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_dir = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.789005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.789063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.789245 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.789345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.789501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.789582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.789755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.789856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.789927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.789992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.790097 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.790221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.790344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.790441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.790590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.790686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.791422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.791549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.791619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.791684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.791866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.792000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.792111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.792171 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.792349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.792428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.792601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.792691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.792868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.793017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.793167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.793365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.793548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] publish_errors = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.793626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.793779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.793870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] publish_errors = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.794015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.794141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.794218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.794276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.794434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.794523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.794704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.794802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.794876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] standard_threads = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.794982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.795115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.795190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] standard_threads = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.795333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.795423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.795519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.795610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.795691 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] use_journal = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.795763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.795859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] use_json = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.795943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_journal = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.796068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] use_stderr = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.796173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_json = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.796262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] use_syslog = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.796361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_stderr = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.796435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.796534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_syslog = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.796697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.796777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 12:09:10.796936 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.797041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.797198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.797312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.797499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.797747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.798007 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.798253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.798465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.798630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.798746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.798865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.799002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.799149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.799300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.799413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.799530 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.799643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.799750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.799880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.799990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.800137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.800251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.800374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.800494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.800605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.800716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.800860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.800974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.801167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.801289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.801407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.801524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.801643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.801756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.801875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.801992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.802110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.802228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.802339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.802449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.802567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.802679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.802773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.802871 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.802982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.803077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.803194 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.803306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.803422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.803534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.803644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.803754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.803873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.803985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.804113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.804224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.804318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.804437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.804559 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.804671 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.804787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.804898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.805007 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.805126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.805237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.805348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.805472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.806052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.806170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.806275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.806383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.806592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.806688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.806786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.806879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.807069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.807169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.807262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.807354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.807447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.807546 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.807649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.807743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.807842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.807937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.808101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.808213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.808321 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.808417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.808510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.808610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.808703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.808795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.808895 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.809001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.809095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.809187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.809284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.810508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.810647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.810768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.810880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.810989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.811100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.811247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.811362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.811474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.811585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.811697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.811813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.811925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.812066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.812178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.812278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.812388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.812499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.812618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.812740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.812861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.812974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.813094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.813215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.813328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.813440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.813559 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.813672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.813784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.813907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.814021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.814133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.814244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.814367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.814480 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.814591 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.814692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.814809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.814921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.815040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.815154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.815255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.815364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.815476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.815587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.815709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.815824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.815935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.816070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.816185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.816296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.816416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.816529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.816641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.816752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.816871 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.816992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.817113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.817225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.817336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.817447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.817562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.817682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.817795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.817907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.818018 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.818135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.818253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.818253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.818473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.818473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.818681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.818792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.818909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.819100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.819222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.819342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.819454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.819565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.819682 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.819802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.819923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.820105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.820223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.820335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.820459 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.820589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.820702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.820702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.820928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.821040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.821152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.821263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.821380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.821504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.821624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.821737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.821852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.821852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.821852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.822186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.822301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.822412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.822523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.822634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.822754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.external = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.822874 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.822988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.823105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.823105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.823317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.823439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.external = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.823551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.823690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.823820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.password = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.823935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.824063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.token = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.824172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.824267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.824375 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.password = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.824474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.824570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.token = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.824664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.824764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.824764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.824949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.825044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.825145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.825242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.825336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.825430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.825536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.825638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.825734 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.825828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.825922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826411 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826701 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826895 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.826982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827225 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827373 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827738 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827807 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.827928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.828060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.828202 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.828331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.828469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.828580 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.828717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.828830 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.828964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.829071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.829223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.829349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.829478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.829586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.829700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.829897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.829979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.830267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.830473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.830602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.830722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.830831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.830967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.831090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.831237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.831319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.832111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.832267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.832401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.832525 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.832607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.832758 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.832833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.832903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.832986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.833063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.833144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.833278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.833278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.833499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.833600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.833674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.833743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.833823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.833901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.833971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.834040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.834108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.834185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.834287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.834445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.834574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.834678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.834757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.834911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.835014 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.835144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.835231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.835390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.835468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.835640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.835720 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.835891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.835975 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.836184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.836296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.836437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.836571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.836705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.836865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.836981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.837057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.837213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.837310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.837382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.837459 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.837601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.838180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.838359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.838448 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.838606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.838683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.838852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.838930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.839090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.839169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.839332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.839408 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.839562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.839639 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.839813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.839892 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.840073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.840155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.840317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.840396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.840566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.840645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.840801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.840877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.841034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.841110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.841267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.841344 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.841494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.841572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.841731 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.841808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.841969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.842048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.842209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.842285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.842444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.842519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.842682 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.842761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.842933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.843014 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.843168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.843245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.843403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.843482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.843647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.843736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.843878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.843947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.844154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.844230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.844381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.844459 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.844634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.844720 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.844848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.844927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.845077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.845154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.845320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.845397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.845576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.845661 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.845805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.845888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.846056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.846135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.846336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.846425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.846540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.846617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.846774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.846859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.847004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.847079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.847242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.847319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.847475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.847551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.847706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.847774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.847934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.848001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.848207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.848295 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.848455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.848525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.848703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.848771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.848949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.849027 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.849183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.849250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.849413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.849481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.849789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.849889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.849889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.849998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.850126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.850204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.850367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.850452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.850604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.850681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.850850 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.850927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.851091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.851184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.851324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.851400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.851573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.851649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.851800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.851885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.852100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.852183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.852303 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.852381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.852539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.852629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.852775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.852853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.853022 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.853099 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.853284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.853910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.854071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.854142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.854337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.854426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.854576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.854664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.854833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.854911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.855080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.855167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.855312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.855398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.855564 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.855638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.855808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.855875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.856060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.856222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.856298 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.856368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.856538 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.856615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.856785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.856871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.857023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] role.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.857100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.857260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.857337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] role.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.857491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.857575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.857744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.857823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.857997 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.858075 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.858248 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.858334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.858498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.858575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.858749 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.858826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.858995 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.859081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.859244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.859322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.859480 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.859555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.859713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.859791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.859967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.860081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.860319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.860398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.860569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.860649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.860819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.861014 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.861243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.861320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.861481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.861560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.861732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.861810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.861982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.862060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.862232 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.862311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.862468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.862545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.862702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.862779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.862957 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.863037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.863200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.863276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.863437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.863513 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.863669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.863748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.863900 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.863977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.864156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.864237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.864410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.864490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.864665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.864742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.864911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.864989 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.865145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.865223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.865379 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.865455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.865608 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.865693 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.865845 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.865923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.866081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.866159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.866325 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.866410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.866559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.866635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.866818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.866895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.867060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.867163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.867299 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.867379 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.867548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.867680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.867792 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.867882 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.868078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.868160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.868295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.868372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.868533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.868624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.868768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.868870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.869057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.869134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.869293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.869380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.869522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.869600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.869765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.869843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.870070 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.870219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.870340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.870431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.870572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.870653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.870813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.870891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.871050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.871132 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.871293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.871371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.871529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.871606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.871769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.871845 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.872032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.872112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.872274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.872352 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.872513 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.872590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.872753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.872880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.873012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.873095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.873219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.873297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.873460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.873540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.873695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.873772 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.873932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.874009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.874161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.874243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.874402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.874470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.874575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 12:09:10.874652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 12:09:10.874797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 12:09:10.906507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:10.913508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:10.913621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:10.913766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:10.913952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:10.913952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:10.916630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:10.917335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:10.945503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:10.945724 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:10.945806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:10.945974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.097090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.097618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.148538 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.148776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.150594 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.150836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.217163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.217387 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.217504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.217619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.217707 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.217838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.217925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.218057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.218147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.218275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.218359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.218492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.244759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.244952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.245136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.245266 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.245388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.245469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.245559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.245634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.245870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.245960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.246031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.246115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.246191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.246259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.257904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.258074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.272127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.272360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.272455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.272589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.272684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.272812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.272929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.273037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.273120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.273259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.273351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.273475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.273563 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.273689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 12:09:11.293238 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.293436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 12:09:11.293787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.293919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.294012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 12:09:11.294133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 12:09:11.294252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.294477 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.294640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.294776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 12:09:11.294915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.295043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.295145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.295249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.295423 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.295674 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.307364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.307457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.307655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.307742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.307923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.308011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.308351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.316515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.317255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.319875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.320192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.320494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.320675 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.320820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.320929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.321048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.321134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.321313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.321410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.321589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.321673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.321867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.321949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.322196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.322428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.322557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.322733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.322872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.323294 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.323649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.323927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.350006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.351589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.351873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.352072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.354307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.354588 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.357843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.358272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.358561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.359932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.360377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.360660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.366042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.366337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.368042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.368346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.371498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.371785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.372099 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.372391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.372682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.372962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.373239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.373512 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.373608 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.373798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.374081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.374363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.374635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.374911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.375184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.375452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.393100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.393391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.394964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.395310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.398112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.399985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.402402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.402835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.404313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.404730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.408156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.410166 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.411820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.414029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.415570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.416467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.416764 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.417047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.417330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.417629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.418328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.418627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.418917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.419196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.419472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.419750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.437687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.438001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.438268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.438548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.439558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.439852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.440144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.440414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.446596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.448933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.449064 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.449217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.450761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.451046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.452583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.452883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.453185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.453490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.453832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.454341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.454643 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.454944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.455252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.455588 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.467316 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.467602 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.467896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.468220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.469163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.469454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.469737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.469958 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.470046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.470265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.470589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.471759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.472087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.472385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.488923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.490963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.492370 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.494962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.496283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.498065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.498308 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.499752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.500053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.500169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.500344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.501855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.502130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.502423 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.507775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.509494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.510735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.512405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.513396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.513692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.514106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.514391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.515942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.516258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.516664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.516944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.523930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.524249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.524536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.526779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.527077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.527357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.533082 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.533373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.533659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.533936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.534208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.534612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.534903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.535191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.535286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 12:09:11.535468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.535552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.535754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.535863 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.536052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.536159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.536329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.536416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.536614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.536723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.536895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.537018 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.537298 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.537567 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.537837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.538108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.538379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.538687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.538969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 12:09:11.576268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556fa41a39c0 pid: 80175 (default app) Jun 22 12:09:11.578498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556fa41a39c0 pid: 80176 (default app) Jun 22 12:09:11.579851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c8d1-ebe2-4169-8db0-dab71178a07e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:11.580186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c8d1-ebe2-4169-8db0-dab71178a07e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:11.580472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c8d1-ebe2-4169-8db0-dab71178a07e None None] PATH_INFO: `/v3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:11.584770 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 791 bytes} [Wed Jun 22 12:09:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:19.378778 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f8ccd-16c4-484e-95b4-42168ce11fdb None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:19.379363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f8ccd-16c4-484e-95b4-42168ce11fdb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:19.379363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f8ccd-16c4-484e-95b4-42168ce11fdb None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:19.383692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:19.389803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85242b-f6cd-4ee6-9624-66b4459f31bc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:19.390490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85242b-f6cd-4ee6-9624-66b4459f31bc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:19.390615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85242b-f6cd-4ee6-9624-66b4459f31bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:19.459959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: INFO dbcounter [None req-5c85242b-f6cd-4ee6-9624-66b4459f31bc None None] Registered counter for database keystone Jun 22 12:09:19.481739 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG oslo_db.sqlalchemy.engines [None req-5c85242b-f6cd-4ee6-9624-66b4459f31bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 12:09:19.488098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writer thread running {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 12:09:19.667527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG passlib.handlers.bcrypt [None req-5c85242b-f6cd-4ee6-9624-66b4459f31bc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80175) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 12:09:19.667939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG passlib.handlers.bcrypt [None req-5c85242b-f6cd-4ee6-9624-66b4459f31bc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80175) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 12:09:19.722453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5c85242b-f6cd-4ee6-9624-66b4459f31bc None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:19.724162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5c85242b-f6cd-4ee6-9624-66b4459f31bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:19.847127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 22 12:09:20.001623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f8ccd-16c4-484e-95b4-42168ce11fdb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:20.074410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: INFO dbcounter [None req-304f8ccd-16c4-484e-95b4-42168ce11fdb None None] Registered counter for database keystone Jun 22 12:09:20.093924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG oslo_db.sqlalchemy.engines [None req-304f8ccd-16c4-484e-95b4-42168ce11fdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 12:09:20.100218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writer thread running {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 12:09:20.221159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f8ccd-16c4-484e-95b4-42168ce11fdb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:20.225333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136fef5-b9e1-42cb-8d38-b5d225871e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:20.225996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136fef5-b9e1-42cb-8d38-b5d225871e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:20.226284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136fef5-b9e1-42cb-8d38-b5d225871e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:20.226566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136fef5-b9e1-42cb-8d38-b5d225871e4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:20.235283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136fef5-b9e1-42cb-8d38-b5d225871e4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:20.286888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e136fef5-b9e1-42cb-8d38-b5d225871e4a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 12:09:20.287163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136fef5-b9e1-42cb-8d38-b5d225871e4a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:20.298024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1324 bytes} [Wed Jun 22 12:09:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 12:09:20.304118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85242b-f6cd-4ee6-9624-66b4459f31bc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:20.319239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85242b-f6cd-4ee6-9624-66b4459f31bc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:20.323626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9539e-13e7-49bc-a8eb-878d0818e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:20.324784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9539e-13e7-49bc-a8eb-878d0818e2cc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:20.325070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9539e-13e7-49bc-a8eb-878d0818e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:20.325346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9539e-13e7-49bc-a8eb-878d0818e2cc admin admin] PATH_INFO: `/v3/projects/4bd14a2971f0418089231e7139d946ba` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:20.329404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9539e-13e7-49bc-a8eb-878d0818e2cc admin admin] RBAC: Authorizing `identity:get_project(project_id=4bd14a2971f0418089231e7139d946ba)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:20.380034 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4fa9539e-13e7-49bc-a8eb-878d0818e2cc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 12:09:20.380391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9539e-13e7-49bc-a8eb-878d0818e2cc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:20.385089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 3/5] 10.222.0.66 () {56 vars in 1207 bytes} [Wed Jun 22 12:09:20 2022] GET /identity/v3/projects/4bd14a2971f0418089231e7139d946ba => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:22.379746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410ba4-9e6a-4ec5-b396-d34b69722bc8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:22.380316 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410ba4-9e6a-4ec5-b396-d34b69722bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:22.380316 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410ba4-9e6a-4ec5-b396-d34b69722bc8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:22.384519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 3/6] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:22.389741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcee17f-7b9c-4a2b-b027-12a4716560c5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:22.390372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcee17f-7b9c-4a2b-b027-12a4716560c5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:22.390554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcee17f-7b9c-4a2b-b027-12a4716560c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:22.410358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3bcee17f-7b9c-4a2b-b027-12a4716560c5 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:22.412040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3bcee17f-7b9c-4a2b-b027-12a4716560c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:22.421580 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 22 12:09:22.444273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a410ba4-9e6a-4ec5-b396-d34b69722bc8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:22.457009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a410ba4-9e6a-4ec5-b396-d34b69722bc8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:22.461347 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff314d3-2b67-4c06-91ab-a86b0d5f2d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:22.461986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff314d3-2b67-4c06-91ab-a86b0d5f2d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:22.462278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff314d3-2b67-4c06-91ab-a86b0d5f2d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:22.463122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff314d3-2b67-4c06-91ab-a86b0d5f2d5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:22.470886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff314d3-2b67-4c06-91ab-a86b0d5f2d5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:22.472718 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff314d3-2b67-4c06-91ab-a86b0d5f2d5a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:22.481615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1324 bytes} [Wed Jun 22 12:09:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:09:22.487319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcee17f-7b9c-4a2b-b027-12a4716560c5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:22.496458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcee17f-7b9c-4a2b-b027-12a4716560c5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:22.500759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6826f82-8350-49f5-85fe-660c08626e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:22.501623 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6826f82-8350-49f5-85fe-660c08626e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:22.501905 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6826f82-8350-49f5-85fe-660c08626e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:22.502184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6826f82-8350-49f5-85fe-660c08626e1f admin admin] PATH_INFO: `/v3/users/10bf47ad20914307a19e97e4ac11811c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:22.503561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6826f82-8350-49f5-85fe-660c08626e1f admin admin] RBAC: Authorizing `identity:get_user(user_id=10bf47ad20914307a19e97e4ac11811c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:22.505409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6826f82-8350-49f5-85fe-660c08626e1f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:22.506988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 5/9] 10.222.0.66 () {56 vars in 1198 bytes} [Wed Jun 22 12:09:22 2022] GET /identity/v3/users/10bf47ad20914307a19e97e4ac11811c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:24.606932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd24a6-949f-42af-be5a-96fb2bc61879 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:24.607441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd24a6-949f-42af-be5a-96fb2bc61879 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:24.607541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd24a6-949f-42af-be5a-96fb2bc61879 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:24.608871 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:24.614015 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff3a7-9560-46a2-8356-6bb7fae22c8d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:24.614432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff3a7-9560-46a2-8356-6bb7fae22c8d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:24.614692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff3a7-9560-46a2-8356-6bb7fae22c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:24.629135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69975c7-5c19-4cde-b456-833ef667633e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:24.629431 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69975c7-5c19-4cde-b456-833ef667633e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:24.629720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69975c7-5c19-4cde-b456-833ef667633e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:24.631061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 6/11] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:09:24.631219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-743ff3a7-9560-46a2-8356-6bb7fae22c8d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:24.632546 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-743ff3a7-9560-46a2-8356-6bb7fae22c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:24.636581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f491006-9f74-4940-9499-0eea934fbf4b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:24.636874 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f491006-9f74-4940-9499-0eea934fbf4b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:24.637157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f491006-9f74-4940-9499-0eea934fbf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:24.676919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG passlib.handlers.bcrypt [None req-4f491006-9f74-4940-9499-0eea934fbf4b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80176) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 12:09:24.677339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG passlib.handlers.bcrypt [None req-4f491006-9f74-4940-9499-0eea934fbf4b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80176) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 12:09:24.715648 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:24.723823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4f491006-9f74-4940-9499-0eea934fbf4b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:24.725482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4f491006-9f74-4940-9499-0eea934fbf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:24.738216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff3a7-9560-46a2-8356-6bb7fae22c8d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:24.762666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:24.826752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:09:24.845530 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff3a7-9560-46a2-8356-6bb7fae22c8d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:24.848636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f491006-9f74-4940-9499-0eea934fbf4b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:24.880369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacddd2-1b88-40b7-860b-d6b92b0c3d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:24.881097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacddd2-1b88-40b7-860b-d6b92b0c3d24 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:24.881386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacddd2-1b88-40b7-860b-d6b92b0c3d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:24.881669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacddd2-1b88-40b7-860b-d6b92b0c3d24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:24.893088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacddd2-1b88-40b7-860b-d6b92b0c3d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-deacddd2-1b88-40b7-860b-d6b92b0c3d24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:24.904824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:24.905788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:24.906597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 7/14] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:09:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:09:24.912693 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacddd2-1b88-40b7-860b-d6b92b0c3d24 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:24.950907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f491006-9f74-4940-9499-0eea934fbf4b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:24.953203 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:24.989346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9198626-904c-4a0e-9cc1-51f572c5db81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:24.990345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9198626-904c-4a0e-9cc1-51f572c5db81 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:24.990706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9198626-904c-4a0e-9cc1-51f572c5db81 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:24.991058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9198626-904c-4a0e-9cc1-51f572c5db81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:24.995890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:25.014896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacddd2-1b88-40b7-860b-d6b92b0c3d24 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:25.050179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e98846-5ffd-49bb-b88e-3a57937f41d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:25.050845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e98846-5ffd-49bb-b88e-3a57937f41d8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:25.051131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e98846-5ffd-49bb-b88e-3a57937f41d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:25.051409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e98846-5ffd-49bb-b88e-3a57937f41d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:25.052195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e98846-5ffd-49bb-b88e-3a57937f41d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:25.052501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e98846-5ffd-49bb-b88e-3a57937f41d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:25.053898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e98846-5ffd-49bb-b88e-3a57937f41d8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:25.062006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9198626-904c-4a0e-9cc1-51f572c5db81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:25.063535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9198626-904c-4a0e-9cc1-51f572c5db81 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:25.065299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 8/15] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:25.070849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e98846-5ffd-49bb-b88e-3a57937f41d8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:25.162010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 8/16] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 12:09:25.168265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9198626-904c-4a0e-9cc1-51f572c5db81 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:25.171141 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:25.173088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e98846-5ffd-49bb-b88e-3a57937f41d8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:25.206776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceadf9-ceb4-414d-8f2c-4501a07a9cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:25.207650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceadf9-ceb4-414d-8f2c-4501a07a9cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:25.207935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceadf9-ceb4-414d-8f2c-4501a07a9cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:25.208242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceadf9-ceb4-414d-8f2c-4501a07a9cb3 None admin] PATH_INFO: `/v3/users/10bf47ad20914307a19e97e4ac11811c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:25.209447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ceadf9-ceb4-414d-8f2c-4501a07a9cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=10bf47ad20914307a19e97e4ac11811c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:25.210903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ceadf9-ceb4-414d-8f2c-4501a07a9cb3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:25.213330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 9/17] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:25 2022] GET /identity/v3/users/10bf47ad20914307a19e97e4ac11811c => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:25.218362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceadf9-ceb4-414d-8f2c-4501a07a9cb3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:25.232750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:25.268039 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9198626-904c-4a0e-9cc1-51f572c5db81 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:25.302691 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed989d66-dc8c-4bde-8dda-77b9de49412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:25.303520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989d66-dc8c-4bde-8dda-77b9de49412e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:25.303802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989d66-dc8c-4bde-8dda-77b9de49412e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:25.304100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989d66-dc8c-4bde-8dda-77b9de49412e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:25.324130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed989d66-dc8c-4bde-8dda-77b9de49412e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:25.325593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed989d66-dc8c-4bde-8dda-77b9de49412e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:25.328242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceadf9-ceb4-414d-8f2c-4501a07a9cb3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ed989d66-dc8c-4bde-8dda-77b9de49412e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:09:25.345719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:25.346730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:25.347917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:09:25.347917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:09:25.347917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:09:25.347917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:09:25.347917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 9/18] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:09:25.352609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed989d66-dc8c-4bde-8dda-77b9de49412e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:25.362429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe33c47-0e6a-42c2-b37c-3cb888bf19c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:25.363232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe33c47-0e6a-42c2-b37c-3cb888bf19c2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:25.363523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe33c47-0e6a-42c2-b37c-3cb888bf19c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:25.363807 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe33c47-0e6a-42c2-b37c-3cb888bf19c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:25.365794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe33c47-0e6a-42c2-b37c-3cb888bf19c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:25.366501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe33c47-0e6a-42c2-b37c-3cb888bf19c2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:25.368385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 10/19] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:25.374364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe33c47-0e6a-42c2-b37c-3cb888bf19c2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:25.411228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:25.454422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:25.455536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed989d66-dc8c-4bde-8dda-77b9de49412e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:25.473875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe33c47-0e6a-42c2-b37c-3cb888bf19c2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:25.489608 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c15c-0d30-43dc-8191-8eff780e61f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:25.490264 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c15c-0d30-43dc-8191-8eff780e61f5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:25.490553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c15c-0d30-43dc-8191-8eff780e61f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:25.490827 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c15c-0d30-43dc-8191-8eff780e61f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:25.491549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489c15c-0d30-43dc-8191-8eff780e61f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:25.491851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489c15c-0d30-43dc-8191-8eff780e61f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:25.493259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489c15c-0d30-43dc-8191-8eff780e61f5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:25.510846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 10/20] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:25.511070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a916a29-63f5-444c-b795-ce547cff3c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:25.511735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916a29-63f5-444c-b795-ce547cff3c9f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:25.512043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916a29-63f5-444c-b795-ce547cff3c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:25.512335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916a29-63f5-444c-b795-ce547cff3c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:25.513192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a916a29-63f5-444c-b795-ce547cff3c9f None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.domain.id=default, user.id=10bf47ad20914307a19e97e4ac11811c) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:25.513511 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a916a29-63f5-444c-b795-ce547cff3c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:25.515273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a916a29-63f5-444c-b795-ce547cff3c9f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:25.523011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 11/21] 10.222.0.66 () {56 vars in 1322 bytes} [Wed Jun 22 12:09:25 2022] GET /identity/v3/role_assignments?user.id=10bf47ad20914307a19e97e4ac11811c&scope.domain.id=default&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:27.637364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d42b36-272f-4ad4-845b-4b241e7b0f37 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:27.637966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d42b36-272f-4ad4-845b-4b241e7b0f37 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:27.637966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d42b36-272f-4ad4-845b-4b241e7b0f37 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:27.639288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 11/22] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:27.644938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f368568-78c6-4679-be57-7dca0cc417f9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:27.645389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f368568-78c6-4679-be57-7dca0cc417f9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:27.645475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f368568-78c6-4679-be57-7dca0cc417f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:27.673076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9f368568-78c6-4679-be57-7dca0cc417f9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:27.674293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9f368568-78c6-4679-be57-7dca0cc417f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:27.757626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 12/23] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:27.794312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d42b36-272f-4ad4-845b-4b241e7b0f37 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:27.945104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d42b36-272f-4ad4-845b-4b241e7b0f37 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:27.970093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:27.987891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694eb81-bb6b-4203-a8dc-d5ef8317c4b4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:27.988204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694eb81-bb6b-4203-a8dc-d5ef8317c4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:27.988495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694eb81-bb6b-4203-a8dc-d5ef8317c4b4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:27.989871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:09:27.995690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb59c02-23d7-4869-a831-0309bb0946f9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:27.995980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb59c02-23d7-4869-a831-0309bb0946f9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:27.996290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb59c02-23d7-4869-a831-0309bb0946f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:28.003892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880ef54-fd34-4f6f-91c4-277f7b6cf558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:28.011353 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880ef54-fd34-4f6f-91c4-277f7b6cf558 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:28.011353 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880ef54-fd34-4f6f-91c4-277f7b6cf558 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:28.016402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880ef54-fd34-4f6f-91c4-277f7b6cf558 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:28.032281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3fb59c02-23d7-4869-a831-0309bb0946f9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:28.033493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3fb59c02-23d7-4869-a831-0309bb0946f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:28.050541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880ef54-fd34-4f6f-91c4-277f7b6cf558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-b880ef54-fd34-4f6f-91c4-277f7b6cf558 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:28.069752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:28.070635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:09:28.071886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 12/25] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:09:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:28.078290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880ef54-fd34-4f6f-91c4-277f7b6cf558 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:28.220809 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 14/26] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 22 12:09:28.256488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb59c02-23d7-4869-a831-0309bb0946f9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:28.260340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:28.306799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880ef54-fd34-4f6f-91c4-277f7b6cf558 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:28.366616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3a2f0-761f-418f-933e-547d62305c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:28.368306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a2f0-761f-418f-933e-547d62305c27 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:28.368656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a2f0-761f-418f-933e-547d62305c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:28.368943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a2f0-761f-418f-933e-547d62305c27 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:28.369716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3a2f0-761f-418f-933e-547d62305c27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:28.370274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3a2f0-761f-418f-933e-547d62305c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:28.371695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3a2f0-761f-418f-933e-547d62305c27 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:28.397233 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 13/27] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:28.399928 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c39c-8aca-45c1-b713-f9e10af1773f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:28.400264 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c39c-8aca-45c1-b713-f9e10af1773f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:28.400553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c39c-8aca-45c1-b713-f9e10af1773f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:28.402107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 14/28] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:28.405742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c39c-8aca-45c1-b713-f9e10af1773f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:28.459576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb59c02-23d7-4869-a831-0309bb0946f9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:28.495769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:28.524802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260aa28-dcbf-44f6-bb51-5eb9c0c11b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:28.526288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260aa28-dcbf-44f6-bb51-5eb9c0c11b91 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:28.528005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260aa28-dcbf-44f6-bb51-5eb9c0c11b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:28.528711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260aa28-dcbf-44f6-bb51-5eb9c0c11b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:28.547882 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260aa28-dcbf-44f6-bb51-5eb9c0c11b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:28.549922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260aa28-dcbf-44f6-bb51-5eb9c0c11b91 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e260aa28-dcbf-44f6-bb51-5eb9c0c11b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:09:28.589550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:28.590400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:28.591200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:09:28.591200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:09:28.591200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:09:28.591200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:28.598144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 15/29] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:28.600123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba25e13-5c91-4873-a064-f67edf96bbe6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:28.600598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba25e13-5c91-4873-a064-f67edf96bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:28.601030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba25e13-5c91-4873-a064-f67edf96bbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:28.612528 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c39c-8aca-45c1-b713-f9e10af1773f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:28.618845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9ba25e13-5c91-4873-a064-f67edf96bbe6 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:28.620173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9ba25e13-5c91-4873-a064-f67edf96bbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:28.660247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34769d-e0a5-4d92-968a-fc8cde7ff7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:28.661131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34769d-e0a5-4d92-968a-fc8cde7ff7fa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:28.661422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34769d-e0a5-4d92-968a-fc8cde7ff7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:28.661707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34769d-e0a5-4d92-968a-fc8cde7ff7fa None admin] PATH_INFO: `/v3/users/10bf47ad20914307a19e97e4ac11811c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:28.663295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34769d-e0a5-4d92-968a-fc8cde7ff7fa None admin] RBAC: Authorizing `identity:get_user(user_id=10bf47ad20914307a19e97e4ac11811c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:28.664790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34769d-e0a5-4d92-968a-fc8cde7ff7fa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:28.667414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 15/30] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:28 2022] GET /identity/v3/users/10bf47ad20914307a19e97e4ac11811c => generated 247 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:28.668743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8d8f1-429a-428f-b92f-b9540a73b890 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:28.669037 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8d8f1-429a-428f-b92f-b9540a73b890 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:28.669327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8d8f1-429a-428f-b92f-b9540a73b890 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:28.670614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 16/31] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:28.671321 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8d8f1-429a-428f-b92f-b9540a73b890 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:28.687861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:28.713229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 16/32] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:28.714478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba25e13-5c91-4873-a064-f67edf96bbe6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:28.820122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8d8f1-429a-428f-b92f-b9540a73b890 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:28.821987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:28.834634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba25e13-5c91-4873-a064-f67edf96bbe6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:28.853174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b170a-a686-474f-9d8b-ad6a613bf099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:28.853851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b170a-a686-474f-9d8b-ad6a613bf099 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:28.854136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b170a-a686-474f-9d8b-ad6a613bf099 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:28.854414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b170a-a686-474f-9d8b-ad6a613bf099 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:28.855262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b170a-a686-474f-9d8b-ad6a613bf099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:28.855558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b170a-a686-474f-9d8b-ad6a613bf099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:28.857015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b170a-a686-474f-9d8b-ad6a613bf099 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:28.870259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d47402-5d8c-4275-942b-1a68a829aac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:28.870458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 17/33] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:28.871036 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d47402-5d8c-4275-942b-1a68a829aac5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:28.871327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d47402-5d8c-4275-942b-1a68a829aac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:28.871607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d47402-5d8c-4275-942b-1a68a829aac5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:28.872985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d47402-5d8c-4275-942b-1a68a829aac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:28.874471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d47402-5d8c-4275-942b-1a68a829aac5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:28.876249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae5d8-1cb5-4668-be2a-cf609c829ddd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:28.876486 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 17/34] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:28.876824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae5d8-1cb5-4668-be2a-cf609c829ddd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:28.877160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae5d8-1cb5-4668-be2a-cf609c829ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:28.877269 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d47402-5d8c-4275-942b-1a68a829aac5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:28.901538 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-eaeae5d8-1cb5-4668-be2a-cf609c829ddd None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:28.902851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-eaeae5d8-1cb5-4668-be2a-cf609c829ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:28.935992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:28.980281 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 18/35] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:28.981176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeae5d8-1cb5-4668-be2a-cf609c829ddd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:28.990609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d47402-5d8c-4275-942b-1a68a829aac5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:29.046340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f73f34-a8b8-4428-825e-6681bb2f19fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:29.047314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f73f34-a8b8-4428-825e-6681bb2f19fb None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:29.047836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f73f34-a8b8-4428-825e-6681bb2f19fb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:29.048334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f73f34-a8b8-4428-825e-6681bb2f19fb None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:29.049268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f73f34-a8b8-4428-825e-6681bb2f19fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:29.050805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f73f34-a8b8-4428-825e-6681bb2f19fb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:29.082995 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:29.089938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeae5d8-1cb5-4668-be2a-cf609c829ddd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:29.125691 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b022e7-0514-4740-98d0-e3d864025aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:29.126371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b022e7-0514-4740-98d0-e3d864025aa7 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:29.126657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b022e7-0514-4740-98d0-e3d864025aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:29.126936 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b022e7-0514-4740-98d0-e3d864025aa7 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:29.127653 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b022e7-0514-4740-98d0-e3d864025aa7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:29.129135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b022e7-0514-4740-98d0-e3d864025aa7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:29.192382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 18/36] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Jun 22 12:09:28 2022] POST /identity/v3/roles => generated 219 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:09:29.193813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f73f34-a8b8-4428-825e-6681bb2f19fb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:29.276529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 19/37] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:09:28 2022] POST /identity/v3/projects => generated 301 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:09:29.276529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b022e7-0514-4740-98d0-e3d864025aa7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:29.379777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f73f34-a8b8-4428-825e-6681bb2f19fb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:29.413475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:29.449859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b022e7-0514-4740-98d0-e3d864025aa7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:29.478836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3d7f7-5339-4f74-89ed-214334af6098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:29.478836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d7f7-5339-4f74-89ed-214334af6098 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:29.479137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d7f7-5339-4f74-89ed-214334af6098 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:29.479399 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d7f7-5339-4f74-89ed-214334af6098 None admin] PATH_INFO: `/v3/domains/default/users/10bf47ad20914307a19e97e4ac11811c/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:29.482725 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3d7f7-5339-4f74-89ed-214334af6098 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=10bf47ad20914307a19e97e4ac11811c, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:29.484913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3d7f7-5339-4f74-89ed-214334af6098 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:29.497285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc15bc7-db54-4162-b2ad-7823e795c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:29.498024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc15bc7-db54-4162-b2ad-7823e795c2f2 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:29.498320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc15bc7-db54-4162-b2ad-7823e795c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:29.498603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc15bc7-db54-4162-b2ad-7823e795c2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:29.499379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc15bc7-db54-4162-b2ad-7823e795c2f2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:29.500991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc15bc7-db54-4162-b2ad-7823e795c2f2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:29.503281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 19/38] 10.222.0.66 () {58 vars in 1361 bytes} [Wed Jun 22 12:09:29 2022] PUT /identity/v3/domains/default/users/10bf47ad20914307a19e97e4ac11811c/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:09:29.505727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78f10d-faa7-4eaf-a1fb-ed9b586660df None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:29.505727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78f10d-faa7-4eaf-a1fb-ed9b586660df None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:29.505727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78f10d-faa7-4eaf-a1fb-ed9b586660df None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:29.507309 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 20/39] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:29.508056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b297212-ca2f-443c-bf36-0f89c9f75630 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:29.508609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b297212-ca2f-443c-bf36-0f89c9f75630 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:29.508951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b297212-ca2f-443c-bf36-0f89c9f75630 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:29.510650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 21/40] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:29.517019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055361c-cbeb-43ad-98c6-98cc82726258 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:29.517509 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055361c-cbeb-43ad-98c6-98cc82726258 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:29.517804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055361c-cbeb-43ad-98c6-98cc82726258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:29.523960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Jun 22 12:09:29 2022] POST /identity/v3/roles => generated 225 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:09:29.526354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6bda7-3fc4-4377-9ffc-47a42fe16c54 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:29.526354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6bda7-3fc4-4377-9ffc-47a42fe16c54 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:29.526570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6bda7-3fc4-4377-9ffc-47a42fe16c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:29.538027 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f055361c-cbeb-43ad-98c6-98cc82726258 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:29.539800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f055361c-cbeb-43ad-98c6-98cc82726258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:29.547515 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-63a6bda7-3fc4-4377-9ffc-47a42fe16c54 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:29.549307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-63a6bda7-3fc4-4377-9ffc-47a42fe16c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:29.558756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:29.647668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 22/42] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:29.647853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 21/43] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:29.684669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055361c-cbeb-43ad-98c6-98cc82726258 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:29.689000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6bda7-3fc4-4377-9ffc-47a42fe16c54 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:29.848804 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6bda7-3fc4-4377-9ffc-47a42fe16c54 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:29.888983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398be24-f4cf-40b0-969c-e16a07b2a637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:29.889837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398be24-f4cf-40b0-969c-e16a07b2a637 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:29.890478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398be24-f4cf-40b0-969c-e16a07b2a637 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:29.890631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398be24-f4cf-40b0-969c-e16a07b2a637 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:29.891806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398be24-f4cf-40b0-969c-e16a07b2a637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:29.893327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398be24-f4cf-40b0-969c-e16a07b2a637 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:29.894989 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 22/44] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:29.901112 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398be24-f4cf-40b0-969c-e16a07b2a637 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:29.910245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:29.930404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055361c-cbeb-43ad-98c6-98cc82726258 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:29.933971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:29.969433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3b77e-1fee-4349-b2e8-71ef882a83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:29.970117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3b77e-1fee-4349-b2e8-71ef882a83b2 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:29.970406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3b77e-1fee-4349-b2e8-71ef882a83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:29.970684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3b77e-1fee-4349-b2e8-71ef882a83b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:29.971443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3b77e-1fee-4349-b2e8-71ef882a83b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:29.972884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3b77e-1fee-4349-b2e8-71ef882a83b2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:29.996059 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 23/45] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Jun 22 12:09:29 2022] POST /identity/v3/roles => generated 223 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:09:30.021243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398be24-f4cf-40b0-969c-e16a07b2a637 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:30.059747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1161fe-7e1d-4223-839f-5e2af1261053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:30.060466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1161fe-7e1d-4223-839f-5e2af1261053 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:30.060756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1161fe-7e1d-4223-839f-5e2af1261053 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:30.061037 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1161fe-7e1d-4223-839f-5e2af1261053 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:30.061772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1161fe-7e1d-4223-839f-5e2af1261053 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:30.063277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1161fe-7e1d-4223-839f-5e2af1261053 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:30.091952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 23/46] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:09:29 2022] POST /identity/v3/projects => generated 312 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:09:31.669758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99ed37-e17f-4459-9d0f-94547e8bab66 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:31.670296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99ed37-e17f-4459-9d0f-94547e8bab66 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:31.670387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99ed37-e17f-4459-9d0f-94547e8bab66 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:31.671722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 24/47] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:09:31.676997 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1e5d-c4f5-4b73-a522-aa677e14b051 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:31.677405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1e5d-c4f5-4b73-a522-aa677e14b051 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:31.677680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1e5d-c4f5-4b73-a522-aa677e14b051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:31.695556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-711e1e5d-c4f5-4b73-a522-aa677e14b051 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:31.697370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-711e1e5d-c4f5-4b73-a522-aa677e14b051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:31.749211 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:31.764837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 24/48] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:31.787717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99ed37-e17f-4459-9d0f-94547e8bab66 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:31.901573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99ed37-e17f-4459-9d0f-94547e8bab66 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:31.935069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39773fe6-6272-4b9e-8e18-f27ebff00a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:31.935794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39773fe6-6272-4b9e-8e18-f27ebff00a79 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:31.936115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39773fe6-6272-4b9e-8e18-f27ebff00a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:31.936403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39773fe6-6272-4b9e-8e18-f27ebff00a79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:31.946425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39773fe6-6272-4b9e-8e18-f27ebff00a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-39773fe6-6272-4b9e-8e18-f27ebff00a79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:31.954697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:31.955556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:31.956345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 25/49] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:09:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:31.961832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1e5d-c4f5-4b73-a522-aa677e14b051 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:32.062120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1e5d-c4f5-4b73-a522-aa677e14b051 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:32.096623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093661c-4b09-43d6-bf9e-87f2efc63243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:32.097290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093661c-4b09-43d6-bf9e-87f2efc63243 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:32.097577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093661c-4b09-43d6-bf9e-87f2efc63243 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:32.097859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093661c-4b09-43d6-bf9e-87f2efc63243 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:32.098618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093661c-4b09-43d6-bf9e-87f2efc63243 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:32.098930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093661c-4b09-43d6-bf9e-87f2efc63243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:32.100334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093661c-4b09-43d6-bf9e-87f2efc63243 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:32.108485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 25/50] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:32.113997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39773fe6-6272-4b9e-8e18-f27ebff00a79 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:32.140395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:32.152349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ee52a-da0b-42ec-a7e8-df504676801b None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:32.152649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ee52a-da0b-42ec-a7e8-df504676801b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:32.152937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ee52a-da0b-42ec-a7e8-df504676801b None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:32.154319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 26/51] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:09:32.159224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f3b2-d38b-43cf-8697-5fcffd707c0a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:32.159524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f3b2-d38b-43cf-8697-5fcffd707c0a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:32.159812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f3b2-d38b-43cf-8697-5fcffd707c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:32.221381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39773fe6-6272-4b9e-8e18-f27ebff00a79 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:32.257104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64ebb6-7f56-4905-b303-1894dcaa21c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:32.257994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64ebb6-7f56-4905-b303-1894dcaa21c1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:32.258358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64ebb6-7f56-4905-b303-1894dcaa21c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:32.258610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64ebb6-7f56-4905-b303-1894dcaa21c1 None admin] PATH_INFO: `/v3/users/10bf47ad20914307a19e97e4ac11811c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:32.260404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64ebb6-7f56-4905-b303-1894dcaa21c1 None admin] RBAC: Authorizing `identity:get_user(user_id=10bf47ad20914307a19e97e4ac11811c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:32.261902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64ebb6-7f56-4905-b303-1894dcaa21c1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:32.263682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 26/52] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:32 2022] GET /identity/v3/users/10bf47ad20914307a19e97e4ac11811c => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:32.269255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64ebb6-7f56-4905-b303-1894dcaa21c1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:32.282006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8b42f3b2-d38b-43cf-8697-5fcffd707c0a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:32.283240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8b42f3b2-d38b-43cf-8697-5fcffd707c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:32.330570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:32.358623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 27/53] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:09:32.361431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:32.370984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64ebb6-7f56-4905-b303-1894dcaa21c1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:32.382630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42f3b2-d38b-43cf-8697-5fcffd707c0a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:32.405335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818a598-6c21-483d-8c32-0b6e3c4a4e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:32.406714 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818a598-6c21-483d-8c32-0b6e3c4a4e84 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:32.407009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818a598-6c21-483d-8c32-0b6e3c4a4e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:32.407294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818a598-6c21-483d-8c32-0b6e3c4a4e84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:32.408608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818a598-6c21-483d-8c32-0b6e3c4a4e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:32.410016 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818a598-6c21-483d-8c32-0b6e3c4a4e84 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:32.411701 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 27/54] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:32.418255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818a598-6c21-483d-8c32-0b6e3c4a4e84 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:32.492918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42f3b2-d38b-43cf-8697-5fcffd707c0a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:32.525929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818a598-6c21-483d-8c32-0b6e3c4a4e84 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:32.527450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165bfa5-5054-420c-b3ae-05b5fbbcc3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:32.528415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165bfa5-5054-420c-b3ae-05b5fbbcc3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:32.528574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165bfa5-5054-420c-b3ae-05b5fbbcc3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:32.528845 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165bfa5-5054-420c-b3ae-05b5fbbcc3c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:32.530035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165bfa5-5054-420c-b3ae-05b5fbbcc3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:32.531501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165bfa5-5054-420c-b3ae-05b5fbbcc3c3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:32.533360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 28/55] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:32.538623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165bfa5-5054-420c-b3ae-05b5fbbcc3c3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:32.562875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09020c0-6e32-498b-8818-5f2924e8eb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:32.563544 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09020c0-6e32-498b-8818-5f2924e8eb0f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:32.563832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09020c0-6e32-498b-8818-5f2924e8eb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:32.564163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09020c0-6e32-498b-8818-5f2924e8eb0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:32.565001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09020c0-6e32-498b-8818-5f2924e8eb0f None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.domain.id=default, user.id=10bf47ad20914307a19e97e4ac11811c) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:32.565318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09020c0-6e32-498b-8818-5f2924e8eb0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:32.566796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09020c0-6e32-498b-8818-5f2924e8eb0f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:32.573222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 28/56] 10.222.0.66 () {56 vars in 1322 bytes} [Wed Jun 22 12:09:32 2022] GET /identity/v3/role_assignments?user.id=10bf47ad20914307a19e97e4ac11811c&scope.domain.id=default&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:32.591623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:32.648169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165bfa5-5054-420c-b3ae-05b5fbbcc3c3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:32.684200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3536f-7128-4edf-a519-b6a50d330167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:32.684880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3536f-7128-4edf-a519-b6a50d330167 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:32.685167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3536f-7128-4edf-a519-b6a50d330167 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:32.685445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3536f-7128-4edf-a519-b6a50d330167 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:32.686182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3536f-7128-4edf-a519-b6a50d330167 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:32.687665 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3536f-7128-4edf-a519-b6a50d330167 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:32.714354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 29/57] 10.222.0.66 () {60 vars in 1140 bytes} [Wed Jun 22 12:09:32 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:09:34.760421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d14e81-a3a0-4738-946e-78c237e6c4af None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:34.760966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d14e81-a3a0-4738-946e-78c237e6c4af None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:34.761059 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d14e81-a3a0-4738-946e-78c237e6c4af None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:34.762371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 29/58] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:34.768075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34319a7-4c71-4c0a-9c52-7bcc4965053b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:34.768482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34319a7-4c71-4c0a-9c52-7bcc4965053b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:34.768654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34319a7-4c71-4c0a-9c52-7bcc4965053b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:34.785544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f34319a7-4c71-4c0a-9c52-7bcc4965053b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:34.786739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f34319a7-4c71-4c0a-9c52-7bcc4965053b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:34.854876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 30/59] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:34.879645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d14e81-a3a0-4738-946e-78c237e6c4af None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:34.905278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:34.980167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d14e81-a3a0-4738-946e-78c237e6c4af None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:35.016447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9decab-78df-4a3c-af6f-841d1ef326c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:35.017173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9decab-78df-4a3c-af6f-841d1ef326c6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:35.017465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9decab-78df-4a3c-af6f-841d1ef326c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:35.017751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9decab-78df-4a3c-af6f-841d1ef326c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:35.018945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9decab-78df-4a3c-af6f-841d1ef326c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:35.020443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9decab-78df-4a3c-af6f-841d1ef326c6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:35.022085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 30/60] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:35.027696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34319a7-4c71-4c0a-9c52-7bcc4965053b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:35.057553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:35.124637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34319a7-4c71-4c0a-9c52-7bcc4965053b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:35.156978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf7386-ee1e-40c2-ba11-33bdf9bf7c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:35.157639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf7386-ee1e-40c2-ba11-33bdf9bf7c72 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:35.157928 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf7386-ee1e-40c2-ba11-33bdf9bf7c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:35.158214 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf7386-ee1e-40c2-ba11-33bdf9bf7c72 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:35.158935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf7386-ee1e-40c2-ba11-33bdf9bf7c72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:35.160436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf7386-ee1e-40c2-ba11-33bdf9bf7c72 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:35.185948 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 31/61] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:09:35 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:09:38.332096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ece77-36a5-4a88-b951-8af06d294487 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:38.333099 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ece77-36a5-4a88-b951-8af06d294487 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:38.333584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ece77-36a5-4a88-b951-8af06d294487 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:38.335149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 31/62] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:38.341193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bee87-b6df-4f80-9e04-ab679df4cf41 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:38.341631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bee87-b6df-4f80-9e04-ab679df4cf41 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:38.341771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bee87-b6df-4f80-9e04-ab679df4cf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:38.365178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-133bee87-b6df-4f80-9e04-ab679df4cf41 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:38.366657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-133bee87-b6df-4f80-9e04-ab679df4cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:38.462931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 32/63] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:38.510419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ece77-36a5-4a88-b951-8af06d294487 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:38.636870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:38.650846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ece77-36a5-4a88-b951-8af06d294487 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:38.662465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcaee4-b34e-494f-93ef-da4cedb15bd7 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:38.663077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcaee4-b34e-494f-93ef-da4cedb15bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:38.663814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcaee4-b34e-494f-93ef-da4cedb15bd7 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:38.665870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 33/64] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:38.667210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af0a6b-ed88-41e0-89a4-57b12fedf371 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:38.667705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af0a6b-ed88-41e0-89a4-57b12fedf371 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:38.671480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af0a6b-ed88-41e0-89a4-57b12fedf371 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:38.674023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 34/65] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:38.675899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1af92-90e7-4f16-9efa-5dbb15d02406 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:38.676418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1af92-90e7-4f16-9efa-5dbb15d02406 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:38.677012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1af92-90e7-4f16-9efa-5dbb15d02406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:38.696671 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d438b88-3e29-4e06-bd72-675edb6759d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:38.697847 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d438b88-3e29-4e06-bd72-675edb6759d9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:38.698341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d438b88-3e29-4e06-bd72-675edb6759d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:38.698843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d438b88-3e29-4e06-bd72-675edb6759d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:38.700792 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9bd1af92-90e7-4f16-9efa-5dbb15d02406 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:38.702737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9bd1af92-90e7-4f16-9efa-5dbb15d02406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:38.710553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d438b88-3e29-4e06-bd72-675edb6759d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:38.716365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6d438b88-3e29-4e06-bd72-675edb6759d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:38.719113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:38.719963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:38.721198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 32/66] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:38.722031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c7d4-017e-4b20-950d-2ee0464b3953 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:38.722256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c7d4-017e-4b20-950d-2ee0464b3953 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:38.722700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56c7d4-017e-4b20-950d-2ee0464b3953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:38.744459 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7e56c7d4-017e-4b20-950d-2ee0464b3953 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:38.745695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7e56c7d4-017e-4b20-950d-2ee0464b3953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:38.785730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 35/67] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:38.786908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1af92-90e7-4f16-9efa-5dbb15d02406 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:38.833986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 33/68] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:38.838797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65654d-007c-4c36-8a93-864d3e70bcf3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:38.839332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65654d-007c-4c36-8a93-864d3e70bcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:38.840094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65654d-007c-4c36-8a93-864d3e70bcf3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:38.846450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 34/69] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:38.846450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65654d-007c-4c36-8a93-864d3e70bcf3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:38.900330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1af92-90e7-4f16-9efa-5dbb15d02406 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:38.936496 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8c0aa-dd91-4c1b-9427-fe44c19abb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:38.937259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c0aa-dd91-4c1b-9427-fe44c19abb8b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:38.937555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c0aa-dd91-4c1b-9427-fe44c19abb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:38.937933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c0aa-dd91-4c1b-9427-fe44c19abb8b None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:38.938699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8c0aa-dd91-4c1b-9427-fe44c19abb8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:38.939013 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8c0aa-dd91-4c1b-9427-fe44c19abb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:38.940464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8c0aa-dd91-4c1b-9427-fe44c19abb8b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:38.941045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:38.950129 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 36/70] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:09:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:38.955797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903ee80-104b-4ced-b5cc-45d66ea7ac1e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:38.956131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903ee80-104b-4ced-b5cc-45d66ea7ac1e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:38.956422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903ee80-104b-4ced-b5cc-45d66ea7ac1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:38.961167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65654d-007c-4c36-8a93-864d3e70bcf3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:38.973774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a903ee80-104b-4ced-b5cc-45d66ea7ac1e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:38.974969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a903ee80-104b-4ced-b5cc-45d66ea7ac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:38.978425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:39.002218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d2094-44ac-4741-928c-0028747781a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:39.003043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d2094-44ac-4741-928c-0028747781a4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.003335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d2094-44ac-4741-928c-0028747781a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.003623 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d2094-44ac-4741-928c-0028747781a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.015566 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d2094-44ac-4741-928c-0028747781a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2d7d2094-44ac-4741-928c-0028747781a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:39.024814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:39.025669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:39.026543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 35/71] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:09:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:39.027400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d2094-44ac-4741-928c-0028747781a4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:39.050760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 37/72] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:39.051609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903ee80-104b-4ced-b5cc-45d66ea7ac1e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:39.128740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d2094-44ac-4741-928c-0028747781a4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:39.151228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903ee80-104b-4ced-b5cc-45d66ea7ac1e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:39.163119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8357e-2a07-44f0-945d-46c8e582853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:39.163917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8357e-2a07-44f0-945d-46c8e582853e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.164233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8357e-2a07-44f0-945d-46c8e582853e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.164516 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8357e-2a07-44f0-945d-46c8e582853e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.175070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8357e-2a07-44f0-945d-46c8e582853e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5ec8357e-2a07-44f0-945d-46c8e582853e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:39.183084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:39.184081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:39.185254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 36/73] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:39.187739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64058b-ae6b-47fe-821b-213062124961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:39.188956 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64058b-ae6b-47fe-821b-213062124961 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.189247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64058b-ae6b-47fe-821b-213062124961 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.189526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64058b-ae6b-47fe-821b-213062124961 None admin] PATH_INFO: `/v3/users/01daecc16ba048b68b7a60751478124e` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.189898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ee43-f0a4-4d9b-9a8d-5b623af1bf50 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.190193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ee43-f0a4-4d9b-9a8d-5b623af1bf50 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.190476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ee43-f0a4-4d9b-9a8d-5b623af1bf50 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.191775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 37/74] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:39.192501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639ee43-f0a4-4d9b-9a8d-5b623af1bf50 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:39.196116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:39.197896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:39.207040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64058b-ae6b-47fe-821b-213062124961 None admin] RBAC: Authorizing `identity:get_user(user_id=01daecc16ba048b68b7a60751478124e)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:39.208558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64058b-ae6b-47fe-821b-213062124961 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:39.210296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 38/75] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/users/01daecc16ba048b68b7a60751478124e => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:39.211069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64058b-ae6b-47fe-821b-213062124961 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:39.297175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639ee43-f0a4-4d9b-9a8d-5b623af1bf50 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:39.312894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64058b-ae6b-47fe-821b-213062124961 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:39.330938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf28d3-b4f1-44db-8f02-73df9eae8d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:39.331614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf28d3-b4f1-44db-8f02-73df9eae8d22 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.331908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf28d3-b4f1-44db-8f02-73df9eae8d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.332232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf28d3-b4f1-44db-8f02-73df9eae8d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.332998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf28d3-b4f1-44db-8f02-73df9eae8d22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:39.333312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf28d3-b4f1-44db-8f02-73df9eae8d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:39.334723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf28d3-b4f1-44db-8f02-73df9eae8d22 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:39.344034 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 38/76] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:39.344857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf28d3-b4f1-44db-8f02-73df9eae8d22 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:39.348724 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c7561-8ab4-482d-886c-f73557243ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:39.349525 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c7561-8ab4-482d-886c-f73557243ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.349814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c7561-8ab4-482d-886c-f73557243ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.350094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c7561-8ab4-482d-886c-f73557243ae4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.361108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c7561-8ab4-482d-886c-f73557243ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-d45c7561-8ab4-482d-886c-f73557243ae4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:39.368789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:39.369631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:09:39.370379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 39/77] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:39.371217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c53f1-3d43-498f-b770-6e1a5f1216d1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.371570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c53f1-3d43-498f-b770-6e1a5f1216d1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.371853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c53f1-3d43-498f-b770-6e1a5f1216d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.388749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-dd5c53f1-3d43-498f-b770-6e1a5f1216d1 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:39.389963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dd5c53f1-3d43-498f-b770-6e1a5f1216d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:39.409933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:39.442013 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:39.450228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf28d3-b4f1-44db-8f02-73df9eae8d22 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:39.460586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 40/78] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:39.461446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c53f1-3d43-498f-b770-6e1a5f1216d1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:39.485568 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de63a1-1b05-4317-9439-8039ed9b1f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:39.486250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de63a1-1b05-4317-9439-8039ed9b1f40 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.486545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de63a1-1b05-4317-9439-8039ed9b1f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.486839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de63a1-1b05-4317-9439-8039ed9b1f40 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.487597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de63a1-1b05-4317-9439-8039ed9b1f40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:39.487917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de63a1-1b05-4317-9439-8039ed9b1f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:39.489356 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de63a1-1b05-4317-9439-8039ed9b1f40 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:39.502571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 39/79] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:39.502571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de63a1-1b05-4317-9439-8039ed9b1f40 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:39.565055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c53f1-3d43-498f-b770-6e1a5f1216d1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:39.599973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533dd74-4123-4b38-88ff-e4f3d090fe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:39.600652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533dd74-4123-4b38-88ff-e4f3d090fe3a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.600935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533dd74-4123-4b38-88ff-e4f3d090fe3a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.601220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533dd74-4123-4b38-88ff-e4f3d090fe3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.603582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de63a1-1b05-4317-9439-8039ed9b1f40 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:39.628721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:39.638583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697b63d-c250-421c-a449-b1f828f4e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:39.639470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b63d-c250-421c-a449-b1f828f4e750 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.639763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b63d-c250-421c-a449-b1f828f4e750 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.640320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b63d-c250-421c-a449-b1f828f4e750 None admin] PATH_INFO: `/v3/users/01daecc16ba048b68b7a60751478124e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.641552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697b63d-c250-421c-a449-b1f828f4e750 None admin] RBAC: Authorizing `identity:get_user(user_id=01daecc16ba048b68b7a60751478124e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:39.643016 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697b63d-c250-421c-a449-b1f828f4e750 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:39.644701 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 40/80] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/users/01daecc16ba048b68b7a60751478124e => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:39.645470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697b63d-c250-421c-a449-b1f828f4e750 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:39.661686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:39.677369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533dd74-4123-4b38-88ff-e4f3d090fe3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:39.678874 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533dd74-4123-4b38-88ff-e4f3d090fe3a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:39.744639 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697b63d-c250-421c-a449-b1f828f4e750 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:39.776452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 41/81] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:39.777599 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533dd74-4123-4b38-88ff-e4f3d090fe3a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:39.780064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1f1a5-d018-44f6-8da7-47144fad7a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:39.780771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f1a5-d018-44f6-8da7-47144fad7a06 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.781040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f1a5-d018-44f6-8da7-47144fad7a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.781326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f1a5-d018-44f6-8da7-47144fad7a06 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.782083 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1f1a5-d018-44f6-8da7-47144fad7a06 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:39.782396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1f1a5-d018-44f6-8da7-47144fad7a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:39.783795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1f1a5-d018-44f6-8da7-47144fad7a06 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:39.793037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 41/82] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:39.793843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1f1a5-d018-44f6-8da7-47144fad7a06 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:39.851588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:39.872095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:39.887883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533dd74-4123-4b38-88ff-e4f3d090fe3a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:39.902622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1f1a5-d018-44f6-8da7-47144fad7a06 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:39.923058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a4d19-d9ad-4299-989b-e61734792b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:39.923781 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4d19-d9ad-4299-989b-e61734792b1b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.924094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4d19-d9ad-4299-989b-e61734792b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.924377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4d19-d9ad-4299-989b-e61734792b1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.925549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a4d19-d9ad-4299-989b-e61734792b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:39.927011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a4d19-d9ad-4299-989b-e61734792b1b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:39.928666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 42/83] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:39.929423 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a4d19-d9ad-4299-989b-e61734792b1b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:39.937538 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eba33-1025-42fb-8b1d-89690027e25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:39.938431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eba33-1025-42fb-8b1d-89690027e25e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:39.938721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eba33-1025-42fb-8b1d-89690027e25e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:39.939010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04eba33-1025-42fb-8b1d-89690027e25e None admin] PATH_INFO: `/v3/users/10bf47ad20914307a19e97e4ac11811c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:39.940264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04eba33-1025-42fb-8b1d-89690027e25e None admin] RBAC: Authorizing `identity:get_user(user_id=10bf47ad20914307a19e97e4ac11811c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:39.941735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04eba33-1025-42fb-8b1d-89690027e25e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:39.943532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 42/84] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/users/10bf47ad20914307a19e97e4ac11811c => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:39.944179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eba33-1025-42fb-8b1d-89690027e25e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:40.037510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a4d19-d9ad-4299-989b-e61734792b1b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:40.047511 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04eba33-1025-42fb-8b1d-89690027e25e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:40.070783 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:40.073255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cba73-9a36-4b6e-91a1-c8dd813d7f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:40.073954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cba73-9a36-4b6e-91a1-c8dd813d7f77 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:40.074203 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cba73-9a36-4b6e-91a1-c8dd813d7f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:40.074489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cba73-9a36-4b6e-91a1-c8dd813d7f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:40.082113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a960f4-dc9b-4133-99de-4857e5f859c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:40.082977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a960f4-dc9b-4133-99de-4857e5f859c7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:40.083259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a960f4-dc9b-4133-99de-4857e5f859c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:40.083539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a960f4-dc9b-4133-99de-4857e5f859c7 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:40.084700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a960f4-dc9b-4133-99de-4857e5f859c7 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:40.086198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a960f4-dc9b-4133-99de-4857e5f859c7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:40.087944 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 43/85] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:40.088723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a960f4-dc9b-4133-99de-4857e5f859c7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:40.098494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:40.143913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cba73-9a36-4b6e-91a1-c8dd813d7f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:40.145430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cba73-9a36-4b6e-91a1-c8dd813d7f77 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:40.191849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a960f4-dc9b-4133-99de-4857e5f859c7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:40.225541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e8b50-8481-4645-abf5-54ce69bfaa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:40.226418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8b50-8481-4645-abf5-54ce69bfaa36 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:40.226708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8b50-8481-4645-abf5-54ce69bfaa36 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:40.226990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8b50-8481-4645-abf5-54ce69bfaa36 None admin] PATH_INFO: `/v3/users/01daecc16ba048b68b7a60751478124e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:40.228257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e8b50-8481-4645-abf5-54ce69bfaa36 None admin] RBAC: Authorizing `identity:get_user(user_id=01daecc16ba048b68b7a60751478124e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:40.229717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e8b50-8481-4645-abf5-54ce69bfaa36 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:40.231353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 44/86] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:40 2022] GET /identity/v3/users/01daecc16ba048b68b7a60751478124e => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:40.232121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e8b50-8481-4645-abf5-54ce69bfaa36 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:40.248994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 43/87] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:40.248994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cba73-9a36-4b6e-91a1-c8dd813d7f77 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:40.291250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:40.301225 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:40.334513 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e8b50-8481-4645-abf5-54ce69bfaa36 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:40.347974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cba73-9a36-4b6e-91a1-c8dd813d7f77 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:40.368250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2537-e76d-4e2c-8881-4adc845ab4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:40.369423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2537-e76d-4e2c-8881-4adc845ab4e1 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:40.369715 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2537-e76d-4e2c-8881-4adc845ab4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:40.370001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2537-e76d-4e2c-8881-4adc845ab4e1 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:40.370750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b2537-e76d-4e2c-8881-4adc845ab4e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:40.372235 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b2537-e76d-4e2c-8881-4adc845ab4e1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:40.381799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494db8a-af56-4783-ba55-0bd3948acc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:40.382452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494db8a-af56-4783-ba55-0bd3948acc6a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:40.382749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494db8a-af56-4783-ba55-0bd3948acc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:40.383033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494db8a-af56-4783-ba55-0bd3948acc6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:40.400156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 45/88] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:09:40 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:09:40.405042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2537-e76d-4e2c-8881-4adc845ab4e1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:40.462312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494db8a-af56-4783-ba55-0bd3948acc6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:40.464107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494db8a-af56-4783-ba55-0bd3948acc6a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:40.528410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:40.541067 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2537-e76d-4e2c-8881-4adc845ab4e1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:40.562629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:40.582629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 44/89] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:40.583577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494db8a-af56-4783-ba55-0bd3948acc6a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:40.593468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6fc72-bf06-404e-8aa9-e32579a5f374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:40.593973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6fc72-bf06-404e-8aa9-e32579a5f374 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:40.594257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6fc72-bf06-404e-8aa9-e32579a5f374 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:40.594534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6fc72-bf06-404e-8aa9-e32579a5f374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:40.595377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6fc72-bf06-404e-8aa9-e32579a5f374 None admin] RBAC: Adding query filter params (role.id=dda86b29d55a42c48f50fdd9fc4d5b61, scope.project.id=fa0ac34fcb3543da82900c7dad597219, user.id=01daecc16ba048b68b7a60751478124e) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:40.595695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6fc72-bf06-404e-8aa9-e32579a5f374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:40.597195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6fc72-bf06-404e-8aa9-e32579a5f374 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:40.606332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 46/90] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:40 2022] GET /identity/v3/role_assignments?user.id=01daecc16ba048b68b7a60751478124e&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:40.607276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6fc72-bf06-404e-8aa9-e32579a5f374 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:40.731142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494db8a-af56-4783-ba55-0bd3948acc6a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:40.761312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6fc72-bf06-404e-8aa9-e32579a5f374 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:40.786528 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76693e2-1e20-4932-959a-7254936ceecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:40.787491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76693e2-1e20-4932-959a-7254936ceecf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:40.787985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76693e2-1e20-4932-959a-7254936ceecf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:40.788471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76693e2-1e20-4932-959a-7254936ceecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:40.806802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b17b9b-4588-44bf-a56d-73bc566c59ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:40.807682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b17b9b-4588-44bf-a56d-73bc566c59ca None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:40.807974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b17b9b-4588-44bf-a56d-73bc566c59ca None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:40.808287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b17b9b-4588-44bf-a56d-73bc566c59ca None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:40.809559 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b17b9b-4588-44bf-a56d-73bc566c59ca None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:40.811038 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b17b9b-4588-44bf-a56d-73bc566c59ca None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:40.812979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 47/91] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:40 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:40.813602 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b17b9b-4588-44bf-a56d-73bc566c59ca None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:40.829762 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:40.873185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76693e2-1e20-4932-959a-7254936ceecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:40.874665 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76693e2-1e20-4932-959a-7254936ceecf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:40.887571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:40.944523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b17b9b-4588-44bf-a56d-73bc566c59ca None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:40.983729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c1955-e68b-4411-8866-96c43800983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:40.984553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c1955-e68b-4411-8866-96c43800983f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:40.984839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c1955-e68b-4411-8866-96c43800983f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:40.985247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c1955-e68b-4411-8866-96c43800983f None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:40.986454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c1955-e68b-4411-8866-96c43800983f None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:40.987988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c1955-e68b-4411-8866-96c43800983f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:40.989806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 48/92] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:40 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:40.990681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c1955-e68b-4411-8866-96c43800983f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:40.992376 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 45/93] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:40.995605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76693e2-1e20-4932-959a-7254936ceecf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:41.059789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:41.100378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c1955-e68b-4411-8866-96c43800983f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:41.111743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76693e2-1e20-4932-959a-7254936ceecf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:41.117637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:41.137288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98309d67-8c96-43b7-88d9-8ec6187ad34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:41.138094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98309d67-8c96-43b7-88d9-8ec6187ad34d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:41.138487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98309d67-8c96-43b7-88d9-8ec6187ad34d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:41.138832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98309d67-8c96-43b7-88d9-8ec6187ad34d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:41.139754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98309d67-8c96-43b7-88d9-8ec6187ad34d None admin] RBAC: Adding query filter params (role.id=0ec7b267a5724203a4845cf7da3a6ab8, scope.project.id=fa0ac34fcb3543da82900c7dad597219, user.id=01daecc16ba048b68b7a60751478124e) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:41.140367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98309d67-8c96-43b7-88d9-8ec6187ad34d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:41.141919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98309d67-8c96-43b7-88d9-8ec6187ad34d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:41.147875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 49/94] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:40 2022] GET /identity/v3/role_assignments?user.id=01daecc16ba048b68b7a60751478124e&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=0ec7b267a5724203a4845cf7da3a6ab8 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:41.148804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98309d67-8c96-43b7-88d9-8ec6187ad34d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:41.159749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfca62e-1743-4d26-983d-e96400090646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:41.160574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfca62e-1743-4d26-983d-e96400090646 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:41.160868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfca62e-1743-4d26-983d-e96400090646 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:41.161153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfca62e-1743-4d26-983d-e96400090646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:41.162019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfca62e-1743-4d26-983d-e96400090646 None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=fa0ac34fcb3543da82900c7dad597219, user.id=10bf47ad20914307a19e97e4ac11811c) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:41.162449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfca62e-1743-4d26-983d-e96400090646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:41.164090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfca62e-1743-4d26-983d-e96400090646 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:41.181382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 46/95] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:40 2022] GET /identity/v3/role_assignments?user.id=10bf47ad20914307a19e97e4ac11811c&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:41.276433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98309d67-8c96-43b7-88d9-8ec6187ad34d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:41.315040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5350dd-0b0d-4842-b366-0ccbb2518d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:41.315991 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5350dd-0b0d-4842-b366-0ccbb2518d1e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:41.316318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5350dd-0b0d-4842-b366-0ccbb2518d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:41.316603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5350dd-0b0d-4842-b366-0ccbb2518d1e None admin] PATH_INFO: `/v3/projects/73972f17f85b42e59527a8a67b7f2236` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:41.317939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5350dd-0b0d-4842-b366-0ccbb2518d1e None admin] RBAC: Authorizing `identity:get_project(project_id=73972f17f85b42e59527a8a67b7f2236)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:41.319438 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5350dd-0b0d-4842-b366-0ccbb2518d1e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:41.321537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 50/96] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:41 2022] GET /identity/v3/projects/73972f17f85b42e59527a8a67b7f2236 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:41.328082 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfca62e-1743-4d26-983d-e96400090646 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:41.470012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfca62e-1743-4d26-983d-e96400090646 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:41.490044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:41.511383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002139b-1348-4e5c-b32d-7c443efe5103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:41.512136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002139b-1348-4e5c-b32d-7c443efe5103 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:41.512428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002139b-1348-4e5c-b32d-7c443efe5103 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:41.512712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002139b-1348-4e5c-b32d-7c443efe5103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:41.513572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002139b-1348-4e5c-b32d-7c443efe5103 None admin] RBAC: Adding query filter params (role.id=dda86b29d55a42c48f50fdd9fc4d5b61, scope.project.id=73972f17f85b42e59527a8a67b7f2236, user.id=01daecc16ba048b68b7a60751478124e) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:41.513891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002139b-1348-4e5c-b32d-7c443efe5103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:41.515620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002139b-1348-4e5c-b32d-7c443efe5103 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:41.521685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 47/97] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:41 2022] GET /identity/v3/role_assignments?user.id=01daecc16ba048b68b7a60751478124e&scope.project.id=73972f17f85b42e59527a8a67b7f2236&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:43.269768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89012f2-9a23-444c-95f9-4872c1c96230 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:43.270447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89012f2-9a23-444c-95f9-4872c1c96230 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:43.270447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89012f2-9a23-444c-95f9-4872c1c96230 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:43.271802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 51/98] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:09:43.277319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f614a1-5ae0-4a6f-963f-a3088e943782 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:43.277819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f614a1-5ae0-4a6f-963f-a3088e943782 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:43.277968 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f614a1-5ae0-4a6f-963f-a3088e943782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:43.296504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-28f614a1-5ae0-4a6f-963f-a3088e943782 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:43.297754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-28f614a1-5ae0-4a6f-963f-a3088e943782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:43.382737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 48/99] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:43.415665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89012f2-9a23-444c-95f9-4872c1c96230 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:43.480885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:43.516472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52036a90-9a37-48b7-b23b-972de30c42b8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:43.516782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52036a90-9a37-48b7-b23b-972de30c42b8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:43.517039 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52036a90-9a37-48b7-b23b-972de30c42b8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:43.518414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 49/100] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:43.523454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b2680-5187-4251-b57c-0c1b4e245e41 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:43.523664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b2680-5187-4251-b57c-0c1b4e245e41 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:43.523944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b2680-5187-4251-b57c-0c1b4e245e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:43.541632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ac4b2680-5187-4251-b57c-0c1b4e245e41 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:43.543689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ac4b2680-5187-4251-b57c-0c1b4e245e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:43.546909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89012f2-9a23-444c-95f9-4872c1c96230 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:43.608826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85f511-6038-4e65-ba27-1cc2e7d73094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:43.609632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85f511-6038-4e65-ba27-1cc2e7d73094 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:43.609920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85f511-6038-4e65-ba27-1cc2e7d73094 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:43.610196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85f511-6038-4e65-ba27-1cc2e7d73094 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:43.630894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85f511-6038-4e65-ba27-1cc2e7d73094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2d85f511-6038-4e65-ba27-1cc2e7d73094 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:43.638845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:43.639681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:43.640702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 52/101] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:43.641808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6d757-71c0-4e20-815c-380b81508e9f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:43.642057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6d757-71c0-4e20-815c-380b81508e9f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:43.642484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6d757-71c0-4e20-815c-380b81508e9f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:43.643767 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 53/102] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:43.651702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623ddb0-8967-4469-895d-6dc9b172d1ad None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:43.652117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623ddb0-8967-4469-895d-6dc9b172d1ad None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:43.652406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623ddb0-8967-4469-895d-6dc9b172d1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:43.675452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5623ddb0-8967-4469-895d-6dc9b172d1ad None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:43.676777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5623ddb0-8967-4469-895d-6dc9b172d1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:43.678435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 50/103] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:09:43.679303 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b2680-5187-4251-b57c-0c1b4e245e41 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:43.752298 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:43.816422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 54/104] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:43.817531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623ddb0-8967-4469-895d-6dc9b172d1ad None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:43.870970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b2680-5187-4251-b57c-0c1b4e245e41 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:43.908414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:43.940668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b02db3-f6ea-4b0c-baea-2f7429149a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:43.941353 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b02db3-f6ea-4b0c-baea-2f7429149a00 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:43.941645 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b02db3-f6ea-4b0c-baea-2f7429149a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:43.941931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b02db3-f6ea-4b0c-baea-2f7429149a00 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:43.942698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b02db3-f6ea-4b0c-baea-2f7429149a00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:43.943010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b02db3-f6ea-4b0c-baea-2f7429149a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:43.944436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b02db3-f6ea-4b0c-baea-2f7429149a00 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:43.953187 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 51/105] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:09:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:43.954250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b02db3-f6ea-4b0c-baea-2f7429149a00 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:44.013544 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623ddb0-8967-4469-895d-6dc9b172d1ad None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:44.080219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c523c-f1a3-4a68-b632-2a1635796522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:44.080963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c523c-f1a3-4a68-b632-2a1635796522 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.081253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c523c-f1a3-4a68-b632-2a1635796522 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.081537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c523c-f1a3-4a68-b632-2a1635796522 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.105996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c523c-f1a3-4a68-b632-2a1635796522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-da1c523c-f1a3-4a68-b632-2a1635796522 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:44.113894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:44.114745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:44.115517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 55/106] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:44.116175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c523c-f1a3-4a68-b632-2a1635796522 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:44.144378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b02db3-f6ea-4b0c-baea-2f7429149a00 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:44.152948 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:44.207519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3b5db-98ad-4a67-88d8-e99298336a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:44.208400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3b5db-98ad-4a67-88d8-e99298336a9b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.208695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3b5db-98ad-4a67-88d8-e99298336a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.208976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3b5db-98ad-4a67-88d8-e99298336a9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.210861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3b5db-98ad-4a67-88d8-e99298336a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:44.214134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3b5db-98ad-4a67-88d8-e99298336a9b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:44.216654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 52/107] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:44.217438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3b5db-98ad-4a67-88d8-e99298336a9b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:44.297287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:44.302158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c523c-f1a3-4a68-b632-2a1635796522 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:44.346039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609e2dc-a934-4e56-809e-2924a4845300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:44.346904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609e2dc-a934-4e56-809e-2924a4845300 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.347229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609e2dc-a934-4e56-809e-2924a4845300 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.347520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609e2dc-a934-4e56-809e-2924a4845300 None admin] PATH_INFO: `/v3/users/51effb8068114236ac8e5a18fc130c81` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.362252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609e2dc-a934-4e56-809e-2924a4845300 None admin] RBAC: Authorizing `identity:get_user(user_id=51effb8068114236ac8e5a18fc130c81)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:44.363736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609e2dc-a934-4e56-809e-2924a4845300 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:44.365812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 56/108] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:44 2022] GET /identity/v3/users/51effb8068114236ac8e5a18fc130c81 => generated 289 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:44.366373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609e2dc-a934-4e56-809e-2924a4845300 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:44.373406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3b5db-98ad-4a67-88d8-e99298336a9b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:44.424861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5d841-8cc5-43e8-80ea-b12229980a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:44.425793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d841-8cc5-43e8-80ea-b12229980a34 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.426498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d841-8cc5-43e8-80ea-b12229980a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.426788 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d841-8cc5-43e8-80ea-b12229980a34 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.427558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5d841-8cc5-43e8-80ea-b12229980a34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:44.427871 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5d841-8cc5-43e8-80ea-b12229980a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:44.429297 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5d841-8cc5-43e8-80ea-b12229980a34 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:44.442604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 53/109] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:09:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:44.444034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1a46-0c40-4d01-9531-ea0ea45f59c8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.444397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1a46-0c40-4d01-9531-ea0ea45f59c8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.444689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1a46-0c40-4d01-9531-ea0ea45f59c8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.450856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 54/110] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:44.452349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1a46-0c40-4d01-9531-ea0ea45f59c8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:44.493448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609e2dc-a934-4e56-809e-2924a4845300 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:44.503413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:44.531016 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f02b72-01af-40f1-ac86-2a4f4362d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:44.531680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02b72-01af-40f1-ac86-2a4f4362d8b4 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.531966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02b72-01af-40f1-ac86-2a4f4362d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.532419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02b72-01af-40f1-ac86-2a4f4362d8b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.533304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f02b72-01af-40f1-ac86-2a4f4362d8b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:44.534448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f02b72-01af-40f1-ac86-2a4f4362d8b4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:44.563466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 57/111] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:09:44 2022] POST /identity/v3/projects => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:09:44.564341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f02b72-01af-40f1-ac86-2a4f4362d8b4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:44.581846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:44.599973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1a46-0c40-4d01-9531-ea0ea45f59c8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:44.638226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2c899-fbec-4165-b36f-3eb01ceab00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:44.638907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2c899-fbec-4165-b36f-3eb01ceab00d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.639199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2c899-fbec-4165-b36f-3eb01ceab00d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.639495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2c899-fbec-4165-b36f-3eb01ceab00d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.696960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f02b72-01af-40f1-ac86-2a4f4362d8b4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:44.724234 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2c899-fbec-4165-b36f-3eb01ceab00d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:44.726996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2c899-fbec-4165-b36f-3eb01ceab00d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:44.736660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2f53f-3b7e-4047-be7c-ce43fb9b1087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:44.737555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2f53f-3b7e-4047-be7c-ce43fb9b1087 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.737848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2f53f-3b7e-4047-be7c-ce43fb9b1087 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.738139 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2f53f-3b7e-4047-be7c-ce43fb9b1087 None admin] PATH_INFO: `/v3/users/01daecc16ba048b68b7a60751478124e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.739376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2f53f-3b7e-4047-be7c-ce43fb9b1087 None admin] RBAC: Authorizing `identity:get_user(user_id=01daecc16ba048b68b7a60751478124e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:44.740887 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2f53f-3b7e-4047-be7c-ce43fb9b1087 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:44.743568 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 58/112] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:44 2022] GET /identity/v3/users/01daecc16ba048b68b7a60751478124e => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:44.744714 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dda7e-c0cb-410f-8e31-8a03349938d3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.744714 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dda7e-c0cb-410f-8e31-8a03349938d3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.748190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dda7e-c0cb-410f-8e31-8a03349938d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.763442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d99dda7e-c0cb-410f-8e31-8a03349938d3 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:44.764676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d99dda7e-c0cb-410f-8e31-8a03349938d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:44.768007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:44.841846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 59/113] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:44.842980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b2f2-9119-4967-a969-fc9908bb0bfd None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.843271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b2f2-9119-4967-a969-fc9908bb0bfd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.843551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b2f2-9119-4967-a969-fc9908bb0bfd None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.845233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 60/114] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:44.846133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66664910-59a7-4c24-a3b9-693aef984a0b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.846421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66664910-59a7-4c24-a3b9-693aef984a0b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.846700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66664910-59a7-4c24-a3b9-693aef984a0b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.848073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 61/115] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:44.848632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66664910-59a7-4c24-a3b9-693aef984a0b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:44.860398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:44.867034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 55/116] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:44.868579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a4e1-fb3e-48f6-8bae-94ddb04e9e87 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.868759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a4e1-fb3e-48f6-8bae-94ddb04e9e87 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.868992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a4e1-fb3e-48f6-8bae-94ddb04e9e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.887065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-43a5a4e1-fb3e-48f6-8bae-94ddb04e9e87 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:44.888302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-43a5a4e1-fb3e-48f6-8bae-94ddb04e9e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:44.958061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 56/117] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:44.959426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cf705-9f84-4aed-acbf-bdfaa4dc1274 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:44.959726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cf705-9f84-4aed-acbf-bdfaa4dc1274 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:44.960011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cf705-9f84-4aed-acbf-bdfaa4dc1274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:44.974993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66664910-59a7-4c24-a3b9-693aef984a0b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:44.978862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a29cf705-9f84-4aed-acbf-bdfaa4dc1274 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:44.979406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a29cf705-9f84-4aed-acbf-bdfaa4dc1274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:45.017121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c27dd4-1eb3-4611-bb6a-e01dc23de5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:45.018000 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c27dd4-1eb3-4611-bb6a-e01dc23de5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:45.018286 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c27dd4-1eb3-4611-bb6a-e01dc23de5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:45.018568 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c27dd4-1eb3-4611-bb6a-e01dc23de5f6 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:45.019769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c27dd4-1eb3-4611-bb6a-e01dc23de5f6 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:45.021278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c27dd4-1eb3-4611-bb6a-e01dc23de5f6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:45.023154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 62/118] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:44 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:45.028895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c27dd4-1eb3-4611-bb6a-e01dc23de5f6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:45.046837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:45.060185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 57/119] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:45.061373 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cf705-9f84-4aed-acbf-bdfaa4dc1274 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:45.110246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:45.136971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c27dd4-1eb3-4611-bb6a-e01dc23de5f6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:45.174182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2b8a-4332-4f9a-8fed-0cb6f530175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:45.174981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2b8a-4332-4f9a-8fed-0cb6f530175c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:45.175268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2b8a-4332-4f9a-8fed-0cb6f530175c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:45.175456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cf705-9f84-4aed-acbf-bdfaa4dc1274 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:45.175578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2b8a-4332-4f9a-8fed-0cb6f530175c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:45.187512 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb2b8a-4332-4f9a-8fed-0cb6f530175c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-efcb2b8a-4332-4f9a-8fed-0cb6f530175c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:45.196263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:45.197119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:45.197889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 63/120] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:45.198508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2b8a-4332-4f9a-8fed-0cb6f530175c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:45.218832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3542cd9-0787-4804-ae72-5ecb047c6966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:45.219977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3542cd9-0787-4804-ae72-5ecb047c6966 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:45.220307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3542cd9-0787-4804-ae72-5ecb047c6966 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:45.220589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3542cd9-0787-4804-ae72-5ecb047c6966 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:45.222209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3542cd9-0787-4804-ae72-5ecb047c6966 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:45.223864 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3542cd9-0787-4804-ae72-5ecb047c6966 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:45.230195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 58/121] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:45 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:45.230195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3542cd9-0787-4804-ae72-5ecb047c6966 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:45.297486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:45.312634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2b8a-4332-4f9a-8fed-0cb6f530175c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:45.338788 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3542cd9-0787-4804-ae72-5ecb047c6966 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:45.350402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a30f-7994-449c-8d40-19f27af64980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:45.351222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a30f-7994-449c-8d40-19f27af64980 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:45.351514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a30f-7994-449c-8d40-19f27af64980 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:45.351801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a30f-7994-449c-8d40-19f27af64980 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:45.354624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:45.367646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8a30f-7994-449c-8d40-19f27af64980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b7a8a30f-7994-449c-8d40-19f27af64980 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:45.375832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:45.376766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:45.377501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 64/122] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:09:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:45.378201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a30f-7994-449c-8d40-19f27af64980 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:45.384545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c585852-eb74-41d4-bb42-cf6546ebee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:45.385503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585852-eb74-41d4-bb42-cf6546ebee8e None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:45.385798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585852-eb74-41d4-bb42-cf6546ebee8e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:45.386079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585852-eb74-41d4-bb42-cf6546ebee8e None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219/users/01daecc16ba048b68b7a60751478124e/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:45.388167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c585852-eb74-41d4-bb42-cf6546ebee8e None admin] RBAC: Authorizing `identity:create_grant(project_id=fa0ac34fcb3543da82900c7dad597219, user_id=01daecc16ba048b68b7a60751478124e, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:45.389763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c585852-eb74-41d4-bb42-cf6546ebee8e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:45.406687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 59/123] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:09:45 2022] PUT /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219/users/01daecc16ba048b68b7a60751478124e/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:09:45.417392 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c585852-eb74-41d4-bb42-cf6546ebee8e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:45.521104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a30f-7994-449c-8d40-19f27af64980 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:45.561672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee9d78-a142-45dc-8b43-5d3074ff65e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:45.562725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c585852-eb74-41d4-bb42-cf6546ebee8e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:45.563303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9d78-a142-45dc-8b43-5d3074ff65e5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:45.563669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9d78-a142-45dc-8b43-5d3074ff65e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:45.564050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9d78-a142-45dc-8b43-5d3074ff65e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:45.580009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee9d78-a142-45dc-8b43-5d3074ff65e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f8ee9d78-a142-45dc-8b43-5d3074ff65e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:45.588243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:45.589115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:45.589866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:45.592167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 65/124] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:09:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:45.593161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee9d78-a142-45dc-8b43-5d3074ff65e5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:45.598674 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:45.615947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c93ff-a4de-409e-a8a2-d022b4ae3003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:45.616718 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c93ff-a4de-409e-a8a2-d022b4ae3003 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:45.617013 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c93ff-a4de-409e-a8a2-d022b4ae3003 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:45.617296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c93ff-a4de-409e-a8a2-d022b4ae3003 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:45.618122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c93ff-a4de-409e-a8a2-d022b4ae3003 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:45.618446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c93ff-a4de-409e-a8a2-d022b4ae3003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:45.619838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c93ff-a4de-409e-a8a2-d022b4ae3003 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:45.631995 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 60/125] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:09:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:45.632876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c93ff-a4de-409e-a8a2-d022b4ae3003 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:45.670688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:45.738050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee9d78-a142-45dc-8b43-5d3074ff65e5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:45.767368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c93ff-a4de-409e-a8a2-d022b4ae3003 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:45.786578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf82fc-0ba7-4bca-875a-9ef40f8219e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:45.787569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf82fc-0ba7-4bca-875a-9ef40f8219e7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:45.788086 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf82fc-0ba7-4bca-875a-9ef40f8219e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:45.788564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf82fc-0ba7-4bca-875a-9ef40f8219e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:45.789604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf82fc-0ba7-4bca-875a-9ef40f8219e7 None admin] RBAC: Adding query filter params (role.id=0473bb110e5b46a28efa9ef9abc7659b, scope.project.id=fa0ac34fcb3543da82900c7dad597219, user.id=51effb8068114236ac8e5a18fc130c81) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:45.790745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf82fc-0ba7-4bca-875a-9ef40f8219e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:45.792452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf82fc-0ba7-4bca-875a-9ef40f8219e7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:45.798698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 66/126] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:45 2022] GET /identity/v3/role_assignments?user.id=51effb8068114236ac8e5a18fc130c81&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=0473bb110e5b46a28efa9ef9abc7659b => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:45.799875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf82fc-0ba7-4bca-875a-9ef40f8219e7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:45.805853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c28d-ecdb-471a-912f-9aa4175d06c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:45.806613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c28d-ecdb-471a-912f-9aa4175d06c0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:45.806908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c28d-ecdb-471a-912f-9aa4175d06c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:45.807189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c28d-ecdb-471a-912f-9aa4175d06c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:45.807978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809c28d-ecdb-471a-912f-9aa4175d06c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:45.808329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809c28d-ecdb-471a-912f-9aa4175d06c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:45.809779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809c28d-ecdb-471a-912f-9aa4175d06c0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:45.822548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 61/127] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:09:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:45.823429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c28d-ecdb-471a-912f-9aa4175d06c0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:45.880669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:45.919645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf82fc-0ba7-4bca-875a-9ef40f8219e7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:45.939830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:45.942479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c28d-ecdb-471a-912f-9aa4175d06c0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:45.960462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879680-52e4-427d-9287-b2ad8e018c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:45.961547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879680-52e4-427d-9287-b2ad8e018c06 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:45.962613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879680-52e4-427d-9287-b2ad8e018c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:45.963117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879680-52e4-427d-9287-b2ad8e018c06 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:45.964521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b879680-52e4-427d-9287-b2ad8e018c06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:45.965084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b879680-52e4-427d-9287-b2ad8e018c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:45.966799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b879680-52e4-427d-9287-b2ad8e018c06 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:45.976179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 67/128] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:45.978042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879680-52e4-427d-9287-b2ad8e018c06 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:45.983012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f672526-6a5c-4aa6-897d-636146e6b3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:45.983340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f672526-6a5c-4aa6-897d-636146e6b3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:45.983630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f672526-6a5c-4aa6-897d-636146e6b3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:45.983916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f672526-6a5c-4aa6-897d-636146e6b3d7 None admin] PATH_INFO: `/v3/users/01daecc16ba048b68b7a60751478124e` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:45.985339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f672526-6a5c-4aa6-897d-636146e6b3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=01daecc16ba048b68b7a60751478124e)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:45.986833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f672526-6a5c-4aa6-897d-636146e6b3d7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:45.988869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 62/129] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:45 2022] GET /identity/v3/users/01daecc16ba048b68b7a60751478124e => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:45.990260 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f672526-6a5c-4aa6-897d-636146e6b3d7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:46.093577 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879680-52e4-427d-9287-b2ad8e018c06 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:46.101783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f672526-6a5c-4aa6-897d-636146e6b3d7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:46.117924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:46.132420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889a19a-7bc1-4fa0-8e83-acc81af6e6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:46.133687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889a19a-7bc1-4fa0-8e83-acc81af6e6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:46.134197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889a19a-7bc1-4fa0-8e83-acc81af6e6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:46.134678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889a19a-7bc1-4fa0-8e83-acc81af6e6f8 None admin] PATH_INFO: `/v3/users/01daecc16ba048b68b7a60751478124e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:46.136130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889a19a-7bc1-4fa0-8e83-acc81af6e6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=01daecc16ba048b68b7a60751478124e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:46.137792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889a19a-7bc1-4fa0-8e83-acc81af6e6f8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:46.140010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 68/130] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:45 2022] GET /identity/v3/users/01daecc16ba048b68b7a60751478124e => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:46.141369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889a19a-7bc1-4fa0-8e83-acc81af6e6f8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:46.144809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f9767-8406-49f5-b175-b48444910901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:46.146162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9767-8406-49f5-b175-b48444910901 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:46.146162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9767-8406-49f5-b175-b48444910901 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:46.146347 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9767-8406-49f5-b175-b48444910901 None admin] PATH_INFO: `/v3/users/10bf47ad20914307a19e97e4ac11811c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:46.147752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f9767-8406-49f5-b175-b48444910901 None admin] RBAC: Authorizing `identity:get_user(user_id=10bf47ad20914307a19e97e4ac11811c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:46.149799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f9767-8406-49f5-b175-b48444910901 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:46.151608 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 63/131] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:45 2022] GET /identity/v3/users/10bf47ad20914307a19e97e4ac11811c => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:46.152250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f9767-8406-49f5-b175-b48444910901 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:46.197966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:46.254062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889a19a-7bc1-4fa0-8e83-acc81af6e6f8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:46.261690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f9767-8406-49f5-b175-b48444910901 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:46.291564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4069-9ae6-4589-8fbc-224d2c4d8710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:46.292842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4069-9ae6-4589-8fbc-224d2c4d8710 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:46.293351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4069-9ae6-4589-8fbc-224d2c4d8710 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:46.293852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4069-9ae6-4589-8fbc-224d2c4d8710 None admin] PATH_INFO: `/v3/projects/73972f17f85b42e59527a8a67b7f2236` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:46.295279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee4069-9ae6-4589-8fbc-224d2c4d8710 None admin] RBAC: Authorizing `identity:get_project(project_id=73972f17f85b42e59527a8a67b7f2236)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:46.297017 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee4069-9ae6-4589-8fbc-224d2c4d8710 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:46.298323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12818d-31a8-453f-be92-1e946f687d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:46.299241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 69/132] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:46 2022] GET /identity/v3/projects/73972f17f85b42e59527a8a67b7f2236 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:46.299500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12818d-31a8-453f-be92-1e946f687d87 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:46.299785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12818d-31a8-453f-be92-1e946f687d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:46.300107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12818d-31a8-453f-be92-1e946f687d87 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:46.301003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4069-9ae6-4589-8fbc-224d2c4d8710 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:46.301436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12818d-31a8-453f-be92-1e946f687d87 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:46.302952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12818d-31a8-453f-be92-1e946f687d87 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:46.304905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 64/133] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:46 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:46.305720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12818d-31a8-453f-be92-1e946f687d87 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:46.358696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:46.411528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4069-9ae6-4589-8fbc-224d2c4d8710 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:46.412568 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12818d-31a8-453f-be92-1e946f687d87 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:46.430344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:46.449651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127ef3-9a2c-4c4b-b1bd-973bae63e34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:46.450643 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127ef3-9a2c-4c4b-b1bd-973bae63e34d None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:46.450984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127ef3-9a2c-4c4b-b1bd-973bae63e34d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:46.451276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127ef3-9a2c-4c4b-b1bd-973bae63e34d None admin] PATH_INFO: `/v3/projects/73972f17f85b42e59527a8a67b7f2236/users/01daecc16ba048b68b7a60751478124e/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:46.451743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44182796-b4f3-4d23-bb85-97af24b4eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:46.452875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44182796-b4f3-4d23-bb85-97af24b4eec9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:46.453372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44182796-b4f3-4d23-bb85-97af24b4eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:46.453860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44182796-b4f3-4d23-bb85-97af24b4eec9 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:46.457257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44182796-b4f3-4d23-bb85-97af24b4eec9 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:46.458196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef127ef3-9a2c-4c4b-b1bd-973bae63e34d None admin] RBAC: Authorizing `identity:create_grant(project_id=73972f17f85b42e59527a8a67b7f2236, user_id=01daecc16ba048b68b7a60751478124e, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:46.461019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef127ef3-9a2c-4c4b-b1bd-973bae63e34d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:46.461852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44182796-b4f3-4d23-bb85-97af24b4eec9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:46.467224 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 70/134] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:46 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:46.468493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44182796-b4f3-4d23-bb85-97af24b4eec9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:46.499908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 65/135] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:09:46 2022] PUT /identity/v3/projects/73972f17f85b42e59527a8a67b7f2236/users/01daecc16ba048b68b7a60751478124e/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:09:46.500888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127ef3-9a2c-4c4b-b1bd-973bae63e34d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:46.675254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44182796-b4f3-4d23-bb85-97af24b4eec9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:46.703627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127ef3-9a2c-4c4b-b1bd-973bae63e34d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:46.721594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:46.738288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cba35-49e2-4964-afe7-c135c598ad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:46.739223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cba35-49e2-4964-afe7-c135c598ad98 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:46.739511 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cba35-49e2-4964-afe7-c135c598ad98 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:46.739792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cba35-49e2-4964-afe7-c135c598ad98 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219/users/01daecc16ba048b68b7a60751478124e/roles/0ec7b267a5724203a4845cf7da3a6ab8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:46.742467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cba35-49e2-4964-afe7-c135c598ad98 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa0ac34fcb3543da82900c7dad597219, user_id=01daecc16ba048b68b7a60751478124e, role_id=0ec7b267a5724203a4845cf7da3a6ab8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:46.744147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cba35-49e2-4964-afe7-c135c598ad98 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:46.766460 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48a3e7-cd8e-4b98-a331-f70c720ba3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:46.767393 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48a3e7-cd8e-4b98-a331-f70c720ba3e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:46.767690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48a3e7-cd8e-4b98-a331-f70c720ba3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:46.770155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48a3e7-cd8e-4b98-a331-f70c720ba3e7 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219/users/10bf47ad20914307a19e97e4ac11811c/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:46.771626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 71/136] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:09:46 2022] PUT /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219/users/01daecc16ba048b68b7a60751478124e/roles/0ec7b267a5724203a4845cf7da3a6ab8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:09:46.772941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48a3e7-cd8e-4b98-a331-f70c720ba3e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa0ac34fcb3543da82900c7dad597219, user_id=10bf47ad20914307a19e97e4ac11811c, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:46.774990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48a3e7-cd8e-4b98-a331-f70c720ba3e7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:46.795355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 66/137] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:09:46 2022] PUT /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219/users/10bf47ad20914307a19e97e4ac11811c/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:09:47.020228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe9280-8287-4d17-a462-4bf9b2cc7d4c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:47.020576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe9280-8287-4d17-a462-4bf9b2cc7d4c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:47.020753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe9280-8287-4d17-a462-4bf9b2cc7d4c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:47.022142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 72/138] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:47.028008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12bcdf-f568-4e8e-90be-ecd15acf75b5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:47.028327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12bcdf-f568-4e8e-90be-ecd15acf75b5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:47.028623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12bcdf-f568-4e8e-90be-ecd15acf75b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:47.049811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3d12bcdf-f568-4e8e-90be-ecd15acf75b5 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:47.051040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3d12bcdf-f568-4e8e-90be-ecd15acf75b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:47.130863 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 67/139] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:47.156411 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe9280-8287-4d17-a462-4bf9b2cc7d4c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:47.233848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:47.312825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe9280-8287-4d17-a462-4bf9b2cc7d4c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:47.357822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57a201-15d1-403f-ad66-10ef43856419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:47.358630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57a201-15d1-403f-ad66-10ef43856419 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:47.358919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57a201-15d1-403f-ad66-10ef43856419 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:47.359200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57a201-15d1-403f-ad66-10ef43856419 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:47.360427 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57a201-15d1-403f-ad66-10ef43856419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:47.361898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57a201-15d1-403f-ad66-10ef43856419 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:47.363557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 73/140] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:47.370305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12bcdf-f568-4e8e-90be-ecd15acf75b5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:47.491977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:47.498443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12bcdf-f568-4e8e-90be-ecd15acf75b5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:47.548772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc76ab-cfc7-4391-ac53-6622a3a09788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:47.549470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc76ab-cfc7-4391-ac53-6622a3a09788 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:47.549764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc76ab-cfc7-4391-ac53-6622a3a09788 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:47.550049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc76ab-cfc7-4391-ac53-6622a3a09788 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:47.550793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc76ab-cfc7-4391-ac53-6622a3a09788 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:47.552291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc76ab-cfc7-4391-ac53-6622a3a09788 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:47.581324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 68/141] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:09:47 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:09:48.058428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c50226-1635-4d25-aef9-ae7ab9bd25e0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:48.058973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c50226-1635-4d25-aef9-ae7ab9bd25e0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:48.058973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c50226-1635-4d25-aef9-ae7ab9bd25e0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:48.060404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 74/142] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:48.065980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57020-c939-4c49-bca3-18ff60cce443 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:48.066422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57020-c939-4c49-bca3-18ff60cce443 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:48.066843 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57020-c939-4c49-bca3-18ff60cce443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:48.088180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a0f57020-c939-4c49-bca3-18ff60cce443 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:48.089390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a0f57020-c939-4c49-bca3-18ff60cce443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:48.178267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 69/143] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:48.208367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c50226-1635-4d25-aef9-ae7ab9bd25e0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:48.344855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c50226-1635-4d25-aef9-ae7ab9bd25e0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:48.358907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:48.381689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea976d-3af7-4265-90bc-fed91fe097c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:48.382501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea976d-3af7-4265-90bc-fed91fe097c9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:48.382789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea976d-3af7-4265-90bc-fed91fe097c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:48.383072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea976d-3af7-4265-90bc-fed91fe097c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:48.394876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea976d-3af7-4265-90bc-fed91fe097c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-28ea976d-3af7-4265-90bc-fed91fe097c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:48.402818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:48.403718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:48.404551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 75/144] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:48.409977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57020-c939-4c49-bca3-18ff60cce443 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:48.514899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:48.532275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57020-c939-4c49-bca3-18ff60cce443 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:48.575903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4038e-dd4e-41f5-880c-71fdf17ae24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:48.576628 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4038e-dd4e-41f5-880c-71fdf17ae24a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:48.576919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4038e-dd4e-41f5-880c-71fdf17ae24a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:48.577206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4038e-dd4e-41f5-880c-71fdf17ae24a None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:48.577979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4038e-dd4e-41f5-880c-71fdf17ae24a None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:48.578294 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4038e-dd4e-41f5-880c-71fdf17ae24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:48.579714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4038e-dd4e-41f5-880c-71fdf17ae24a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:48.589271 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 70/145] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:09:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:48.594991 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea976d-3af7-4265-90bc-fed91fe097c9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:48.701632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea976d-3af7-4265-90bc-fed91fe097c9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:48.737316 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de1009-b495-46dc-a37e-1cb9a7cc1fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:48.738203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1009-b495-46dc-a37e-1cb9a7cc1fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:48.738488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1009-b495-46dc-a37e-1cb9a7cc1fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:48.738769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1009-b495-46dc-a37e-1cb9a7cc1fd0 None admin] PATH_INFO: `/v3/users/01daecc16ba048b68b7a60751478124e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:48.739992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de1009-b495-46dc-a37e-1cb9a7cc1fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=01daecc16ba048b68b7a60751478124e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:48.741499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de1009-b495-46dc-a37e-1cb9a7cc1fd0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:48.743759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 76/146] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:48 2022] GET /identity/v3/users/01daecc16ba048b68b7a60751478124e => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:48.749475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4038e-dd4e-41f5-880c-71fdf17ae24a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:48.860463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4038e-dd4e-41f5-880c-71fdf17ae24a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:48.902856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7a3f1-2b22-47d0-8f0c-5cc065daddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:48.903533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7a3f1-2b22-47d0-8f0c-5cc065daddf4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:48.903827 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7a3f1-2b22-47d0-8f0c-5cc065daddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:48.904176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7a3f1-2b22-47d0-8f0c-5cc065daddf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:48.926876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:48.998359 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7a3f1-2b22-47d0-8f0c-5cc065daddf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:48.999876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7a3f1-2b22-47d0-8f0c-5cc065daddf4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:49.139469 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 71/147] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:49.145548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de1009-b495-46dc-a37e-1cb9a7cc1fd0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:49.209310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:49.231820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045870c2-697f-4845-bde6-e9914013e060 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:49.232164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045870c2-697f-4845-bde6-e9914013e060 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:49.232456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045870c2-697f-4845-bde6-e9914013e060 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:49.234165 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 72/148] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:49.240289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a6be-e40c-423f-8769-ce69d2174876 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:49.240585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a6be-e40c-423f-8769-ce69d2174876 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:49.240876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a6be-e40c-423f-8769-ce69d2174876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:49.262157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-24f6a6be-e40c-423f-8769-ce69d2174876 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:49.263442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-24f6a6be-e40c-423f-8769-ce69d2174876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:49.281971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de1009-b495-46dc-a37e-1cb9a7cc1fd0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:49.331816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:49.351184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4063d1-d51e-4659-9526-bf5ce2134825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:49.352781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4063d1-d51e-4659-9526-bf5ce2134825 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:49.353146 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4063d1-d51e-4659-9526-bf5ce2134825 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:49.353430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4063d1-d51e-4659-9526-bf5ce2134825 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:49.355803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4063d1-d51e-4659-9526-bf5ce2134825 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:49.360690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4063d1-d51e-4659-9526-bf5ce2134825 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:49.362564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 77/149] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:49 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:49.370255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4063d1-d51e-4659-9526-bf5ce2134825 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:49.406419 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 73/150] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:49.456314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a6be-e40c-423f-8769-ce69d2174876 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:49.513608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4063d1-d51e-4659-9526-bf5ce2134825 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:49.526843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:49.560438 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98184847-30b6-4153-aeb7-3e74656f2d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:49.562182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98184847-30b6-4153-aeb7-3e74656f2d34 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:49.562804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98184847-30b6-4153-aeb7-3e74656f2d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:49.563293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98184847-30b6-4153-aeb7-3e74656f2d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:49.564382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98184847-30b6-4153-aeb7-3e74656f2d34 None admin] RBAC: Adding query filter params (role.id=dda86b29d55a42c48f50fdd9fc4d5b61, scope.project.id=fa0ac34fcb3543da82900c7dad597219, user.id=01daecc16ba048b68b7a60751478124e) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:49.564921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98184847-30b6-4153-aeb7-3e74656f2d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:49.566612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98184847-30b6-4153-aeb7-3e74656f2d34 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:49.575239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 78/151] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:49 2022] GET /identity/v3/role_assignments?user.id=01daecc16ba048b68b7a60751478124e&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:49.628650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9311c0-1a42-4f10-8e09-da135dbe4215 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:49.629565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9311c0-1a42-4f10-8e09-da135dbe4215 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:49.630089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9311c0-1a42-4f10-8e09-da135dbe4215 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:49.633051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 79/152] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:09:49.642379 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede442c8-3979-452a-ba06-58f75a592dbc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:49.643430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede442c8-3979-452a-ba06-58f75a592dbc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:49.643923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede442c8-3979-452a-ba06-58f75a592dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:49.646306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a6be-e40c-423f-8769-ce69d2174876 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:49.683388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ede442c8-3979-452a-ba06-58f75a592dbc None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:49.685701 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ede442c8-3979-452a-ba06-58f75a592dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:49.725835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b5a05-c00e-4420-883f-f6875c548a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:49.726659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5a05-c00e-4420-883f-f6875c548a00 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:49.726945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5a05-c00e-4420-883f-f6875c548a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:49.727281 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5a05-c00e-4420-883f-f6875c548a00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:49.749040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b5a05-c00e-4420-883f-f6875c548a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-0d7b5a05-c00e-4420-883f-f6875c548a00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:49.756905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:49.757787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:09:49.758679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 74/153] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:09:49.764701 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b5a05-c00e-4420-883f-f6875c548a00 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:49.820216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 80/154] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:09:49.848164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede442c8-3979-452a-ba06-58f75a592dbc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:49.868862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:49.999635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b5a05-c00e-4420-883f-f6875c548a00 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:50.053539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf022b-e8dd-450d-8297-893d88498e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:50.054216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf022b-e8dd-450d-8297-893d88498e07 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:50.054502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf022b-e8dd-450d-8297-893d88498e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:50.054784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf022b-e8dd-450d-8297-893d88498e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:50.055609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf022b-e8dd-450d-8297-893d88498e07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:50.055923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf022b-e8dd-450d-8297-893d88498e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:50.057339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf022b-e8dd-450d-8297-893d88498e07 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:50.066923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 75/155] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:09:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:50.073427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf022b-e8dd-450d-8297-893d88498e07 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:50.094539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede442c8-3979-452a-ba06-58f75a592dbc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:50.096813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:50.183319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653536a-4a45-4e42-9ffd-de16da580615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:50.184987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653536a-4a45-4e42-9ffd-de16da580615 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:50.185617 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653536a-4a45-4e42-9ffd-de16da580615 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:50.186095 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653536a-4a45-4e42-9ffd-de16da580615 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:50.208719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653536a-4a45-4e42-9ffd-de16da580615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:50.215739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:50.218656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf022b-e8dd-450d-8297-893d88498e07 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e653536a-4a45-4e42-9ffd-de16da580615 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:50.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:50.225361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:50.226218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:50.229681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 81/156] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:50.235962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653536a-4a45-4e42-9ffd-de16da580615 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:50.263207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46b805-15cd-4e59-8b83-bbba45cf46b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:50.264048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46b805-15cd-4e59-8b83-bbba45cf46b6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:50.264404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46b805-15cd-4e59-8b83-bbba45cf46b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:50.264745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46b805-15cd-4e59-8b83-bbba45cf46b6 None admin] PATH_INFO: `/v3/users/51effb8068114236ac8e5a18fc130c81` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:50.268270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46b805-15cd-4e59-8b83-bbba45cf46b6 None admin] RBAC: Authorizing `identity:get_user(user_id=51effb8068114236ac8e5a18fc130c81)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:50.269971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46b805-15cd-4e59-8b83-bbba45cf46b6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:50.272244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 76/157] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:50 2022] GET /identity/v3/users/51effb8068114236ac8e5a18fc130c81 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:50.279280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46b805-15cd-4e59-8b83-bbba45cf46b6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:50.393602 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653536a-4a45-4e42-9ffd-de16da580615 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:50.439490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1c95e-e353-48a9-8ea6-d037aded0a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:50.440206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1c95e-e353-48a9-8ea6-d037aded0a56 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:50.440497 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1c95e-e353-48a9-8ea6-d037aded0a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:50.440779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1c95e-e353-48a9-8ea6-d037aded0a56 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:50.441547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1c95e-e353-48a9-8ea6-d037aded0a56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:50.441861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1c95e-e353-48a9-8ea6-d037aded0a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:50.443257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1c95e-e353-48a9-8ea6-d037aded0a56 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:50.462846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 82/158] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:09:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:50.465221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869140a0-4bf3-4218-8cdc-74fa752ff9ca None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:50.465516 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869140a0-4bf3-4218-8cdc-74fa752ff9ca None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:50.465800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869140a0-4bf3-4218-8cdc-74fa752ff9ca None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:50.467076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 83/159] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:50.469572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869140a0-4bf3-4218-8cdc-74fa752ff9ca None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:50.504040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46b805-15cd-4e59-8b83-bbba45cf46b6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:50.528455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:50.588078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad82e7-7852-4f1a-af03-a76e9487a0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:50.589000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad82e7-7852-4f1a-af03-a76e9487a0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:50.589288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad82e7-7852-4f1a-af03-a76e9487a0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:50.589577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad82e7-7852-4f1a-af03-a76e9487a0c9 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:50.592361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad82e7-7852-4f1a-af03-a76e9487a0c9 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:50.593851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad82e7-7852-4f1a-af03-a76e9487a0c9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:50.595657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 77/160] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:50 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:50.601875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c5e38-8760-4123-a342-df2fbbb10981 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:50.602257 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c5e38-8760-4123-a342-df2fbbb10981 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:50.602511 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c5e38-8760-4123-a342-df2fbbb10981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:50.637932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2d0c5e38-8760-4123-a342-df2fbbb10981 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:50.639502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2d0c5e38-8760-4123-a342-df2fbbb10981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:50.698041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869140a0-4bf3-4218-8cdc-74fa752ff9ca None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:50.709421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:50.778579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 78/161] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:50.780357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c5e38-8760-4123-a342-df2fbbb10981 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:50.785217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1e8aa-24f9-47c5-9475-a51595f41ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:50.786354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e8aa-24f9-47c5-9475-a51595f41ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:50.787837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e8aa-24f9-47c5-9475-a51595f41ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:50.794159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e8aa-24f9-47c5-9475-a51595f41ee7 None admin] PATH_INFO: `/v3/users/01daecc16ba048b68b7a60751478124e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:50.795743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1e8aa-24f9-47c5-9475-a51595f41ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=01daecc16ba048b68b7a60751478124e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:50.797444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1e8aa-24f9-47c5-9475-a51595f41ee7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:50.799384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 84/162] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:50 2022] GET /identity/v3/users/01daecc16ba048b68b7a60751478124e => generated 275 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:50.807760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021848-de3f-41ca-b5fb-51b119c5b1bd None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:50.808371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021848-de3f-41ca-b5fb-51b119c5b1bd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:50.808880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021848-de3f-41ca-b5fb-51b119c5b1bd None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:50.812368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 85/163] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:50.817941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021848-de3f-41ca-b5fb-51b119c5b1bd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:50.942700 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c5e38-8760-4123-a342-df2fbbb10981 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:50.987503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b21a32-b91a-4fbf-b383-e343e2a885f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:50.990197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21a32-b91a-4fbf-b383-e343e2a885f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:50.995590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21a32-b91a-4fbf-b383-e343e2a885f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:50.995896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21a32-b91a-4fbf-b383-e343e2a885f1 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219/users/51effb8068114236ac8e5a18fc130c81/roles/0473bb110e5b46a28efa9ef9abc7659b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:50.998124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b21a32-b91a-4fbf-b383-e343e2a885f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa0ac34fcb3543da82900c7dad597219, user_id=51effb8068114236ac8e5a18fc130c81, role_id=0473bb110e5b46a28efa9ef9abc7659b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:51.000072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b21a32-b91a-4fbf-b383-e343e2a885f1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:51.020661 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 79/164] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:09:50 2022] PUT /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219/users/51effb8068114236ac8e5a18fc130c81/roles/0473bb110e5b46a28efa9ef9abc7659b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:09:51.021112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:51.021946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01be90e-2638-46e1-b444-8ee16e091b80 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:51.022461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01be90e-2638-46e1-b444-8ee16e091b80 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:51.022576 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01be90e-2638-46e1-b444-8ee16e091b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:51.042690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021848-de3f-41ca-b5fb-51b119c5b1bd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:51.057579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c01be90e-2638-46e1-b444-8ee16e091b80 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:51.058844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c01be90e-2638-46e1-b444-8ee16e091b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:51.114230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3db1f-2923-4593-a1e0-be727ea926b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:51.115679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3db1f-2923-4593-a1e0-be727ea926b8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:51.116150 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3db1f-2923-4593-a1e0-be727ea926b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:51.116627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3db1f-2923-4593-a1e0-be727ea926b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:51.119464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:51.239906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3db1f-2923-4593-a1e0-be727ea926b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:51.241471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3db1f-2923-4593-a1e0-be727ea926b8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:51.285785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 80/165] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:51.286686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01be90e-2638-46e1-b444-8ee16e091b80 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:51.419518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:51.436364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 86/166] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:51.437334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3db1f-2923-4593-a1e0-be727ea926b8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:51.507363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01be90e-2638-46e1-b444-8ee16e091b80 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:51.580874 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a600f-fd79-4af9-8aa0-e9c9961fadd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:51.581694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a600f-fd79-4af9-8aa0-e9c9961fadd4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:51.581979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a600f-fd79-4af9-8aa0-e9c9961fadd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:51.582255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a600f-fd79-4af9-8aa0-e9c9961fadd4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:51.606563 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a600f-fd79-4af9-8aa0-e9c9961fadd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-e87a600f-fd79-4af9-8aa0-e9c9961fadd4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:51.615585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:51.616468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:09:51.617465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 81/167] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:09:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:51.618161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a600f-fd79-4af9-8aa0-e9c9961fadd4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:51.628434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3db1f-2923-4593-a1e0-be727ea926b8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:51.665543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:51.694587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d5eda-d554-4b7c-ab0d-8c9e593aab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:51.695337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d5eda-d554-4b7c-ab0d-8c9e593aab1e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:51.695624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d5eda-d554-4b7c-ab0d-8c9e593aab1e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:51.695946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d5eda-d554-4b7c-ab0d-8c9e593aab1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:51.718491 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d5eda-d554-4b7c-ab0d-8c9e593aab1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ff9d5eda-d554-4b7c-ab0d-8c9e593aab1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:51.731713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:51.732728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:51.733529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 87/168] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:09:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:51.734201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d5eda-d554-4b7c-ab0d-8c9e593aab1e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:51.831460 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a600f-fd79-4af9-8aa0-e9c9961fadd4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:51.852238 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:51.900593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7df0a-eadf-462e-95d8-283d45ec8590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:51.901807 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7df0a-eadf-462e-95d8-283d45ec8590 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:51.902104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7df0a-eadf-462e-95d8-283d45ec8590 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:51.902382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7df0a-eadf-462e-95d8-283d45ec8590 None admin] PATH_INFO: `/v3/projects/73972f17f85b42e59527a8a67b7f2236` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:51.903609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7df0a-eadf-462e-95d8-283d45ec8590 None admin] RBAC: Authorizing `identity:get_project(project_id=73972f17f85b42e59527a8a67b7f2236)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:51.905417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7df0a-eadf-462e-95d8-283d45ec8590 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:51.907374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 82/169] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:51 2022] GET /identity/v3/projects/73972f17f85b42e59527a8a67b7f2236 => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:51.909141 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482d9d2-39d4-4e09-87b7-40ddcfcfee34 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:51.909434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482d9d2-39d4-4e09-87b7-40ddcfcfee34 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:51.909716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482d9d2-39d4-4e09-87b7-40ddcfcfee34 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:51.911016 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 83/170] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:51.912543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482d9d2-39d4-4e09-87b7-40ddcfcfee34 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:51.954277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d5eda-d554-4b7c-ab0d-8c9e593aab1e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:52.026670 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:52.042030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482d9d2-39d4-4e09-87b7-40ddcfcfee34 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:52.055372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f0db9-49a3-4400-8d08-8b4a7fc7e07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:52.056366 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f0db9-49a3-4400-8d08-8b4a7fc7e07c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:52.056802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f0db9-49a3-4400-8d08-8b4a7fc7e07c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:52.057230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f0db9-49a3-4400-8d08-8b4a7fc7e07c None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:52.058132 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f0db9-49a3-4400-8d08-8b4a7fc7e07c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:52.060416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f0db9-49a3-4400-8d08-8b4a7fc7e07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:52.062004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f0db9-49a3-4400-8d08-8b4a7fc7e07c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:52.079237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 88/171] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:09:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:52.083384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f0db9-49a3-4400-8d08-8b4a7fc7e07c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:52.113358 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b874de5-dd34-442d-af19-892b1b019032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:52.114274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b874de5-dd34-442d-af19-892b1b019032 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:52.114733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b874de5-dd34-442d-af19-892b1b019032 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:52.115158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b874de5-dd34-442d-af19-892b1b019032 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:52.116093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b874de5-dd34-442d-af19-892b1b019032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:52.116548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b874de5-dd34-442d-af19-892b1b019032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:52.119338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b874de5-dd34-442d-af19-892b1b019032 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:52.141002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 84/172] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:52.142558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901c8a-4d80-4b20-af7a-0c3c3ec8c9fa None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:52.143685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901c8a-4d80-4b20-af7a-0c3c3ec8c9fa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:52.144312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901c8a-4d80-4b20-af7a-0c3c3ec8c9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:52.177138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a1901c8a-4d80-4b20-af7a-0c3c3ec8c9fa None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:52.178613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a1901c8a-4d80-4b20-af7a-0c3c3ec8c9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:52.234794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f0db9-49a3-4400-8d08-8b4a7fc7e07c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:52.250662 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:52.274424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556539e8-e94b-4edf-8183-dc9a4c634241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:52.275447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556539e8-e94b-4edf-8183-dc9a4c634241 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:52.275956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556539e8-e94b-4edf-8183-dc9a4c634241 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:52.276505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556539e8-e94b-4edf-8183-dc9a4c634241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:52.277604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556539e8-e94b-4edf-8183-dc9a4c634241 None admin] RBAC: Adding query filter params (role.id=dda86b29d55a42c48f50fdd9fc4d5b61, scope.project.id=73972f17f85b42e59527a8a67b7f2236, user.id=01daecc16ba048b68b7a60751478124e) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:52.278115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556539e8-e94b-4edf-8183-dc9a4c634241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:52.279757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556539e8-e94b-4edf-8183-dc9a4c634241 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:52.286583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 89/173] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:52 2022] GET /identity/v3/role_assignments?user.id=01daecc16ba048b68b7a60751478124e&scope.project.id=73972f17f85b42e59527a8a67b7f2236&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:52.287639 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556539e8-e94b-4edf-8183-dc9a4c634241 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:52.333708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 85/174] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:52.334594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1901c8a-4d80-4b20-af7a-0c3c3ec8c9fa None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:52.402069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556539e8-e94b-4edf-8183-dc9a4c634241 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:52.442840 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbd042-45ec-44e0-a96d-a52e7f17b444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:52.444150 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbd042-45ec-44e0-a96d-a52e7f17b444 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:52.444641 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbd042-45ec-44e0-a96d-a52e7f17b444 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:52.445115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbd042-45ec-44e0-a96d-a52e7f17b444 None admin] PATH_INFO: `/v3/users/01daecc16ba048b68b7a60751478124e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:52.447335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbd042-45ec-44e0-a96d-a52e7f17b444 None admin] RBAC: Authorizing `identity:get_user(user_id=01daecc16ba048b68b7a60751478124e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:52.449076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbd042-45ec-44e0-a96d-a52e7f17b444 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:52.451364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 90/175] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:52 2022] GET /identity/v3/users/01daecc16ba048b68b7a60751478124e => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:52.452630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbd042-45ec-44e0-a96d-a52e7f17b444 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:52.506423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:52.573116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbd042-45ec-44e0-a96d-a52e7f17b444 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:52.577690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:52.605481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1901c8a-4d80-4b20-af7a-0c3c3ec8c9fa None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:52.611445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77481f53-9672-444d-b3ea-0ac7ff3883f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:52.612562 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77481f53-9672-444d-b3ea-0ac7ff3883f7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:52.613052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77481f53-9672-444d-b3ea-0ac7ff3883f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:52.613526 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77481f53-9672-444d-b3ea-0ac7ff3883f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:52.626316 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77481f53-9672-444d-b3ea-0ac7ff3883f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-77481f53-9672-444d-b3ea-0ac7ff3883f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:52.634396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:52.635306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 91/176] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:52.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77481f53-9672-444d-b3ea-0ac7ff3883f7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:52.650673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb4efe-c92c-47bc-9fa6-039f7baa651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:52.651861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4efe-c92c-47bc-9fa6-039f7baa651e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:52.651861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4efe-c92c-47bc-9fa6-039f7baa651e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:52.652234 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4efe-c92c-47bc-9fa6-039f7baa651e None admin] PATH_INFO: `/v3/users/10bf47ad20914307a19e97e4ac11811c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:52.656782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb4efe-c92c-47bc-9fa6-039f7baa651e None admin] RBAC: Authorizing `identity:get_user(user_id=10bf47ad20914307a19e97e4ac11811c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:52.658264 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb4efe-c92c-47bc-9fa6-039f7baa651e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:52.662121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 86/177] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:52 2022] GET /identity/v3/users/10bf47ad20914307a19e97e4ac11811c => generated 247 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:52.662121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11889297-aa5d-4793-8325-8ea36c0b3332 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:52.662121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11889297-aa5d-4793-8325-8ea36c0b3332 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:52.662121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11889297-aa5d-4793-8325-8ea36c0b3332 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:52.663510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 87/178] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:52.664202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11889297-aa5d-4793-8325-8ea36c0b3332 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:52.759702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77481f53-9672-444d-b3ea-0ac7ff3883f7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:52.767164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:52.801806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a890c-dc1f-4234-bc6c-b94bedf2e289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:52.802043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11889297-aa5d-4793-8325-8ea36c0b3332 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:52.802475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a890c-dc1f-4234-bc6c-b94bedf2e289 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:52.802765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a890c-dc1f-4234-bc6c-b94bedf2e289 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:52.803048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a890c-dc1f-4234-bc6c-b94bedf2e289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:52.842384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bacc7f-38ab-49e2-afa2-03c60d506a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:52.843064 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bacc7f-38ab-49e2-afa2-03c60d506a21 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:52.843378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bacc7f-38ab-49e2-afa2-03c60d506a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:52.843664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bacc7f-38ab-49e2-afa2-03c60d506a21 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:52.844468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bacc7f-38ab-49e2-afa2-03c60d506a21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:52.844784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bacc7f-38ab-49e2-afa2-03c60d506a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:52.846171 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bacc7f-38ab-49e2-afa2-03c60d506a21 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:52.855477 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 88/179] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:52.855477 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bacc7f-38ab-49e2-afa2-03c60d506a21 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:52.865765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:52.893166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a890c-dc1f-4234-bc6c-b94bedf2e289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:52.894648 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a890c-dc1f-4234-bc6c-b94bedf2e289 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:52.963498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bacc7f-38ab-49e2-afa2-03c60d506a21 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:52.999808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 92/180] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:53.001327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068c770-2b5f-47ad-91f1-fb50282a9e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:53.001982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068c770-2b5f-47ad-91f1-fb50282a9e38 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:53.002268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068c770-2b5f-47ad-91f1-fb50282a9e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:53.002548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068c770-2b5f-47ad-91f1-fb50282a9e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:53.010869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14e881-15c1-4be9-8cab-02bdd788e12a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:53.010869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14e881-15c1-4be9-8cab-02bdd788e12a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:53.010869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14e881-15c1-4be9-8cab-02bdd788e12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:53.020594 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:53.027280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bf14e881-15c1-4be9-8cab-02bdd788e12a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:53.028888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bf14e881-15c1-4be9-8cab-02bdd788e12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:53.080527 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068c770-2b5f-47ad-91f1-fb50282a9e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:53.082010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068c770-2b5f-47ad-91f1-fb50282a9e38 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:53.089801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:53.100118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 93/181] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:53.101761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6b59b-0ae1-4173-a4c4-95770634d2df None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:53.102587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6b59b-0ae1-4173-a4c4-95770634d2df None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:53.102880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6b59b-0ae1-4173-a4c4-95770634d2df None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:53.104304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 94/182] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:53.109099 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6b59b-0ae1-4173-a4c4-95770634d2df None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:53.198042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 89/183] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:53.199015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068c770-2b5f-47ad-91f1-fb50282a9e38 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:53.225775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6b59b-0ae1-4173-a4c4-95770634d2df None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:53.260419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d791f-ab0b-4455-836f-05d16720b0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:53.261475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d791f-ab0b-4455-836f-05d16720b0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:53.261696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d791f-ab0b-4455-836f-05d16720b0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:53.261970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d791f-ab0b-4455-836f-05d16720b0b1 None admin] PATH_INFO: `/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:53.264812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:53.277819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d791f-ab0b-4455-836f-05d16720b0b1 None admin] RBAC: Authorizing `identity:get_user(user_id=75bd1e77fbca426e9c2d92c4fe3c0bc0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:53.279298 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d791f-ab0b-4455-836f-05d16720b0b1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:53.281037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 95/184] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:53 2022] GET /identity/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:53.282221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc6fd1-6ca9-4aa3-a5e8-b8425696e3d1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:53.282505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc6fd1-6ca9-4aa3-a5e8-b8425696e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:53.282780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc6fd1-6ca9-4aa3-a5e8-b8425696e3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:53.303724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-39bc6fd1-6ca9-4aa3-a5e8-b8425696e3d1 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:53.305970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-39bc6fd1-6ca9-4aa3-a5e8-b8425696e3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:53.312513 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068c770-2b5f-47ad-91f1-fb50282a9e38 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:53.320972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:53.350816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429e447-d352-4f08-8857-c8ac84d90a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:53.351719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e447-d352-4f08-8857-c8ac84d90a29 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:53.351960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e447-d352-4f08-8857-c8ac84d90a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:53.352795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e447-d352-4f08-8857-c8ac84d90a29 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:53.354015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429e447-d352-4f08-8857-c8ac84d90a29 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:53.355469 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429e447-d352-4f08-8857-c8ac84d90a29 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:53.357680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 90/185] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:53 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:53.358540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429e447-d352-4f08-8857-c8ac84d90a29 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:53.383060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 96/186] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:53.384142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc6fd1-6ca9-4aa3-a5e8-b8425696e3d1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:53.471146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429e447-d352-4f08-8857-c8ac84d90a29 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:53.493407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc6fd1-6ca9-4aa3-a5e8-b8425696e3d1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:53.506910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655ee47-6e7b-4fc9-a9d8-62dca8d658cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:53.507718 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ee47-6e7b-4fc9-a9d8-62dca8d658cb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:53.508089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ee47-6e7b-4fc9-a9d8-62dca8d658cb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:53.508426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655ee47-6e7b-4fc9-a9d8-62dca8d658cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:53.519777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655ee47-6e7b-4fc9-a9d8-62dca8d658cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:53.520099 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-8655ee47-6e7b-4fc9-a9d8-62dca8d658cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:53.528726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:53.529635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:09:53.530420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:09:53.534044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae2c69-5dec-476c-b825-2c46041e0f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:53.534732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 91/187] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:09:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:53.534910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae2c69-5dec-476c-b825-2c46041e0f4c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:53.535207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae2c69-5dec-476c-b825-2c46041e0f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:53.535461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae2c69-5dec-476c-b825-2c46041e0f4c None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:53.535614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655ee47-6e7b-4fc9-a9d8-62dca8d658cb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:53.536737 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae2c69-5dec-476c-b825-2c46041e0f4c None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:53.538248 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae2c69-5dec-476c-b825-2c46041e0f4c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:53.540665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 97/188] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:53 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:53.541324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae2c69-5dec-476c-b825-2c46041e0f4c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:53.584176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:53.653488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae2c69-5dec-476c-b825-2c46041e0f4c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:53.657798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655ee47-6e7b-4fc9-a9d8-62dca8d658cb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:53.692509 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b0d9b-2bce-403f-a574-778df3cb245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:53.693161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0d9b-2bce-403f-a574-778df3cb245d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:53.693444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0d9b-2bce-403f-a574-778df3cb245d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:53.693565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488917c-23fb-489a-bded-d19b97b47541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:53.693744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0d9b-2bce-403f-a574-778df3cb245d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:53.694157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488917c-23fb-489a-bded-d19b97b47541 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:53.694444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488917c-23fb-489a-bded-d19b97b47541 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:53.694609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b0d9b-2bce-403f-a574-778df3cb245d None admin] RBAC: Adding query filter params (role.id=0ec7b267a5724203a4845cf7da3a6ab8, scope.project.id=fa0ac34fcb3543da82900c7dad597219, user.id=01daecc16ba048b68b7a60751478124e) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:53.694710 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488917c-23fb-489a-bded-d19b97b47541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:53.694910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b0d9b-2bce-403f-a574-778df3cb245d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:53.697006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b0d9b-2bce-403f-a574-778df3cb245d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:53.704079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 98/189] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:53 2022] GET /identity/v3/role_assignments?user.id=01daecc16ba048b68b7a60751478124e&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=0ec7b267a5724203a4845cf7da3a6ab8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:53.713088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b0d9b-2bce-403f-a574-778df3cb245d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:53.777228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488917c-23fb-489a-bded-d19b97b47541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:53.778859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488917c-23fb-489a-bded-d19b97b47541 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:53.790583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:53.820302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:53.845085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b0d9b-2bce-403f-a574-778df3cb245d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:53.886906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf93ece-28d7-4cfd-92e1-0cfca1bc7af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:53.887961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf93ece-28d7-4cfd-92e1-0cfca1bc7af6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:53.888322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf93ece-28d7-4cfd-92e1-0cfca1bc7af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:53.888600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf93ece-28d7-4cfd-92e1-0cfca1bc7af6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:53.889797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf93ece-28d7-4cfd-92e1-0cfca1bc7af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:53.891529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf93ece-28d7-4cfd-92e1-0cfca1bc7af6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:53.893226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 99/190] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:53.893998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf93ece-28d7-4cfd-92e1-0cfca1bc7af6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:53.901991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 92/191] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:53.902858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488917c-23fb-489a-bded-d19b97b47541 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:53.998259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf93ece-28d7-4cfd-92e1-0cfca1bc7af6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:54.005734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488917c-23fb-489a-bded-d19b97b47541 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:54.022182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:54.033815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec20da3-9b8c-4793-8b4a-62f1a5d91425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:54.034417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec20da3-9b8c-4793-8b4a-62f1a5d91425 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:54.034698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec20da3-9b8c-4793-8b4a-62f1a5d91425 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:54.034977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec20da3-9b8c-4793-8b4a-62f1a5d91425 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:54.035718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec20da3-9b8c-4793-8b4a-62f1a5d91425 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:54.036053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec20da3-9b8c-4793-8b4a-62f1a5d91425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:54.037475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec20da3-9b8c-4793-8b4a-62f1a5d91425 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:54.042255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b436c9-dac2-40e4-8836-9eb7836adc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:54.042910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b436c9-dac2-40e4-8836-9eb7836adc01 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:54.043195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b436c9-dac2-40e4-8836-9eb7836adc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:54.043474 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b436c9-dac2-40e4-8836-9eb7836adc01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:54.044363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b436c9-dac2-40e4-8836-9eb7836adc01 None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=fa0ac34fcb3543da82900c7dad597219, user.id=10bf47ad20914307a19e97e4ac11811c) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:54.044680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b436c9-dac2-40e4-8836-9eb7836adc01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:54.050009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 100/192] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:09:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:54.050151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b436c9-dac2-40e4-8836-9eb7836adc01 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:54.050226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d33919-e733-42ce-a8b5-c61c7af13c76 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:54.050226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d33919-e733-42ce-a8b5-c61c7af13c76 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:54.050226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d33919-e733-42ce-a8b5-c61c7af13c76 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:54.050422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:54.050487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 101/193] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:54.050487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d33919-e733-42ce-a8b5-c61c7af13c76 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:54.056274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 93/194] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:53 2022] GET /identity/v3/role_assignments?user.id=10bf47ad20914307a19e97e4ac11811c&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:54.057080 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b436c9-dac2-40e4-8836-9eb7836adc01 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:54.175559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b436c9-dac2-40e4-8836-9eb7836adc01 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:54.178035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d33919-e733-42ce-a8b5-c61c7af13c76 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:54.213615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddc976-8af7-4bdd-b87b-2eee389a4979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:54.214475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddc976-8af7-4bdd-b87b-2eee389a4979 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:54.214828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddc976-8af7-4bdd-b87b-2eee389a4979 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:54.215037 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddc976-8af7-4bdd-b87b-2eee389a4979 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:54.216304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddc976-8af7-4bdd-b87b-2eee389a4979 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:54.217243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f86a64-23f6-4b20-926e-5203e9ec67aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:54.217752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddc976-8af7-4bdd-b87b-2eee389a4979 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:54.218078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f86a64-23f6-4b20-926e-5203e9ec67aa None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:54.218361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f86a64-23f6-4b20-926e-5203e9ec67aa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:54.218685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f86a64-23f6-4b20-926e-5203e9ec67aa None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:54.219404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f86a64-23f6-4b20-926e-5203e9ec67aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:54.219518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 94/195] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:54 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:54.221050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f86a64-23f6-4b20-926e-5203e9ec67aa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:54.224324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddc976-8af7-4bdd-b87b-2eee389a4979 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:54.245517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 102/196] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:09:54 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:09:54.246611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc694f-879d-438c-a77b-652c9a7495ba None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:54.246924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc694f-879d-438c-a77b-652c9a7495ba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:54.247180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc694f-879d-438c-a77b-652c9a7495ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:54.267904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8cbc694f-879d-438c-a77b-652c9a7495ba None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:54.269206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8cbc694f-879d-438c-a77b-652c9a7495ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:54.319405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:54.324525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:54.366743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 103/197] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:54.368459 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddc976-8af7-4bdd-b87b-2eee389a4979 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:54.369299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc694f-879d-438c-a77b-652c9a7495ba None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:54.408864 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3127a-e87e-4754-a7ee-9312aeeb5bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:54.409742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3127a-e87e-4754-a7ee-9312aeeb5bcd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:54.410024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3127a-e87e-4754-a7ee-9312aeeb5bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:54.410299 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3127a-e87e-4754-a7ee-9312aeeb5bcd None admin] PATH_INFO: `/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:54.412111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3127a-e87e-4754-a7ee-9312aeeb5bcd None admin] RBAC: Authorizing `identity:get_user(user_id=75bd1e77fbca426e9c2d92c4fe3c0bc0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:54.413444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3127a-e87e-4754-a7ee-9312aeeb5bcd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:54.416051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 95/198] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:54 2022] GET /identity/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:54.420864 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3127a-e87e-4754-a7ee-9312aeeb5bcd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:54.504712 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc694f-879d-438c-a77b-652c9a7495ba None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:54.542920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4bc10-b479-4105-8528-50d972f11c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:54.543587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4bc10-b479-4105-8528-50d972f11c2a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:54.543870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4bc10-b479-4105-8528-50d972f11c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:54.544177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4bc10-b479-4105-8528-50d972f11c2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:54.544485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3127a-e87e-4754-a7ee-9312aeeb5bcd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:54.545021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4bc10-b479-4105-8528-50d972f11c2a None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=aa8cd07280d947a396d40811bab95347, user.id=75bd1e77fbca426e9c2d92c4fe3c0bc0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:54.545331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4bc10-b479-4105-8528-50d972f11c2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:54.546819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4bc10-b479-4105-8528-50d972f11c2a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:54.553058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 104/199] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:54 2022] GET /identity/v3/role_assignments?user.id=75bd1e77fbca426e9c2d92c4fe3c0bc0&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:54.553692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4bc10-b479-4105-8528-50d972f11c2a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:54.594488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11004c-5c74-46a0-b7d2-01e77db500f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:54.595960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11004c-5c74-46a0-b7d2-01e77db500f5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:54.596484 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11004c-5c74-46a0-b7d2-01e77db500f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:54.596942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11004c-5c74-46a0-b7d2-01e77db500f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:54.602971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:54.609433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:54.617502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11004c-5c74-46a0-b7d2-01e77db500f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-da11004c-5c74-46a0-b7d2-01e77db500f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:54.642032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:54.643300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:09:54.644412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:09:54.646198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 96/200] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:54.655702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11004c-5c74-46a0-b7d2-01e77db500f5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:54.707857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4bc10-b479-4105-8528-50d972f11c2a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:54.773001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cc0e3-6996-4958-be3d-2b6f5e3bb647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:54.774069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cc0e3-6996-4958-be3d-2b6f5e3bb647 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:54.774585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cc0e3-6996-4958-be3d-2b6f5e3bb647 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:54.775096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cc0e3-6996-4958-be3d-2b6f5e3bb647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:54.819140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11004c-5c74-46a0-b7d2-01e77db500f5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:54.857639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867337f-f457-4b2d-b63d-909d8c476d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:54.858397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867337f-f457-4b2d-b63d-909d8c476d65 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:54.858786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867337f-f457-4b2d-b63d-909d8c476d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:54.859169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867337f-f457-4b2d-b63d-909d8c476d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:54.860087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867337f-f457-4b2d-b63d-909d8c476d65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:54.860604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867337f-f457-4b2d-b63d-909d8c476d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:54.862226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867337f-f457-4b2d-b63d-909d8c476d65 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:54.876073 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 97/201] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:09:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:54.877383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cc0e3-6996-4958-be3d-2b6f5e3bb647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:54.878894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cc0e3-6996-4958-be3d-2b6f5e3bb647 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:54.880821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867337f-f457-4b2d-b63d-909d8c476d65 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:54.927285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:54.988401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:55.054453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 105/202] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:55.060278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cc0e3-6996-4958-be3d-2b6f5e3bb647 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:55.074285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867337f-f457-4b2d-b63d-909d8c476d65 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:55.138523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c3a3d-7591-45f2-9495-09e31c36806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:55.139325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c3a3d-7591-45f2-9495-09e31c36806e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:55.139613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c3a3d-7591-45f2-9495-09e31c36806e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:55.139892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c3a3d-7591-45f2-9495-09e31c36806e None admin] PATH_INFO: `/v3/users/51effb8068114236ac8e5a18fc130c81` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:55.142280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c3a3d-7591-45f2-9495-09e31c36806e None admin] RBAC: Authorizing `identity:get_user(user_id=51effb8068114236ac8e5a18fc130c81)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:55.143979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c3a3d-7591-45f2-9495-09e31c36806e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:55.148382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 98/203] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:54 2022] GET /identity/v3/users/51effb8068114236ac8e5a18fc130c81 => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:55.151966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c3a3d-7591-45f2-9495-09e31c36806e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:55.213262 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cc0e3-6996-4958-be3d-2b6f5e3bb647 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:55.253221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211ac87-6dae-40cc-b8bc-83254d56671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:55.254458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211ac87-6dae-40cc-b8bc-83254d56671e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:55.254961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211ac87-6dae-40cc-b8bc-83254d56671e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:55.255593 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211ac87-6dae-40cc-b8bc-83254d56671e None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:55.257004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211ac87-6dae-40cc-b8bc-83254d56671e None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:55.259245 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211ac87-6dae-40cc-b8bc-83254d56671e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:55.261659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 106/204] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:55 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:55.270987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211ac87-6dae-40cc-b8bc-83254d56671e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:55.276260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:55.359662 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c3a3d-7591-45f2-9495-09e31c36806e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:55.409052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:55.410927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211ac87-6dae-40cc-b8bc-83254d56671e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:55.437233 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5310-0d21-4d72-a321-a51deeafe006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:55.437889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5310-0d21-4d72-a321-a51deeafe006 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:55.438176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5310-0d21-4d72-a321-a51deeafe006 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:55.438456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5310-0d21-4d72-a321-a51deeafe006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:55.460497 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c0655-744d-4ba9-97bf-6e40c07a9bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:55.461181 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c0655-744d-4ba9-97bf-6e40c07a9bbd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:55.461504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c0655-744d-4ba9-97bf-6e40c07a9bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:55.461783 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c0655-744d-4ba9-97bf-6e40c07a9bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:55.462635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c0655-744d-4ba9-97bf-6e40c07a9bbd None admin] RBAC: Adding query filter params (role.id=0ec7b267a5724203a4845cf7da3a6ab8, scope.project.id=aa8cd07280d947a396d40811bab95347, user.id=75bd1e77fbca426e9c2d92c4fe3c0bc0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:55.462952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c0655-744d-4ba9-97bf-6e40c07a9bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:55.464452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c0655-744d-4ba9-97bf-6e40c07a9bbd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:55.478061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 107/205] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:55 2022] GET /identity/v3/role_assignments?user.id=75bd1e77fbca426e9c2d92c4fe3c0bc0&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=0ec7b267a5724203a4845cf7da3a6ab8 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:55.525455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff5310-0d21-4d72-a321-a51deeafe006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:55.527201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff5310-0d21-4d72-a321-a51deeafe006 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:55.681709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 99/206] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:55.686829 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c0655-744d-4ba9-97bf-6e40c07a9bbd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:55.774487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:55.829827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c0655-744d-4ba9-97bf-6e40c07a9bbd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:55.890835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908e6b7-05d8-4a71-88c9-59762fd8349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:55.891719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e6b7-05d8-4a71-88c9-59762fd8349f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:55.892006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e6b7-05d8-4a71-88c9-59762fd8349f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:55.892321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e6b7-05d8-4a71-88c9-59762fd8349f None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:55.893647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908e6b7-05d8-4a71-88c9-59762fd8349f None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:55.895172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908e6b7-05d8-4a71-88c9-59762fd8349f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:55.897916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 108/207] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:55 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:55.902771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5310-0d21-4d72-a321-a51deeafe006 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:55.932596 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:56.041818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5310-0d21-4d72-a321-a51deeafe006 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:56.087150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcd7f2-fd18-4a1d-b215-0c3d02ba8774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:56.087810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcd7f2-fd18-4a1d-b215-0c3d02ba8774 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:56.088117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcd7f2-fd18-4a1d-b215-0c3d02ba8774 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:56.088397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcd7f2-fd18-4a1d-b215-0c3d02ba8774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:56.089235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcd7f2-fd18-4a1d-b215-0c3d02ba8774 None admin] RBAC: Adding query filter params (role.id=0473bb110e5b46a28efa9ef9abc7659b, scope.project.id=fa0ac34fcb3543da82900c7dad597219, user.id=51effb8068114236ac8e5a18fc130c81) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:56.089548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcd7f2-fd18-4a1d-b215-0c3d02ba8774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:56.090991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcd7f2-fd18-4a1d-b215-0c3d02ba8774 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:56.100440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 100/208] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:55 2022] GET /identity/v3/role_assignments?user.id=51effb8068114236ac8e5a18fc130c81&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=0473bb110e5b46a28efa9ef9abc7659b => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:56.742503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00907648-b3fb-42a9-8cb4-45c7a37646b4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:56.743607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00907648-b3fb-42a9-8cb4-45c7a37646b4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:56.743607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00907648-b3fb-42a9-8cb4-45c7a37646b4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:56.745382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 109/209] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:56.751230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b2dd3-4d41-4e8f-b58c-dd63824a8bd9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:56.751512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b2dd3-4d41-4e8f-b58c-dd63824a8bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:56.751793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b2dd3-4d41-4e8f-b58c-dd63824a8bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:56.772125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-419b2dd3-4d41-4e8f-b58c-dd63824a8bd9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:56.773328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-419b2dd3-4d41-4e8f-b58c-dd63824a8bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:56.858852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 101/210] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:09:56.882674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00907648-b3fb-42a9-8cb4-45c7a37646b4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:56.977194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55c27d-9caf-4ade-aaca-ae295012aad6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:56.977855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55c27d-9caf-4ade-aaca-ae295012aad6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:56.978338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55c27d-9caf-4ade-aaca-ae295012aad6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:56.979875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 102/211] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:56.980831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d8e5c-560e-4250-a19f-a9206eebb383 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:56.981114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d8e5c-560e-4250-a19f-a9206eebb383 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:56.981389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d8e5c-560e-4250-a19f-a9206eebb383 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:56.982724 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 103/212] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:56.987550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17281-418a-4ef8-8858-b6fb6e6d12ae None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:56.988130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17281-418a-4ef8-8858-b6fb6e6d12ae None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:56.988416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17281-418a-4ef8-8858-b6fb6e6d12ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:56.995264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00907648-b3fb-42a9-8cb4-45c7a37646b4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:57.005073 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-49d17281-418a-4ef8-8858-b6fb6e6d12ae None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:57.006244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-49d17281-418a-4ef8-8858-b6fb6e6d12ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:57.022329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:57.035194 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc43613-06d5-4ee7-ab57-e53b971fe423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:57.035999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc43613-06d5-4ee7-ab57-e53b971fe423 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:57.036316 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc43613-06d5-4ee7-ab57-e53b971fe423 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:57.036605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc43613-06d5-4ee7-ab57-e53b971fe423 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:57.039564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:57.050532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc43613-06d5-4ee7-ab57-e53b971fe423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-dcc43613-06d5-4ee7-ab57-e53b971fe423 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:57.059013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:57.059893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:57.060705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 110/213] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:57.062003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b3fe-d493-4d3d-8db0-e35c88197f67 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:57.062003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b3fe-d493-4d3d-8db0-e35c88197f67 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:57.062003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b3fe-d493-4d3d-8db0-e35c88197f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:57.079612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a0e3b3fe-d493-4d3d-8db0-e35c88197f67 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:57.081429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a0e3b3fe-d493-4d3d-8db0-e35c88197f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:57.084124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 104/214] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:09:57.084967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d17281-418a-4ef8-8858-b6fb6e6d12ae None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:57.172584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 111/215] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:57.173629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b3fe-d493-4d3d-8db0-e35c88197f67 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:57.214484 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d17281-418a-4ef8-8858-b6fb6e6d12ae None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:57.254531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b92345-ac32-4c2b-83fd-e56a33642365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:57.255122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92345-ac32-4c2b-83fd-e56a33642365 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:57.255410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92345-ac32-4c2b-83fd-e56a33642365 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:57.255691 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b92345-ac32-4c2b-83fd-e56a33642365 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:57.256591 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b92345-ac32-4c2b-83fd-e56a33642365 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:57.256905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b92345-ac32-4c2b-83fd-e56a33642365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:57.258470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b92345-ac32-4c2b-83fd-e56a33642365 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:57.267804 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 105/216] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:09:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:57.268672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b92345-ac32-4c2b-83fd-e56a33642365 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:57.280247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b3fe-d493-4d3d-8db0-e35c88197f67 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:57.282934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:57.307457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:57.318491 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6087fd-1b43-4e00-9dfe-bec985eae4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:57.319583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6087fd-1b43-4e00-9dfe-bec985eae4eb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:57.319869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6087fd-1b43-4e00-9dfe-bec985eae4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:57.320182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6087fd-1b43-4e00-9dfe-bec985eae4eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:57.321976 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6087fd-1b43-4e00-9dfe-bec985eae4eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:57.323706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6087fd-1b43-4e00-9dfe-bec985eae4eb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:57.330123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 112/217] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:09:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:57.330123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6087fd-1b43-4e00-9dfe-bec985eae4eb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:57.378881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b92345-ac32-4c2b-83fd-e56a33642365 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:57.415920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffe5ab-8185-4d36-8699-bcdc5b48e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:57.416745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffe5ab-8185-4d36-8699-bcdc5b48e100 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:57.417032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffe5ab-8185-4d36-8699-bcdc5b48e100 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:57.417294 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffe5ab-8185-4d36-8699-bcdc5b48e100 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:57.428430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffe5ab-8185-4d36-8699-bcdc5b48e100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-99ffe5ab-8185-4d36-8699-bcdc5b48e100 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:57.436629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:57.437521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:09:57.438304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 106/218] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:57.439046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffe5ab-8185-4d36-8699-bcdc5b48e100 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:57.448926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6087fd-1b43-4e00-9dfe-bec985eae4eb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:57.492153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1617d-fc7a-4cc9-8d36-01d7f40c4c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:57.493071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1617d-fc7a-4cc9-8d36-01d7f40c4c46 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:57.493360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1617d-fc7a-4cc9-8d36-01d7f40c4c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:57.493640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1617d-fc7a-4cc9-8d36-01d7f40c4c46 None admin] PATH_INFO: `/v3/users/dd5051b7c9f34e4896eeadd3fd8b79ba` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:57.509398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1617d-fc7a-4cc9-8d36-01d7f40c4c46 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5051b7c9f34e4896eeadd3fd8b79ba)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:57.510782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1617d-fc7a-4cc9-8d36-01d7f40c4c46 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:57.512818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 113/219] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:57 2022] GET /identity/v3/users/dd5051b7c9f34e4896eeadd3fd8b79ba => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:57.513434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1617d-fc7a-4cc9-8d36-01d7f40c4c46 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:57.528779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:57.563646 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffe5ab-8185-4d36-8699-bcdc5b48e100 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:57.573136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:57.609633 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faacbd-f385-4aff-9402-7cfd4b9d1590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:57.610308 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faacbd-f385-4aff-9402-7cfd4b9d1590 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:57.610603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faacbd-f385-4aff-9402-7cfd4b9d1590 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:57.610885 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faacbd-f385-4aff-9402-7cfd4b9d1590 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:57.611600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faacbd-f385-4aff-9402-7cfd4b9d1590 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:57.613098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faacbd-f385-4aff-9402-7cfd4b9d1590 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:57.634549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 107/220] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:09:57 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:09:57.634745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1617d-fc7a-4cc9-8d36-01d7f40c4c46 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:57.645163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faacbd-f385-4aff-9402-7cfd4b9d1590 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:57.689889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc06c10-ae43-42f6-9406-2af8b7364ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:57.691044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc06c10-ae43-42f6-9406-2af8b7364ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:57.691536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc06c10-ae43-42f6-9406-2af8b7364ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:57.692136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc06c10-ae43-42f6-9406-2af8b7364ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:57.693168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc06c10-ae43-42f6-9406-2af8b7364ed7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:57.693704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc06c10-ae43-42f6-9406-2af8b7364ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:57.695390 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc06c10-ae43-42f6-9406-2af8b7364ed7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:57.710291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 114/221] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:09:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:57.716433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc06c10-ae43-42f6-9406-2af8b7364ed7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:57.790479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faacbd-f385-4aff-9402-7cfd4b9d1590 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:57.829372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:57.842917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758e8fa-4f68-4557-a22b-a8cfb348f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:57.843806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e8fa-4f68-4557-a22b-a8cfb348f29d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:57.844128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e8fa-4f68-4557-a22b-a8cfb348f29d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:57.844413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e8fa-4f68-4557-a22b-a8cfb348f29d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:57.847545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc06c10-ae43-42f6-9406-2af8b7364ed7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:57.866323 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:57.895226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fa71f-1deb-4962-9fac-45eb37cedfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:57.896152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa71f-1deb-4962-9fac-45eb37cedfbc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:57.896444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa71f-1deb-4962-9fac-45eb37cedfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:57.896724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa71f-1deb-4962-9fac-45eb37cedfbc None admin] PATH_INFO: `/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:57.898111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fa71f-1deb-4962-9fac-45eb37cedfbc None admin] RBAC: Authorizing `identity:get_user(user_id=75bd1e77fbca426e9c2d92c4fe3c0bc0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:57.900143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fa71f-1deb-4962-9fac-45eb37cedfbc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:57.901833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 115/222] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:57 2022] GET /identity/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:57.903165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9291cc-0ef5-4260-a393-dbdf1cf715a6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:57.903458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9291cc-0ef5-4260-a393-dbdf1cf715a6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:57.903740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9291cc-0ef5-4260-a393-dbdf1cf715a6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:57.905039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 116/223] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:09:57.910600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9291cc-0ef5-4260-a393-dbdf1cf715a6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:57.927914 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758e8fa-4f68-4557-a22b-a8cfb348f29d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:57.929564 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758e8fa-4f68-4557-a22b-a8cfb348f29d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:58.045886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9291cc-0ef5-4260-a393-dbdf1cf715a6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:58.050083 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 108/224] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:09:58.051378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2936ee2-27a0-4dbb-8749-6d12eda0324b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:58.051669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2936ee2-27a0-4dbb-8749-6d12eda0324b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:58.051950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2936ee2-27a0-4dbb-8749-6d12eda0324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:58.079986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e2936ee2-27a0-4dbb-8749-6d12eda0324b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:09:58.081933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e2936ee2-27a0-4dbb-8749-6d12eda0324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:09:58.088627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d27dcb-922d-4d71-9b10-bb00fca369a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:58.089677 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d27dcb-922d-4d71-9b10-bb00fca369a4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:58.090092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d27dcb-922d-4d71-9b10-bb00fca369a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:58.090442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d27dcb-922d-4d71-9b10-bb00fca369a4 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:58.091743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d27dcb-922d-4d71-9b10-bb00fca369a4 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:58.093367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d27dcb-922d-4d71-9b10-bb00fca369a4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:58.100054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 117/225] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:57 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:58.101123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d27dcb-922d-4d71-9b10-bb00fca369a4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:58.106882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:58.157674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:58.179478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 109/226] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:09:58.181035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2936ee2-27a0-4dbb-8749-6d12eda0324b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:58.218493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d27dcb-922d-4d71-9b10-bb00fca369a4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:58.257724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be0723-79df-437a-941f-9ffa993ed289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:58.258856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0723-79df-437a-941f-9ffa993ed289 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:58.259238 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0723-79df-437a-941f-9ffa993ed289 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:58.259610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0723-79df-437a-941f-9ffa993ed289 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:58.260972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be0723-79df-437a-941f-9ffa993ed289 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:58.262532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be0723-79df-437a-941f-9ffa993ed289 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:58.264497 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 118/227] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:58 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:58.265733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be0723-79df-437a-941f-9ffa993ed289 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:58.326978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2936ee2-27a0-4dbb-8749-6d12eda0324b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:58.373540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4113596-1d08-4846-a5e8-c09b681c32c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:58.374568 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4113596-1d08-4846-a5e8-c09b681c32c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:58.375117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4113596-1d08-4846-a5e8-c09b681c32c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:58.375404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4113596-1d08-4846-a5e8-c09b681c32c9 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347/users/75bd1e77fbca426e9c2d92c4fe3c0bc0/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:58.378367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4113596-1d08-4846-a5e8-c09b681c32c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8cd07280d947a396d40811bab95347, user_id=75bd1e77fbca426e9c2d92c4fe3c0bc0, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:58.380583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4113596-1d08-4846-a5e8-c09b681c32c9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:58.385742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be0723-79df-437a-941f-9ffa993ed289 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:58.398372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 110/228] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:09:58 2022] PUT /identity/v3/projects/aa8cd07280d947a396d40811bab95347/users/75bd1e77fbca426e9c2d92c4fe3c0bc0/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:09:58.399583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4113596-1d08-4846-a5e8-c09b681c32c9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:58.409275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:58.436394 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:58.450057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a7a90-70c2-4c69-b8f7-5077a1ea2ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:58.452230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a7a90-70c2-4c69-b8f7-5077a1ea2ffc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:58.452539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a7a90-70c2-4c69-b8f7-5077a1ea2ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:58.452823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a7a90-70c2-4c69-b8f7-5077a1ea2ffc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:58.482218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a7a90-70c2-4c69-b8f7-5077a1ea2ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-637a7a90-70c2-4c69-b8f7-5077a1ea2ffc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:09:58.497504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:09:58.498654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:09:58.499613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 119/229] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:09:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:09:58.507677 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a7a90-70c2-4c69-b8f7-5077a1ea2ffc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:58.598355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4113596-1d08-4846-a5e8-c09b681c32c9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:58.634814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dcf9a-e01a-4c00-aceb-591fb736df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:58.635472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dcf9a-e01a-4c00-aceb-591fb736df4a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:58.635765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dcf9a-e01a-4c00-aceb-591fb736df4a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:58.636078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dcf9a-e01a-4c00-aceb-591fb736df4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:58.636939 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dcf9a-e01a-4c00-aceb-591fb736df4a None admin] RBAC: Adding query filter params (role.id=dda86b29d55a42c48f50fdd9fc4d5b61, scope.project.id=aa8cd07280d947a396d40811bab95347, user.id=dd5051b7c9f34e4896eeadd3fd8b79ba) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:58.637254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dcf9a-e01a-4c00-aceb-591fb736df4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:58.638714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dcf9a-e01a-4c00-aceb-591fb736df4a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:58.641497 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a7a90-70c2-4c69-b8f7-5077a1ea2ffc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:58.644859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 111/230] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:09:58 2022] GET /identity/v3/role_assignments?user.id=dd5051b7c9f34e4896eeadd3fd8b79ba&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:58.688426 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b62720-d101-45f5-80f8-dcd6c578a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:58.689119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b62720-d101-45f5-80f8-dcd6c578a5ca None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:58.689403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b62720-d101-45f5-80f8-dcd6c578a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:58.689680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b62720-d101-45f5-80f8-dcd6c578a5ca None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:58.690453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b62720-d101-45f5-80f8-dcd6c578a5ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:09:58.690762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b62720-d101-45f5-80f8-dcd6c578a5ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:58.692262 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b62720-d101-45f5-80f8-dcd6c578a5ca None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:58.701602 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 120/231] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:09:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:09:58.707063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dcf9a-e01a-4c00-aceb-591fb736df4a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:58.855038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:58.877616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dcf9a-e01a-4c00-aceb-591fb736df4a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:58.940825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c2ce0-310b-461a-9694-0aaa9a6af76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:58.941719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c2ce0-310b-461a-9694-0aaa9a6af76e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:58.942004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c2ce0-310b-461a-9694-0aaa9a6af76e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:58.942282 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c2ce0-310b-461a-9694-0aaa9a6af76e None admin] PATH_INFO: `/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:58.943511 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c2ce0-310b-461a-9694-0aaa9a6af76e None admin] RBAC: Authorizing `identity:get_user(user_id=75bd1e77fbca426e9c2d92c4fe3c0bc0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:58.945011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c2ce0-310b-461a-9694-0aaa9a6af76e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:58.947329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 112/232] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:09:58 2022] GET /identity/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0 => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:58.953115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b62720-d101-45f5-80f8-dcd6c578a5ca None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:59.026200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:09:59.113309 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b62720-d101-45f5-80f8-dcd6c578a5ca None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:59.158972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550124ce-5abe-40ac-94c5-6c30120a5527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:59.159859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550124ce-5abe-40ac-94c5-6c30120a5527 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:59.160188 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550124ce-5abe-40ac-94c5-6c30120a5527 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:59.160474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550124ce-5abe-40ac-94c5-6c30120a5527 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:59.161682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550124ce-5abe-40ac-94c5-6c30120a5527 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:59.163142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550124ce-5abe-40ac-94c5-6c30120a5527 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:59.168180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 121/233] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:09:58 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:09:59.171372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c2ce0-310b-461a-9694-0aaa9a6af76e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:09:59.304115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c2ce0-310b-461a-9694-0aaa9a6af76e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:09:59.341520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a786269-aff8-496c-891b-adcc4fc72541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:09:59.342426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a786269-aff8-496c-891b-adcc4fc72541 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:09:59.342711 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a786269-aff8-496c-891b-adcc4fc72541 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:09:59.342991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a786269-aff8-496c-891b-adcc4fc72541 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347/users/75bd1e77fbca426e9c2d92c4fe3c0bc0/roles/0ec7b267a5724203a4845cf7da3a6ab8` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:09:59.345261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a786269-aff8-496c-891b-adcc4fc72541 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8cd07280d947a396d40811bab95347, user_id=75bd1e77fbca426e9c2d92c4fe3c0bc0, role_id=0ec7b267a5724203a4845cf7da3a6ab8)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:09:59.346719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a786269-aff8-496c-891b-adcc4fc72541 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:09:59.364636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 113/234] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:09:59 2022] PUT /identity/v3/projects/aa8cd07280d947a396d40811bab95347/users/75bd1e77fbca426e9c2d92c4fe3c0bc0/roles/0ec7b267a5724203a4845cf7da3a6ab8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:00.094222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266e73e-aa69-48cb-8604-782ab001511a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:00.094706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266e73e-aa69-48cb-8604-782ab001511a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:00.094706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266e73e-aa69-48cb-8604-782ab001511a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:00.096388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 122/235] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:00.101729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c4e77-397d-44fa-936c-fc502bd168ef None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:00.102616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c4e77-397d-44fa-936c-fc502bd168ef None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:00.102903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c4e77-397d-44fa-936c-fc502bd168ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:00.124593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bc8c4e77-397d-44fa-936c-fc502bd168ef None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:00.125851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bc8c4e77-397d-44fa-936c-fc502bd168ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:00.127890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:00.150571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481228-b682-4d2f-aa86-24ae561d0998 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:00.150897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481228-b682-4d2f-aa86-24ae561d0998 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:00.151452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481228-b682-4d2f-aa86-24ae561d0998 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:00.153328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 123/236] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:10:00.161364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd65a-a7f5-4c65-addb-be46ad5d39e0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:00.161733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd65a-a7f5-4c65-addb-be46ad5d39e0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:00.162094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd65a-a7f5-4c65-addb-be46ad5d39e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:00.183669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-743fd65a-a7f5-4c65-addb-be46ad5d39e0 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:00.185011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-743fd65a-a7f5-4c65-addb-be46ad5d39e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:00.241947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 114/237] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:00.255237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 124/238] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:00.279646 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c4e77-397d-44fa-936c-fc502bd168ef None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:00.287860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd65a-a7f5-4c65-addb-be46ad5d39e0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:00.335364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:00.400772 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd65a-a7f5-4c65-addb-be46ad5d39e0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:00.442069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0c0f9-fb5d-4320-ae96-b30e8b5742a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:00.442877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0c0f9-fb5d-4320-ae96-b30e8b5742a0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:00.443165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0c0f9-fb5d-4320-ae96-b30e8b5742a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:00.443449 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0c0f9-fb5d-4320-ae96-b30e8b5742a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:00.445665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0c0f9-fb5d-4320-ae96-b30e8b5742a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:00.447149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0c0f9-fb5d-4320-ae96-b30e8b5742a0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:00.448835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 125/239] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:00.457427 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0c0f9-fb5d-4320-ae96-b30e8b5742a0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:00.500979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c4e77-397d-44fa-936c-fc502bd168ef None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:00.542260 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87826561-afb2-4e84-98af-71393d5f2646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:00.543068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826561-afb2-4e84-98af-71393d5f2646 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:00.543352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826561-afb2-4e84-98af-71393d5f2646 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:00.543627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826561-afb2-4e84-98af-71393d5f2646 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:00.551675 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:00.557136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87826561-afb2-4e84-98af-71393d5f2646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-87826561-afb2-4e84-98af-71393d5f2646 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:00.565702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:00.566569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:00.567351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 115/240] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:00.573049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87826561-afb2-4e84-98af-71393d5f2646 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:00.683985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0c0f9-fb5d-4320-ae96-b30e8b5742a0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:00.692231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:00.720759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87826561-afb2-4e84-98af-71393d5f2646 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:00.722243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535efa7e-fe8a-4979-a386-7ba4e1030720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:00.723038 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535efa7e-fe8a-4979-a386-7ba4e1030720 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:00.723332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535efa7e-fe8a-4979-a386-7ba4e1030720 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:00.723616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535efa7e-fe8a-4979-a386-7ba4e1030720 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:00.728149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535efa7e-fe8a-4979-a386-7ba4e1030720 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:00.728149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535efa7e-fe8a-4979-a386-7ba4e1030720 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:00.763208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 126/241] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:10:00 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:10:00.782820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b33e-8d45-461d-9065-28852da741a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:00.783808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b33e-8d45-461d-9065-28852da741a2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:00.784342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b33e-8d45-461d-9065-28852da741a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:00.784818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b33e-8d45-461d-9065-28852da741a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:00.785900 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54b33e-8d45-461d-9065-28852da741a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:00.786366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54b33e-8d45-461d-9065-28852da741a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:00.787946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54b33e-8d45-461d-9065-28852da741a2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:00.798932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 116/242] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:00.805397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535efa7e-fe8a-4979-a386-7ba4e1030720 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:00.943977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535efa7e-fe8a-4979-a386-7ba4e1030720 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:00.993886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cb8fc-59da-4dfc-913d-429425cdc0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:00.995170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cb8fc-59da-4dfc-913d-429425cdc0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:00.995607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cb8fc-59da-4dfc-913d-429425cdc0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:00.996052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cb8fc-59da-4dfc-913d-429425cdc0e2 None admin] PATH_INFO: `/v3/users/5952ce6cc77446679b6abe9499ed9b32` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:01.012526 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cb8fc-59da-4dfc-913d-429425cdc0e2 None admin] RBAC: Authorizing `identity:get_user(user_id=5952ce6cc77446679b6abe9499ed9b32)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:01.014247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cb8fc-59da-4dfc-913d-429425cdc0e2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:01.016876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 127/243] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:00 2022] GET /identity/v3/users/5952ce6cc77446679b6abe9499ed9b32 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:01.022512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b33e-8d45-461d-9065-28852da741a2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:01.092786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:01.101070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb1e3f-7d69-4fc0-8b20-78e1898921a0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:01.102291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb1e3f-7d69-4fc0-8b20-78e1898921a0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:01.102779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb1e3f-7d69-4fc0-8b20-78e1898921a0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:01.104718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 128/244] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:01.110263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8704c-a9f4-47ff-8224-b940c3dd3f2e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:01.110823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8704c-a9f4-47ff-8224-b940c3dd3f2e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:01.111308 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8704c-a9f4-47ff-8224-b940c3dd3f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:01.129801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8cb8704c-a9f4-47ff-8224-b940c3dd3f2e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:01.131397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8cb8704c-a9f4-47ff-8224-b940c3dd3f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:01.145705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b33e-8d45-461d-9065-28852da741a2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:01.150062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:01.193650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf5eba-ed33-437c-8996-250f8263bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:01.194902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5eba-ed33-437c-8996-250f8263bdfc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:01.195377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5eba-ed33-437c-8996-250f8263bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:01.196182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5eba-ed33-437c-8996-250f8263bdfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:01.228519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 129/245] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:01.265133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8704c-a9f4-47ff-8224-b940c3dd3f2e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:01.287300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf5eba-ed33-437c-8996-250f8263bdfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:01.288978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf5eba-ed33-437c-8996-250f8263bdfc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:01.358144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:01.377922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8704c-a9f4-47ff-8224-b940c3dd3f2e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:01.406978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 117/246] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:01.413001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf5eba-ed33-437c-8996-250f8263bdfc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:01.415517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d10f0-1c0e-4d18-bb64-9dc6a3709153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:01.416953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d10f0-1c0e-4d18-bb64-9dc6a3709153 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:01.416953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d10f0-1c0e-4d18-bb64-9dc6a3709153 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:01.416953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d10f0-1c0e-4d18-bb64-9dc6a3709153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:01.428450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d10f0-1c0e-4d18-bb64-9dc6a3709153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-351d10f0-1c0e-4d18-bb64-9dc6a3709153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:01.436680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:01.437775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:01.438821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 130/247] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:01.446525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d10f0-1c0e-4d18-bb64-9dc6a3709153 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:01.462482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:01.575082 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d10f0-1c0e-4d18-bb64-9dc6a3709153 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:01.590967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf5eba-ed33-437c-8996-250f8263bdfc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:01.614259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54ee4c-e5a9-4b0a-92fc-724d943b8f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:01.614938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54ee4c-e5a9-4b0a-92fc-724d943b8f4e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:01.615224 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54ee4c-e5a9-4b0a-92fc-724d943b8f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:01.615504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54ee4c-e5a9-4b0a-92fc-724d943b8f4e None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:01.616290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54ee4c-e5a9-4b0a-92fc-724d943b8f4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:01.616603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54ee4c-e5a9-4b0a-92fc-724d943b8f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:01.618581 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54ee4c-e5a9-4b0a-92fc-724d943b8f4e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:01.628063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 131/248] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:01.629384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f09f-8cb1-49f7-bb5a-e3ce6b8c2037 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:01.629675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f09f-8cb1-49f7-bb5a-e3ce6b8c2037 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:01.629956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f09f-8cb1-49f7-bb5a-e3ce6b8c2037 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:01.631351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 132/249] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:01.635005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443f09f-8cb1-49f7-bb5a-e3ce6b8c2037 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:01.642647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58784f32-3c3b-44dc-ad7c-112b1a0aa374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:01.643521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58784f32-3c3b-44dc-ad7c-112b1a0aa374 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:01.643807 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58784f32-3c3b-44dc-ad7c-112b1a0aa374 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:01.644132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58784f32-3c3b-44dc-ad7c-112b1a0aa374 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:01.645371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58784f32-3c3b-44dc-ad7c-112b1a0aa374 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:01.647013 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58784f32-3c3b-44dc-ad7c-112b1a0aa374 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:01.654251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 118/250] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:01 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:01.655558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ba3ad-a457-425e-a95f-f3426cbaf9c1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:01.655852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ba3ad-a457-425e-a95f-f3426cbaf9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:01.656174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ba3ad-a457-425e-a95f-f3426cbaf9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:01.674299 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6f5ba3ad-a457-425e-a95f-f3426cbaf9c1 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:01.675569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6f5ba3ad-a457-425e-a95f-f3426cbaf9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:01.709446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:01.714536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:01.750104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 119/251] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:01.757771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443f09f-8cb1-49f7-bb5a-e3ce6b8c2037 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:01.758889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ba3ad-a457-425e-a95f-f3426cbaf9c1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:01.801683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8b22-1c4b-4dff-bce0-73a0d30e04f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:01.802568 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8b22-1c4b-4dff-bce0-73a0d30e04f2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:01.803001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8b22-1c4b-4dff-bce0-73a0d30e04f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:01.803290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8b22-1c4b-4dff-bce0-73a0d30e04f2 None admin] PATH_INFO: `/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:01.805804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed8b22-1c4b-4dff-bce0-73a0d30e04f2 None admin] RBAC: Authorizing `identity:get_user(user_id=75bd1e77fbca426e9c2d92c4fe3c0bc0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:01.807335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed8b22-1c4b-4dff-bce0-73a0d30e04f2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:01.811303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 133/252] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:01 2022] GET /identity/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:01.812238 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8b22-1c4b-4dff-bce0-73a0d30e04f2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:01.918345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ba3ad-a457-425e-a95f-f3426cbaf9c1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:01.984087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0462c-6098-4323-b22a-a3fdbb6d366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:01.985216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0462c-6098-4323-b22a-a3fdbb6d366c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:01.985701 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0462c-6098-4323-b22a-a3fdbb6d366c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:01.986173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0462c-6098-4323-b22a-a3fdbb6d366c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:01.987244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0462c-6098-4323-b22a-a3fdbb6d366c None admin] RBAC: Adding query filter params (role.id=0473bb110e5b46a28efa9ef9abc7659b, scope.project.id=aa8cd07280d947a396d40811bab95347, user.id=5952ce6cc77446679b6abe9499ed9b32) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:01.987772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0462c-6098-4323-b22a-a3fdbb6d366c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:01.989479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0462c-6098-4323-b22a-a3fdbb6d366c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:01.996065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8b22-1c4b-4dff-bce0-73a0d30e04f2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:01.997076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 120/253] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:01 2022] GET /identity/v3/role_assignments?user.id=5952ce6cc77446679b6abe9499ed9b32&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=0473bb110e5b46a28efa9ef9abc7659b => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:01.998176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0462c-6098-4323-b22a-a3fdbb6d366c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:02.045182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:02.075143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950668d-fd24-45b9-aa1b-b03894b53bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:02.076417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950668d-fd24-45b9-aa1b-b03894b53bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:02.077192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950668d-fd24-45b9-aa1b-b03894b53bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:02.077691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950668d-fd24-45b9-aa1b-b03894b53bc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:02.097721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950668d-fd24-45b9-aa1b-b03894b53bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b950668d-fd24-45b9-aa1b-b03894b53bc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:02.107851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:02.109217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:02.109995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:02.113313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 134/254] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:02.116746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:02.121288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950668d-fd24-45b9-aa1b-b03894b53bc5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:02.242507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950668d-fd24-45b9-aa1b-b03894b53bc5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:02.292747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4817f07-f69c-48ad-95b2-321be72665bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:02.293440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817f07-f69c-48ad-95b2-321be72665bf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:02.293727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817f07-f69c-48ad-95b2-321be72665bf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:02.294008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817f07-f69c-48ad-95b2-321be72665bf None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:02.294772 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4817f07-f69c-48ad-95b2-321be72665bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:02.295080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4817f07-f69c-48ad-95b2-321be72665bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:02.296510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4817f07-f69c-48ad-95b2-321be72665bf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:02.310006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0462c-6098-4323-b22a-a3fdbb6d366c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:02.319777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 135/255] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:02.321925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec2a2-2f15-4e67-a98a-c1e931b3e481 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:02.322216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec2a2-2f15-4e67-a98a-c1e931b3e481 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:02.322492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec2a2-2f15-4e67-a98a-c1e931b3e481 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:02.323787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 136/256] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:02.329179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ec2a2-2f15-4e67-a98a-c1e931b3e481 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:02.385681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732c86c-207d-4eb0-832a-21f5515d1f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:02.388227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732c86c-207d-4eb0-832a-21f5515d1f26 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:02.388522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732c86c-207d-4eb0-832a-21f5515d1f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:02.388802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732c86c-207d-4eb0-832a-21f5515d1f26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:02.450354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:02.513641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732c86c-207d-4eb0-832a-21f5515d1f26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:02.515027 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732c86c-207d-4eb0-832a-21f5515d1f26 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:02.529292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ec2a2-2f15-4e67-a98a-c1e931b3e481 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:02.540419 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:02.614761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f45d3-561f-46f9-ab0a-d77572b38360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:02.615652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f45d3-561f-46f9-ab0a-d77572b38360 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:02.615940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f45d3-561f-46f9-ab0a-d77572b38360 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:02.616249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f45d3-561f-46f9-ab0a-d77572b38360 None admin] PATH_INFO: `/v3/users/dd5051b7c9f34e4896eeadd3fd8b79ba` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:02.620826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f45d3-561f-46f9-ab0a-d77572b38360 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5051b7c9f34e4896eeadd3fd8b79ba)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:02.622425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f45d3-561f-46f9-ab0a-d77572b38360 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:02.624538 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 137/257] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:02 2022] GET /identity/v3/users/dd5051b7c9f34e4896eeadd3fd8b79ba => generated 297 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:02.625782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42a2dd-dbb6-4a4f-9c70-6175e8030f6f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:02.626075 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42a2dd-dbb6-4a4f-9c70-6175e8030f6f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:02.626359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42a2dd-dbb6-4a4f-9c70-6175e8030f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:02.633760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 121/258] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:02.634882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732c86c-207d-4eb0-832a-21f5515d1f26 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:02.665745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fa42a2dd-dbb6-4a4f-9c70-6175e8030f6f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:02.666975 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fa42a2dd-dbb6-4a4f-9c70-6175e8030f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:02.807156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 138/259] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:02.808032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42a2dd-dbb6-4a4f-9c70-6175e8030f6f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:02.812046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732c86c-207d-4eb0-832a-21f5515d1f26 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:02.860380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:02.891301 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee3daa-c7a0-45e1-a668-141d81cc7b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:02.892216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee3daa-c7a0-45e1-a668-141d81cc7b30 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:02.892508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee3daa-c7a0-45e1-a668-141d81cc7b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:02.892783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee3daa-c7a0-45e1-a668-141d81cc7b30 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:02.900367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:02.900783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee3daa-c7a0-45e1-a668-141d81cc7b30 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:02.902269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee3daa-c7a0-45e1-a668-141d81cc7b30 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:02.904503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 122/260] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:02 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:02.905310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee3daa-c7a0-45e1-a668-141d81cc7b30 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:02.944832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42a2dd-dbb6-4a4f-9c70-6175e8030f6f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:02.984578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d73884-7a88-4ef1-966d-71b18f86b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:02.986242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d73884-7a88-4ef1-966d-71b18f86b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:02.986531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d73884-7a88-4ef1-966d-71b18f86b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:02.986810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d73884-7a88-4ef1-966d-71b18f86b9f8 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:02.988564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d73884-7a88-4ef1-966d-71b18f86b9f8 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:02.990047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d73884-7a88-4ef1-966d-71b18f86b9f8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:02.994395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 139/261] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:02 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:02.995014 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d73884-7a88-4ef1-966d-71b18f86b9f8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:03.118270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee3daa-c7a0-45e1-a668-141d81cc7b30 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:03.164321 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6603fd9-b8c9-43f3-b5e2-fdd0ee8f4f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:03.165149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6603fd9-b8c9-43f3-b5e2-fdd0ee8f4f11 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:03.165437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6603fd9-b8c9-43f3-b5e2-fdd0ee8f4f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:03.165717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6603fd9-b8c9-43f3-b5e2-fdd0ee8f4f11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:03.189705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6603fd9-b8c9-43f3-b5e2-fdd0ee8f4f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-d6603fd9-b8c9-43f3-b5e2-fdd0ee8f4f11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:03.208043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:03.208952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:03.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:03.210393 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d73884-7a88-4ef1-966d-71b18f86b9f8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:03.214427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 123/262] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:10:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:03.215492 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6603fd9-b8c9-43f3-b5e2-fdd0ee8f4f11 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:03.232237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:03.247514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90ce85-5ef4-461d-94e4-8792027ae5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:03.248492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ce85-5ef4-461d-94e4-8792027ae5a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:03.248785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ce85-5ef4-461d-94e4-8792027ae5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:03.249062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ce85-5ef4-461d-94e4-8792027ae5a7 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347/users/dd5051b7c9f34e4896eeadd3fd8b79ba/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:03.252336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90ce85-5ef4-461d-94e4-8792027ae5a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8cd07280d947a396d40811bab95347, user_id=dd5051b7c9f34e4896eeadd3fd8b79ba, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:03.256011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90ce85-5ef4-461d-94e4-8792027ae5a7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:03.279598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 140/263] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:10:02 2022] PUT /identity/v3/projects/aa8cd07280d947a396d40811bab95347/users/dd5051b7c9f34e4896eeadd3fd8b79ba/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:03.280503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90ce85-5ef4-461d-94e4-8792027ae5a7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:03.324673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:03.425705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6603fd9-b8c9-43f3-b5e2-fdd0ee8f4f11 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:03.483677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756642-ae89-43ee-a6a6-0a6e118c84cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:03.484388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756642-ae89-43ee-a6a6-0a6e118c84cc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:03.484680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756642-ae89-43ee-a6a6-0a6e118c84cc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:03.484960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756642-ae89-43ee-a6a6-0a6e118c84cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:03.485820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756642-ae89-43ee-a6a6-0a6e118c84cc None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=aa8cd07280d947a396d40811bab95347, user.id=75bd1e77fbca426e9c2d92c4fe3c0bc0) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:03.486277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756642-ae89-43ee-a6a6-0a6e118c84cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:03.487769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756642-ae89-43ee-a6a6-0a6e118c84cc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:03.500534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 124/264] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:03 2022] GET /identity/v3/role_assignments?user.id=75bd1e77fbca426e9c2d92c4fe3c0bc0&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:03.556613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90ce85-5ef4-461d-94e4-8792027ae5a7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:03.598029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff85dde-9cdd-4c26-a2c0-c42549c2d26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:03.598724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff85dde-9cdd-4c26-a2c0-c42549c2d26b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:03.599016 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff85dde-9cdd-4c26-a2c0-c42549c2d26b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:03.599299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff85dde-9cdd-4c26-a2c0-c42549c2d26b None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:03.600134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff85dde-9cdd-4c26-a2c0-c42549c2d26b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:03.600452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff85dde-9cdd-4c26-a2c0-c42549c2d26b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:03.602442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff85dde-9cdd-4c26-a2c0-c42549c2d26b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:03.616162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 141/265] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:03.618099 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756642-ae89-43ee-a6a6-0a6e118c84cc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:03.740970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756642-ae89-43ee-a6a6-0a6e118c84cc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:03.756755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:03.779561 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed59f99-47ec-4ef1-a7c1-5828b4df53c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:03.780475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed59f99-47ec-4ef1-a7c1-5828b4df53c0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:03.780761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed59f99-47ec-4ef1-a7c1-5828b4df53c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:03.781041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed59f99-47ec-4ef1-a7c1-5828b4df53c0 None admin] PATH_INFO: `/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:03.782286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed59f99-47ec-4ef1-a7c1-5828b4df53c0 None admin] RBAC: Authorizing `identity:get_user(user_id=75bd1e77fbca426e9c2d92c4fe3c0bc0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:03.783760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed59f99-47ec-4ef1-a7c1-5828b4df53c0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:03.785847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 125/266] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:03 2022] GET /identity/v3/users/75bd1e77fbca426e9c2d92c4fe3c0bc0 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:03.791750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff85dde-9cdd-4c26-a2c0-c42549c2d26b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:03.864081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:03.908684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ead97-cef0-46c4-8ac6-8be67998fa58 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:03.908972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ead97-cef0-46c4-8ac6-8be67998fa58 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:03.909253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ead97-cef0-46c4-8ac6-8be67998fa58 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:03.911213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 126/267] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:03.918107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba3a08-3def-4d3b-848f-9b08dc4dcb84 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:03.918485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba3a08-3def-4d3b-848f-9b08dc4dcb84 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:03.918840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba3a08-3def-4d3b-848f-9b08dc4dcb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:03.938650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1bba3a08-3def-4d3b-848f-9b08dc4dcb84 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:03.940051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1bba3a08-3def-4d3b-848f-9b08dc4dcb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:03.941971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff85dde-9cdd-4c26-a2c0-c42549c2d26b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:04.016187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbd595-f89a-48d5-abed-208717c5f8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:04.016821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd595-f89a-48d5-abed-208717c5f8df None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.017113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd595-f89a-48d5-abed-208717c5f8df None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.017392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd595-f89a-48d5-abed-208717c5f8df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.041263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 127/268] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:04.042622 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5c901-fd5f-429f-ba18-79bf327842ad None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.042909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5c901-fd5f-429f-ba18-79bf327842ad None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.043189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5c901-fd5f-429f-ba18-79bf327842ad None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.044779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 128/269] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:04.050202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7f8db-affd-468a-86a1-13b77f840a2f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.050490 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7f8db-affd-468a-86a1-13b77f840a2f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.050768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7f8db-affd-468a-86a1-13b77f840a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.067811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1cb7f8db-affd-468a-86a1-13b77f840a2f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:04.069054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1cb7f8db-affd-468a-86a1-13b77f840a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:04.128546 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbd595-f89a-48d5-abed-208717c5f8df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:04.130171 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbd595-f89a-48d5-abed-208717c5f8df None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:04.153432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 129/270] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:04.154704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7f8db-affd-468a-86a1-13b77f840a2f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:04.189972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:04.214741 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:04.247931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 142/271] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 12:10:04.249421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbd595-f89a-48d5-abed-208717c5f8df None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:04.266588 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7f8db-affd-468a-86a1-13b77f840a2f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:04.305930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395dffb-a20a-4444-aa66-a67730e26328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:04.306831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395dffb-a20a-4444-aa66-a67730e26328 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.307218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395dffb-a20a-4444-aa66-a67730e26328 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.307550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395dffb-a20a-4444-aa66-a67730e26328 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.318663 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395dffb-a20a-4444-aa66-a67730e26328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-a395dffb-a20a-4444-aa66-a67730e26328 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:04.327660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:04.329030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:04.329819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 130/272] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:04.330456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395dffb-a20a-4444-aa66-a67730e26328 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:04.360979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbd595-f89a-48d5-abed-208717c5f8df None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:04.399179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5bcee-b360-41dd-bc3c-be526ebe25c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:04.400307 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5bcee-b360-41dd-bc3c-be526ebe25c9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.400776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5bcee-b360-41dd-bc3c-be526ebe25c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.401259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5bcee-b360-41dd-bc3c-be526ebe25c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.402711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5bcee-b360-41dd-bc3c-be526ebe25c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:04.404521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5bcee-b360-41dd-bc3c-be526ebe25c9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:04.406399 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 143/273] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:04.407483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5bcee-b360-41dd-bc3c-be526ebe25c9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:04.427912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:04.442824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395dffb-a20a-4444-aa66-a67730e26328 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:04.444410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:04.482284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581f8b7-ffff-4bde-9fbe-6d6c7bab7f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:04.483155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581f8b7-ffff-4bde-9fbe-6d6c7bab7f63 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.483445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581f8b7-ffff-4bde-9fbe-6d6c7bab7f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.483727 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581f8b7-ffff-4bde-9fbe-6d6c7bab7f63 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.484990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581f8b7-ffff-4bde-9fbe-6d6c7bab7f63 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:04.486952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581f8b7-ffff-4bde-9fbe-6d6c7bab7f63 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:04.493697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 131/274] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:04 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:04.494552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581f8b7-ffff-4bde-9fbe-6d6c7bab7f63 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:04.523425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5bcee-b360-41dd-bc3c-be526ebe25c9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:04.566382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58504da5-5e3e-495d-a1e6-8445edd88526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:04.567069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58504da5-5e3e-495d-a1e6-8445edd88526 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.567629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58504da5-5e3e-495d-a1e6-8445edd88526 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.567917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58504da5-5e3e-495d-a1e6-8445edd88526 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.569112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58504da5-5e3e-495d-a1e6-8445edd88526 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:04.569440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58504da5-5e3e-495d-a1e6-8445edd88526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:04.571753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58504da5-5e3e-495d-a1e6-8445edd88526 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:04.584059 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 144/275] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:04.585879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58504da5-5e3e-495d-a1e6-8445edd88526 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:04.622031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581f8b7-ffff-4bde-9fbe-6d6c7bab7f63 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:04.657698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565713-9e4c-4ccd-b84b-aa474b2cad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:04.658357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565713-9e4c-4ccd-b84b-aa474b2cad6b None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.658646 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565713-9e4c-4ccd-b84b-aa474b2cad6b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.658927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565713-9e4c-4ccd-b84b-aa474b2cad6b None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.659664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565713-9e4c-4ccd-b84b-aa474b2cad6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:04.661180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565713-9e4c-4ccd-b84b-aa474b2cad6b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:04.683617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 132/276] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:10:04 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:10:04.684491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565713-9e4c-4ccd-b84b-aa474b2cad6b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:04.693211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:04.718681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58504da5-5e3e-495d-a1e6-8445edd88526 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:04.723004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:04.768931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72fa54-ab1a-47ba-8452-44bb5a9e4520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:04.770227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72fa54-ab1a-47ba-8452-44bb5a9e4520 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.770803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72fa54-ab1a-47ba-8452-44bb5a9e4520 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.771093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72fa54-ab1a-47ba-8452-44bb5a9e4520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.771980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72fa54-ab1a-47ba-8452-44bb5a9e4520 None admin] RBAC: Adding query filter params (role.id=0ec7b267a5724203a4845cf7da3a6ab8, scope.project.id=aa8cd07280d947a396d40811bab95347, user.id=75bd1e77fbca426e9c2d92c4fe3c0bc0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:04.772332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72fa54-ab1a-47ba-8452-44bb5a9e4520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:04.774839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72fa54-ab1a-47ba-8452-44bb5a9e4520 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:04.787221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 145/277] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:04 2022] GET /identity/v3/role_assignments?user.id=75bd1e77fbca426e9c2d92c4fe3c0bc0&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=0ec7b267a5724203a4845cf7da3a6ab8 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:04.788650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd324d-2b0a-470a-b395-2a17139d8648 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.788942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd324d-2b0a-470a-b395-2a17139d8648 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.789281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd324d-2b0a-470a-b395-2a17139d8648 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.790927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 146/278] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:04.810259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26810748-962f-466c-a970-80827d5e4194 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.810631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26810748-962f-466c-a970-80827d5e4194 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.810984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26810748-962f-466c-a970-80827d5e4194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.833136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565713-9e4c-4ccd-b84b-aa474b2cad6b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:04.849385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-26810748-962f-466c-a970-80827d5e4194 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:04.850645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-26810748-962f-466c-a970-80827d5e4194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:04.880930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3da41-315d-4d22-a722-2e1b0cdaf54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:04.882288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3da41-315d-4d22-a722-2e1b0cdaf54d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:04.882910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3da41-315d-4d22-a722-2e1b0cdaf54d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:04.883473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3da41-315d-4d22-a722-2e1b0cdaf54d None admin] PATH_INFO: `/v3/users/f43f5f85c2a5481089c942df5a3f27a9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:04.902377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3da41-315d-4d22-a722-2e1b0cdaf54d None admin] RBAC: Authorizing `identity:get_user(user_id=f43f5f85c2a5481089c942df5a3f27a9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:04.904308 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3da41-315d-4d22-a722-2e1b0cdaf54d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:04.906842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 133/279] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:04 2022] GET /identity/v3/users/f43f5f85c2a5481089c942df5a3f27a9 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:04.914299 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3da41-315d-4d22-a722-2e1b0cdaf54d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:04.951586 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 147/280] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:04.977685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26810748-962f-466c-a970-80827d5e4194 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:05.031357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:05.050170 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3da41-315d-4d22-a722-2e1b0cdaf54d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:05.078065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:05.100010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a95c3-4e4d-4c58-82b3-78c66d8c98d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:05.100701 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a95c3-4e4d-4c58-82b3-78c66d8c98d5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:05.100992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a95c3-4e4d-4c58-82b3-78c66d8c98d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:05.101279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a95c3-4e4d-4c58-82b3-78c66d8c98d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:05.102736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a95c3-4e4d-4c58-82b3-78c66d8c98d5 None admin] RBAC: Adding query filter params (role.id=dda86b29d55a42c48f50fdd9fc4d5b61, user.id=f43f5f85c2a5481089c942df5a3f27a9, scope.system=all) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:05.103053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a95c3-4e4d-4c58-82b3-78c66d8c98d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:05.104734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a95c3-4e4d-4c58-82b3-78c66d8c98d5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:05.111636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 134/281] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Jun 22 12:10:04 2022] GET /identity/v3/role_assignments?user.id=f43f5f85c2a5481089c942df5a3f27a9&scope.system=all&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:05.112611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26810748-962f-466c-a970-80827d5e4194 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:05.158346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51c7d0-8b35-441f-ae7e-587bb71610a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:05.159473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c7d0-8b35-441f-ae7e-587bb71610a3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:05.159905 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c7d0-8b35-441f-ae7e-587bb71610a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:05.160398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c7d0-8b35-441f-ae7e-587bb71610a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:05.174595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51c7d0-8b35-441f-ae7e-587bb71610a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2d51c7d0-8b35-441f-ae7e-587bb71610a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:05.183200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:05.184215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:05.185021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 148/282] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:05.190494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a95c3-4e4d-4c58-82b3-78c66d8c98d5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:05.306725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a95c3-4e4d-4c58-82b3-78c66d8c98d5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:05.343800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee697cb2-ca22-4ac7-8df2-81872439cc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:05.344640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee697cb2-ca22-4ac7-8df2-81872439cc1b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:05.344808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee697cb2-ca22-4ac7-8df2-81872439cc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:05.345066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee697cb2-ca22-4ac7-8df2-81872439cc1b None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:05.345832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee697cb2-ca22-4ac7-8df2-81872439cc1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:05.346142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee697cb2-ca22-4ac7-8df2-81872439cc1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:05.347552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee697cb2-ca22-4ac7-8df2-81872439cc1b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:05.357210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 135/283] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:05.362708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51c7d0-8b35-441f-ae7e-587bb71610a3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:05.503708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51c7d0-8b35-441f-ae7e-587bb71610a3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:05.551090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9603e7-d895-4a67-8492-843bf7bb4862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:05.551973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9603e7-d895-4a67-8492-843bf7bb4862 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:05.552283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9603e7-d895-4a67-8492-843bf7bb4862 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:05.552566 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9603e7-d895-4a67-8492-843bf7bb4862 None admin] PATH_INFO: `/v3/users/5952ce6cc77446679b6abe9499ed9b32` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:05.556722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9603e7-d895-4a67-8492-843bf7bb4862 None admin] RBAC: Authorizing `identity:get_user(user_id=5952ce6cc77446679b6abe9499ed9b32)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:05.558306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9603e7-d895-4a67-8492-843bf7bb4862 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:05.560148 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 149/284] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:05 2022] GET /identity/v3/users/5952ce6cc77446679b6abe9499ed9b32 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:05.565658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee697cb2-ca22-4ac7-8df2-81872439cc1b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:05.588514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:05.735367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee697cb2-ca22-4ac7-8df2-81872439cc1b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:05.784804 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e84299-51a5-4559-8019-89b1e1c965e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:05.785682 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84299-51a5-4559-8019-89b1e1c965e3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:05.785971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84299-51a5-4559-8019-89b1e1c965e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:05.786250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84299-51a5-4559-8019-89b1e1c965e3 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:05.787457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e84299-51a5-4559-8019-89b1e1c965e3 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:05.789009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e84299-51a5-4559-8019-89b1e1c965e3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:05.791380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 136/285] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:05 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:05.797298 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9603e7-d895-4a67-8492-843bf7bb4862 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:05.802867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:05.831063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129928-7569-4433-9a80-a7deedccf7d1 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:05.831063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129928-7569-4433-9a80-a7deedccf7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:05.831206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129928-7569-4433-9a80-a7deedccf7d1 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:05.832820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 137/286] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:10:05.841250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a019600-236f-462b-b12f-47e4132fba36 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:05.841539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a019600-236f-462b-b12f-47e4132fba36 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:05.841822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a019600-236f-462b-b12f-47e4132fba36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:05.867178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3a019600-236f-462b-b12f-47e4132fba36 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:05.868486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3a019600-236f-462b-b12f-47e4132fba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:05.954188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 138/287] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:05.981318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a019600-236f-462b-b12f-47e4132fba36 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:05.992479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:06.006483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9603e7-d895-4a67-8492-843bf7bb4862 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:06.075337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416139-a5fd-4980-8b76-459ca22d7697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:06.076255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416139-a5fd-4980-8b76-459ca22d7697 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:06.076535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416139-a5fd-4980-8b76-459ca22d7697 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:06.076810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416139-a5fd-4980-8b76-459ca22d7697 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347/users/5952ce6cc77446679b6abe9499ed9b32/roles/0473bb110e5b46a28efa9ef9abc7659b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:06.078802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416139-a5fd-4980-8b76-459ca22d7697 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8cd07280d947a396d40811bab95347, user_id=5952ce6cc77446679b6abe9499ed9b32, role_id=0473bb110e5b46a28efa9ef9abc7659b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:06.080285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416139-a5fd-4980-8b76-459ca22d7697 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:06.096137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 150/288] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:10:05 2022] PUT /identity/v3/projects/aa8cd07280d947a396d40811bab95347/users/5952ce6cc77446679b6abe9499ed9b32/roles/0473bb110e5b46a28efa9ef9abc7659b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:06.164601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a019600-236f-462b-b12f-47e4132fba36 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:06.217462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347c642-f094-47d5-9565-bdf7244af3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:06.218273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347c642-f094-47d5-9565-bdf7244af3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:06.218555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347c642-f094-47d5-9565-bdf7244af3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:06.218829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347c642-f094-47d5-9565-bdf7244af3a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:06.237078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347c642-f094-47d5-9565-bdf7244af3a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f347c642-f094-47d5-9565-bdf7244af3a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:06.245402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:06.246270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:06.247093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 139/289] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:06.254059 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416139-a5fd-4980-8b76-459ca22d7697 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:06.338698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:06.383947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416139-a5fd-4980-8b76-459ca22d7697 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:06.422868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc2cf7-fa0a-41c9-8b0f-ba6568273a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:06.423543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2cf7-fa0a-41c9-8b0f-ba6568273a59 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:06.423822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2cf7-fa0a-41c9-8b0f-ba6568273a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:06.424125 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2cf7-fa0a-41c9-8b0f-ba6568273a59 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:06.424885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc2cf7-fa0a-41c9-8b0f-ba6568273a59 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:06.425187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc2cf7-fa0a-41c9-8b0f-ba6568273a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:06.426576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc2cf7-fa0a-41c9-8b0f-ba6568273a59 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:06.436358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 151/290] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:06.442245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347c642-f094-47d5-9565-bdf7244af3a8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:06.548597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:06.592012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347c642-f094-47d5-9565-bdf7244af3a8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:06.646497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2951a9-107f-4a35-a635-45102bcd150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:06.647324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2951a9-107f-4a35-a635-45102bcd150f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:06.647612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2951a9-107f-4a35-a635-45102bcd150f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:06.647895 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2951a9-107f-4a35-a635-45102bcd150f None admin] PATH_INFO: `/v3/users/dd5051b7c9f34e4896eeadd3fd8b79ba` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:06.649320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2951a9-107f-4a35-a635-45102bcd150f None admin] RBAC: Authorizing `identity:get_user(user_id=dd5051b7c9f34e4896eeadd3fd8b79ba)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:06.650826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2951a9-107f-4a35-a635-45102bcd150f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:06.652627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 140/291] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:06 2022] GET /identity/v3/users/dd5051b7c9f34e4896eeadd3fd8b79ba => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:06.658465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc2cf7-fa0a-41c9-8b0f-ba6568273a59 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:06.850735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc2cf7-fa0a-41c9-8b0f-ba6568273a59 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:06.875548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:06.894546 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba18af3-c8ef-4005-94bb-80950d30f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:06.895203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba18af3-c8ef-4005-94bb-80950d30f6ba None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:06.895479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba18af3-c8ef-4005-94bb-80950d30f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:06.895757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba18af3-c8ef-4005-94bb-80950d30f6ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:06.986472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba18af3-c8ef-4005-94bb-80950d30f6ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:06.988007 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba18af3-c8ef-4005-94bb-80950d30f6ba None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:07.092736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 152/292] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:07.101101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2951a9-107f-4a35-a635-45102bcd150f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:07.253024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2951a9-107f-4a35-a635-45102bcd150f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:07.306181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f05fc-488e-4c9e-88c7-c663e1891749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:07.307422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f05fc-488e-4c9e-88c7-c663e1891749 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:07.307910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f05fc-488e-4c9e-88c7-c663e1891749 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:07.308431 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f05fc-488e-4c9e-88c7-c663e1891749 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:07.309873 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f05fc-488e-4c9e-88c7-c663e1891749 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:07.311541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f05fc-488e-4c9e-88c7-c663e1891749 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:07.313502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 141/293] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:07 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:07.319225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba18af3-c8ef-4005-94bb-80950d30f6ba None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:07.368386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:07.437820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba18af3-c8ef-4005-94bb-80950d30f6ba None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:07.496777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4db02c-7cc4-464a-9b7b-2873945514bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:07.497466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4db02c-7cc4-464a-9b7b-2873945514bd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:07.497754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4db02c-7cc4-464a-9b7b-2873945514bd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:07.498035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4db02c-7cc4-464a-9b7b-2873945514bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:07.498880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4db02c-7cc4-464a-9b7b-2873945514bd None admin] RBAC: Adding query filter params (role.id=dda86b29d55a42c48f50fdd9fc4d5b61, scope.project.id=aa8cd07280d947a396d40811bab95347, user.id=dd5051b7c9f34e4896eeadd3fd8b79ba) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:07.499195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4db02c-7cc4-464a-9b7b-2873945514bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:07.500673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4db02c-7cc4-464a-9b7b-2873945514bd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:07.507304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 153/294] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:07 2022] GET /identity/v3/role_assignments?user.id=dd5051b7c9f34e4896eeadd3fd8b79ba&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:07.622138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222a4c-80a3-4cf1-b121-2108932b34d4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:07.622642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222a4c-80a3-4cf1-b121-2108932b34d4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:07.622713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222a4c-80a3-4cf1-b121-2108932b34d4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:07.624461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 142/295] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:07.630097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd43ef-5277-4033-b6af-42c9731d4e01 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:07.630404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd43ef-5277-4033-b6af-42c9731d4e01 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:07.630668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd43ef-5277-4033-b6af-42c9731d4e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:07.649508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b9cd43ef-5277-4033-b6af-42c9731d4e01 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:07.650735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b9cd43ef-5277-4033-b6af-42c9731d4e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:07.706889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1282-f447-4b13-8b98-826957898407 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:07.707196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1282-f447-4b13-8b98-826957898407 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:07.707467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1282-f447-4b13-8b98-826957898407 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:07.712061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 143/296] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:07.715887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f820-e367-4803-9f51-16826a47ffc4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:07.716301 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f820-e367-4803-9f51-16826a47ffc4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:07.716683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f820-e367-4803-9f51-16826a47ffc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:07.732196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:07.741270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 154/297] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:07.755322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-30d3f820-e367-4803-9f51-16826a47ffc4 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:07.756592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-30d3f820-e367-4803-9f51-16826a47ffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:07.765560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd43ef-5277-4033-b6af-42c9731d4e01 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:07.795223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:07.843983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 144/298] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:07.870640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3f820-e367-4803-9f51-16826a47ffc4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:07.886280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd43ef-5277-4033-b6af-42c9731d4e01 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:07.931460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ccacd-223c-4e65-beba-e711480bbfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:07.933092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ccacd-223c-4e65-beba-e711480bbfbe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:07.933576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ccacd-223c-4e65-beba-e711480bbfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:07.934044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ccacd-223c-4e65-beba-e711480bbfbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:07.935487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ccacd-223c-4e65-beba-e711480bbfbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:07.938335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ccacd-223c-4e65-beba-e711480bbfbe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:07.939993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 155/299] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:07.941304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160702e9-4b34-4b16-a80c-79ce9bd27102 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:07.941602 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160702e9-4b34-4b16-a80c-79ce9bd27102 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:07.941878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160702e9-4b34-4b16-a80c-79ce9bd27102 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:07.943260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 156/300] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:07.948627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160702e9-4b34-4b16-a80c-79ce9bd27102 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:08.002766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3f820-e367-4803-9f51-16826a47ffc4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:08.041182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2159e1e-cf86-44e6-b067-96e86be33a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:08.041925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2159e1e-cf86-44e6-b067-96e86be33a42 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.042280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2159e1e-cf86-44e6-b067-96e86be33a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.042580 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2159e1e-cf86-44e6-b067-96e86be33a42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.044561 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:08.054273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2159e1e-cf86-44e6-b067-96e86be33a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:08.055869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-e2159e1e-cf86-44e6-b067-96e86be33a42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:08.062136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:08.063077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:08.063861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 145/301] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:08.065361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bf13b-d7c8-4ade-af7d-22840febcb29 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.065361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bf13b-d7c8-4ade-af7d-22840febcb29 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.065361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bf13b-d7c8-4ade-af7d-22840febcb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.079060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160702e9-4b34-4b16-a80c-79ce9bd27102 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:08.082315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-576bf13b-d7c8-4ade-af7d-22840febcb29 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:08.083508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-576bf13b-d7c8-4ade-af7d-22840febcb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:08.121751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128e00-aafd-4ec8-a35a-1896a9af843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:08.122776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128e00-aafd-4ec8-a35a-1896a9af843b None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.123257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128e00-aafd-4ec8-a35a-1896a9af843b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.123540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128e00-aafd-4ec8-a35a-1896a9af843b None admin] PATH_INFO: `/v3/groups` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.124285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60128e00-aafd-4ec8-a35a-1896a9af843b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:08.125740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60128e00-aafd-4ec8-a35a-1896a9af843b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:08.143380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 157/302] 10.222.0.66 () {60 vars in 1134 bytes} [Wed Jun 22 12:10:07 2022] POST /identity/v3/groups => generated 229 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:10:08.144270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128e00-aafd-4ec8-a35a-1896a9af843b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:08.168617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 146/303] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:08.191056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bf13b-d7c8-4ade-af7d-22840febcb29 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:08.282173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128e00-aafd-4ec8-a35a-1896a9af843b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:08.309745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bf13b-d7c8-4ade-af7d-22840febcb29 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:08.325405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773a0a7-2812-4309-9a39-eca7e6dae1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:08.326088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773a0a7-2812-4309-9a39-eca7e6dae1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.326375 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773a0a7-2812-4309-9a39-eca7e6dae1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.326654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773a0a7-2812-4309-9a39-eca7e6dae1c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.327415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773a0a7-2812-4309-9a39-eca7e6dae1c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:08.327726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773a0a7-2812-4309-9a39-eca7e6dae1c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:08.329183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773a0a7-2812-4309-9a39-eca7e6dae1c8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:08.339387 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:08.339780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 158/304] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:08.346261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773a0a7-2812-4309-9a39-eca7e6dae1c8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:08.355230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f353a-e07c-4536-af42-069cd930b63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:08.356394 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f353a-e07c-4536-af42-069cd930b63b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.356820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f353a-e07c-4536-af42-069cd930b63b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.357236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f353a-e07c-4536-af42-069cd930b63b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.357768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:08.371866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f353a-e07c-4536-af42-069cd930b63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-968f353a-e07c-4536-af42-069cd930b63b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:08.379681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:08.380808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:08.381790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 147/305] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:08.389178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f353a-e07c-4536-af42-069cd930b63b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:08.495440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773a0a7-2812-4309-9a39-eca7e6dae1c8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:08.510031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f353a-e07c-4536-af42-069cd930b63b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:08.542260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14f801-9d15-4f82-9c39-04cae66e6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:08.543606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14f801-9d15-4f82-9c39-04cae66e6ffd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.544204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14f801-9d15-4f82-9c39-04cae66e6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.544813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14f801-9d15-4f82-9c39-04cae66e6ffd None admin] PATH_INFO: `/v3/users/4d2a0c04904140b0b0aa8dddcd4dffa1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.546543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e34e3-52eb-4c05-87e7-5ff4481a5fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:08.547410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e34e3-52eb-4c05-87e7-5ff4481a5fbb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.547654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e34e3-52eb-4c05-87e7-5ff4481a5fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.547937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e34e3-52eb-4c05-87e7-5ff4481a5fbb None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.548766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e34e3-52eb-4c05-87e7-5ff4481a5fbb None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:08.549823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e34e3-52eb-4c05-87e7-5ff4481a5fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:08.550595 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e34e3-52eb-4c05-87e7-5ff4481a5fbb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:08.560747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 148/306] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:08.561996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985273e0-db04-42fa-ac7f-eeceeea71fc4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.562290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985273e0-db04-42fa-ac7f-eeceeea71fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.562571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985273e0-db04-42fa-ac7f-eeceeea71fc4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.563996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 149/307] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:08.568463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14f801-9d15-4f82-9c39-04cae66e6ffd None admin] RBAC: Authorizing `identity:get_user(user_id=4d2a0c04904140b0b0aa8dddcd4dffa1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:08.568602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985273e0-db04-42fa-ac7f-eeceeea71fc4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:08.569966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14f801-9d15-4f82-9c39-04cae66e6ffd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:08.572081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 159/308] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:08 2022] GET /identity/v3/users/4d2a0c04904140b0b0aa8dddcd4dffa1 => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:08.573387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd178-53a7-4e3d-852e-4502ee35a4f9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.573676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd178-53a7-4e3d-852e-4502ee35a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.574095 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd178-53a7-4e3d-852e-4502ee35a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.595426 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-36edd178-53a7-4e3d-852e-4502ee35a4f9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:08.596818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-36edd178-53a7-4e3d-852e-4502ee35a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:08.626450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:08.662763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:08.671429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 160/309] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:08.672105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edd178-53a7-4e3d-852e-4502ee35a4f9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:08.700240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985273e0-db04-42fa-ac7f-eeceeea71fc4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:08.735362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a691b86-46f2-493e-b81f-e9654ff94665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:08.736262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a691b86-46f2-493e-b81f-e9654ff94665 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.736545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a691b86-46f2-493e-b81f-e9654ff94665 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.736825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a691b86-46f2-493e-b81f-e9654ff94665 None admin] PATH_INFO: `/v3/users/f43f5f85c2a5481089c942df5a3f27a9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.738055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a691b86-46f2-493e-b81f-e9654ff94665 None admin] RBAC: Authorizing `identity:get_user(user_id=f43f5f85c2a5481089c942df5a3f27a9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:08.739549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a691b86-46f2-493e-b81f-e9654ff94665 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:08.745656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 150/310] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:08 2022] GET /identity/v3/users/f43f5f85c2a5481089c942df5a3f27a9 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:08.745656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a691b86-46f2-493e-b81f-e9654ff94665 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:08.788890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edd178-53a7-4e3d-852e-4502ee35a4f9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:08.828401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b6c8f-2b76-4ca0-b3cc-ef4761e5cc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:08.828987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b6c8f-2b76-4ca0-b3cc-ef4761e5cc92 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.829674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b6c8f-2b76-4ca0-b3cc-ef4761e5cc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.829674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b6c8f-2b76-4ca0-b3cc-ef4761e5cc92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.830363 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b6c8f-2b76-4ca0-b3cc-ef4761e5cc92 None admin] RBAC: Adding query filter params (role.id=0473bb110e5b46a28efa9ef9abc7659b, user.id=4d2a0c04904140b0b0aa8dddcd4dffa1, scope.system=all) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:08.830682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b6c8f-2b76-4ca0-b3cc-ef4761e5cc92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:08.832172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b6c8f-2b76-4ca0-b3cc-ef4761e5cc92 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:08.837567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 161/311] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Jun 22 12:10:08 2022] GET /identity/v3/role_assignments?user.id=4d2a0c04904140b0b0aa8dddcd4dffa1&scope.system=all&role.id=0473bb110e5b46a28efa9ef9abc7659b => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:08.838338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b6c8f-2b76-4ca0-b3cc-ef4761e5cc92 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:08.874973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a691b86-46f2-493e-b81f-e9654ff94665 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:08.896444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:08.926758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:08.926993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaeb5e-0f1f-4874-9968-f736bb1baae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:08.928862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaeb5e-0f1f-4874-9968-f736bb1baae0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:08.929165 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaeb5e-0f1f-4874-9968-f736bb1baae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:08.929449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaeb5e-0f1f-4874-9968-f736bb1baae0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:08.947046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcaeb5e-0f1f-4874-9968-f736bb1baae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-7bcaeb5e-0f1f-4874-9968-f736bb1baae0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:08.958832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:08.959805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:08.960632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 151/312] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:08.967581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaeb5e-0f1f-4874-9968-f736bb1baae0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:08.986829 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b6c8f-2b76-4ca0-b3cc-ef4761e5cc92 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:09.029444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403df3f-e1a4-42b1-8682-43badcd70308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:09.030317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403df3f-e1a4-42b1-8682-43badcd70308 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:09.030604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403df3f-e1a4-42b1-8682-43badcd70308 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:09.030883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403df3f-e1a4-42b1-8682-43badcd70308 None admin] PATH_INFO: `/v3/system/users/f43f5f85c2a5481089c942df5a3f27a9/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:09.032692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403df3f-e1a4-42b1-8682-43badcd70308 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f43f5f85c2a5481089c942df5a3f27a9, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:09.034090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403df3f-e1a4-42b1-8682-43badcd70308 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:09.052049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 162/313] 10.222.0.66 () {58 vars in 1334 bytes} [Wed Jun 22 12:10:08 2022] PUT /identity/v3/system/users/f43f5f85c2a5481089c942df5a3f27a9/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:09.099192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaeb5e-0f1f-4874-9968-f736bb1baae0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:09.139179 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56560781-22e8-4c48-8438-10f845e10567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:09.139859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56560781-22e8-4c48-8438-10f845e10567 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:09.140439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56560781-22e8-4c48-8438-10f845e10567 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:09.140726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56560781-22e8-4c48-8438-10f845e10567 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:09.141490 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56560781-22e8-4c48-8438-10f845e10567 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:09.141804 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56560781-22e8-4c48-8438-10f845e10567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:09.143209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56560781-22e8-4c48-8438-10f845e10567 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:09.153687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 152/314] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:09.159275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403df3f-e1a4-42b1-8682-43badcd70308 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:09.268364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403df3f-e1a4-42b1-8682-43badcd70308 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:09.293666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:09.307398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bba529-8fa8-4927-b890-378f8d502888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:09.308316 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bba529-8fa8-4927-b890-378f8d502888 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:09.308649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bba529-8fa8-4927-b890-378f8d502888 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:09.308932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bba529-8fa8-4927-b890-378f8d502888 None admin] PATH_INFO: `/v3/users/5952ce6cc77446679b6abe9499ed9b32` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:09.310165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bba529-8fa8-4927-b890-378f8d502888 None admin] RBAC: Authorizing `identity:get_user(user_id=5952ce6cc77446679b6abe9499ed9b32)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:09.311628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bba529-8fa8-4927-b890-378f8d502888 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:09.313308 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 163/315] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:09 2022] GET /identity/v3/users/5952ce6cc77446679b6abe9499ed9b32 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:09.318805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56560781-22e8-4c48-8438-10f845e10567 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:09.359266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:09.435045 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56560781-22e8-4c48-8438-10f845e10567 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:09.471865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86796-ec02-421f-b3a9-d12e61adc3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:09.472923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86796-ec02-421f-b3a9-d12e61adc3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:09.473446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86796-ec02-421f-b3a9-d12e61adc3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:09.473925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86796-ec02-421f-b3a9-d12e61adc3a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:09.545135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f86796-ec02-421f-b3a9-d12e61adc3a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:09.546933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f86796-ec02-421f-b3a9-d12e61adc3a5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:09.582470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:09.652241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 153/316] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:09.658338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bba529-8fa8-4927-b890-378f8d502888 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:09.770581 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bba529-8fa8-4927-b890-378f8d502888 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:09.805345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50e55-6625-411c-8aee-177493dd17aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:09.808798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50e55-6625-411c-8aee-177493dd17aa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:09.808798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50e55-6625-411c-8aee-177493dd17aa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:09.808798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50e55-6625-411c-8aee-177493dd17aa None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:09.808798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac50e55-6625-411c-8aee-177493dd17aa None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:09.809433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac50e55-6625-411c-8aee-177493dd17aa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:09.815841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 164/317] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:09 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:09.817475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86796-ec02-421f-b3a9-d12e61adc3a5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:09.923943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86796-ec02-421f-b3a9-d12e61adc3a5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:09.963517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c4509-8f5d-4a9e-8a75-bf5317c2ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:09.964561 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4509-8f5d-4a9e-8a75-bf5317c2ccbc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:09.964850 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4509-8f5d-4a9e-8a75-bf5317c2ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:09.965133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4509-8f5d-4a9e-8a75-bf5317c2ccbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:09.965990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c4509-8f5d-4a9e-8a75-bf5317c2ccbc None admin] RBAC: Adding query filter params (role.id=0473bb110e5b46a28efa9ef9abc7659b, scope.project.id=aa8cd07280d947a396d40811bab95347, user.id=5952ce6cc77446679b6abe9499ed9b32) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:09.966304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c4509-8f5d-4a9e-8a75-bf5317c2ccbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:09.968043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c4509-8f5d-4a9e-8a75-bf5317c2ccbc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:09.974760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 154/318] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:09 2022] GET /identity/v3/role_assignments?user.id=5952ce6cc77446679b6abe9499ed9b32&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=0473bb110e5b46a28efa9ef9abc7659b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:09.976363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:10.294413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7c82-5649-4a8c-894f-7662264eedf5 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:10.294618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7c82-5649-4a8c-894f-7662264eedf5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:10.294899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7c82-5649-4a8c-894f-7662264eedf5 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:10.296317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 165/319] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:10.303347 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db39e22-075e-4e0d-ac81-d549e0162a32 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:10.303823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db39e22-075e-4e0d-ac81-d549e0162a32 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:10.304270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db39e22-075e-4e0d-ac81-d549e0162a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:10.324448 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7db39e22-075e-4e0d-ac81-d549e0162a32 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:10.325645 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7db39e22-075e-4e0d-ac81-d549e0162a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:10.398868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 155/320] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:10.422312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa7c82-5649-4a8c-894f-7662264eedf5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:10.485734 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:10.533276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa7c82-5649-4a8c-894f-7662264eedf5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:10.568156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a0f8c-b3e8-4688-b87a-d9a3296d503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:10.568884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0f8c-b3e8-4688-b87a-d9a3296d503d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:10.569170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0f8c-b3e8-4688-b87a-d9a3296d503d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:10.569449 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0f8c-b3e8-4688-b87a-d9a3296d503d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:10.571148 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a0f8c-b3e8-4688-b87a-d9a3296d503d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:10.572640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a0f8c-b3e8-4688-b87a-d9a3296d503d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:10.574448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 166/321] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:10.579890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db39e22-075e-4e0d-ac81-d549e0162a32 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:10.686734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db39e22-075e-4e0d-ac81-d549e0162a32 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:10.717756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:10.724826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f4d1b-03e5-476d-aee7-b763aae32e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:10.725504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f4d1b-03e5-476d-aee7-b763aae32e44 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:10.725791 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f4d1b-03e5-476d-aee7-b763aae32e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:10.726071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f4d1b-03e5-476d-aee7-b763aae32e44 None admin] PATH_INFO: `/v3/groups` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:10.727347 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f4d1b-03e5-476d-aee7-b763aae32e44 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:10.728826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f4d1b-03e5-476d-aee7-b763aae32e44 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:10.745192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 156/322] 10.222.0.66 () {60 vars in 1134 bytes} [Wed Jun 22 12:10:10 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:10:11.011944 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5f67b-cc83-4603-81b8-d04e295814ec None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:11.012461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5f67b-cc83-4603-81b8-d04e295814ec None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:11.012565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5f67b-cc83-4603-81b8-d04e295814ec None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:11.014264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 167/323] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:11.019983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc09c7-6bec-40a8-bfb5-bf0f1f9a6b9e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:11.020330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc09c7-6bec-40a8-bfb5-bf0f1f9a6b9e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:11.020585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc09c7-6bec-40a8-bfb5-bf0f1f9a6b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:11.040607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d5fc09c7-6bec-40a8-bfb5-bf0f1f9a6b9e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:11.041831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d5fc09c7-6bec-40a8-bfb5-bf0f1f9a6b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:11.117574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 157/324] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:11.141075 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5f67b-cc83-4603-81b8-d04e295814ec None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:11.219866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e2f4-cb49-43b6-837f-7bd7389a8089 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:11.220221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e2f4-cb49-43b6-837f-7bd7389a8089 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:11.220544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e2f4-cb49-43b6-837f-7bd7389a8089 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:11.223838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 158/325] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:11.228729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537a846-a39e-46c4-bc07-a6bd34513a64 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:11.229022 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537a846-a39e-46c4-bc07-a6bd34513a64 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:11.229305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537a846-a39e-46c4-bc07-a6bd34513a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:11.249090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9537a846-a39e-46c4-bc07-a6bd34513a64 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:11.250371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9537a846-a39e-46c4-bc07-a6bd34513a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:11.275165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5f67b-cc83-4603-81b8-d04e295814ec None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:11.306890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:11.325145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c0d1a-4062-4236-bfa1-02af8b911be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:11.325966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c0d1a-4062-4236-bfa1-02af8b911be9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:11.326265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c0d1a-4062-4236-bfa1-02af8b911be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:11.326535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c0d1a-4062-4236-bfa1-02af8b911be9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:11.339405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 159/326] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:11.340696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c0d1a-4062-4236-bfa1-02af8b911be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0a1c0d1a-4062-4236-bfa1-02af8b911be9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:11.348926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:11.350050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:11.350893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:11.353716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 168/327] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:11.361562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537a846-a39e-46c4-bc07-a6bd34513a64 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:11.369591 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c0d1a-4062-4236-bfa1-02af8b911be9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:11.432402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:11.493330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537a846-a39e-46c4-bc07-a6bd34513a64 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:11.501112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c0d1a-4062-4236-bfa1-02af8b911be9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:11.541425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06a75-40f5-4c56-8530-94c1d069f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:11.542105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06a75-40f5-4c56-8530-94c1d069f60f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:11.542391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06a75-40f5-4c56-8530-94c1d069f60f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:11.542669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06a75-40f5-4c56-8530-94c1d069f60f None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:11.543438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06a75-40f5-4c56-8530-94c1d069f60f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:11.543750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06a75-40f5-4c56-8530-94c1d069f60f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:11.546094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06a75-40f5-4c56-8530-94c1d069f60f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:11.546524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1c3a-3907-4b6c-9b6b-af6fb50746a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:11.547334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1c3a-3907-4b6c-9b6b-af6fb50746a8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:11.547834 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1c3a-3907-4b6c-9b6b-af6fb50746a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:11.548147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1c3a-3907-4b6c-9b6b-af6fb50746a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:11.560464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 160/328] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:11.561435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06a75-40f5-4c56-8530-94c1d069f60f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:11.561876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a1c3a-3907-4b6c-9b6b-af6fb50746a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f42a1c3a-3907-4b6c-9b6b-af6fb50746a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:11.570964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:11.571886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:11.572703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:11.573811 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 169/329] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:11.579616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1c3a-3907-4b6c-9b6b-af6fb50746a8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:11.648130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:11.697192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06a75-40f5-4c56-8530-94c1d069f60f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:11.715229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:11.733340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1c3a-3907-4b6c-9b6b-af6fb50746a8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:11.774913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a37783-e972-49c2-ad78-8357dd60bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:11.775599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a37783-e972-49c2-ad78-8357dd60bfec None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:11.775881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a37783-e972-49c2-ad78-8357dd60bfec None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:11.776209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a37783-e972-49c2-ad78-8357dd60bfec None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:11.776971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a37783-e972-49c2-ad78-8357dd60bfec None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:11.777303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a37783-e972-49c2-ad78-8357dd60bfec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:11.778740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a37783-e972-49c2-ad78-8357dd60bfec None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:11.779720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba07e34-340d-437d-817f-a13c286ea5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:11.781043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba07e34-340d-437d-817f-a13c286ea5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:11.781543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba07e34-340d-437d-817f-a13c286ea5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:11.782002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba07e34-340d-437d-817f-a13c286ea5e7 None admin] PATH_INFO: `/v3/users/4d2a0c04904140b0b0aa8dddcd4dffa1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:11.786618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba07e34-340d-437d-817f-a13c286ea5e7 None admin] RBAC: Authorizing `identity:get_user(user_id=4d2a0c04904140b0b0aa8dddcd4dffa1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:11.788144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba07e34-340d-437d-817f-a13c286ea5e7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:11.790965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 170/331] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:11.795711 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 161/331] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:11 2022] GET /identity/v3/users/4d2a0c04904140b0b0aa8dddcd4dffa1 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:11.796996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a37783-e972-49c2-ad78-8357dd60bfec None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:11.801350 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba07e34-340d-437d-817f-a13c286ea5e7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:11.942740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba07e34-340d-437d-817f-a13c286ea5e7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:11.985963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a37783-e972-49c2-ad78-8357dd60bfec None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:12.020466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:12.027111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3039a-3aa3-4a16-9131-59997d886b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:12.027995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3039a-3aa3-4a16-9131-59997d886b29 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:12.028323 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3039a-3aa3-4a16-9131-59997d886b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:12.028607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3039a-3aa3-4a16-9131-59997d886b29 None admin] PATH_INFO: `/v3/system/users/4d2a0c04904140b0b0aa8dddcd4dffa1/roles/0473bb110e5b46a28efa9ef9abc7659b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:12.030246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3039a-3aa3-4a16-9131-59997d886b29 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4d2a0c04904140b0b0aa8dddcd4dffa1, role_id=0473bb110e5b46a28efa9ef9abc7659b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:12.031111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130eb69-0596-47ff-800f-3fba40107015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:12.031656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3039a-3aa3-4a16-9131-59997d886b29 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:12.032498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130eb69-0596-47ff-800f-3fba40107015 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:12.032985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130eb69-0596-47ff-800f-3fba40107015 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:12.033443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130eb69-0596-47ff-800f-3fba40107015 None admin] PATH_INFO: `/v3/users/f43f5f85c2a5481089c942df5a3f27a9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:12.040818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130eb69-0596-47ff-800f-3fba40107015 None admin] RBAC: Authorizing `identity:get_user(user_id=f43f5f85c2a5481089c942df5a3f27a9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:12.042093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 171/332] 10.222.0.66 () {58 vars in 1334 bytes} [Wed Jun 22 12:10:11 2022] PUT /identity/v3/system/users/4d2a0c04904140b0b0aa8dddcd4dffa1/roles/0473bb110e5b46a28efa9ef9abc7659b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:10:12.042873 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130eb69-0596-47ff-800f-3fba40107015 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:12.046656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 162/333] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:11 2022] GET /identity/v3/users/f43f5f85c2a5481089c942df5a3f27a9 => generated 293 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:12.051097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3039a-3aa3-4a16-9131-59997d886b29 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:12.166708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3039a-3aa3-4a16-9131-59997d886b29 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:12.208109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399298ab-d4e3-46b1-b7b9-e42bfac64453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:12.209152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399298ab-d4e3-46b1-b7b9-e42bfac64453 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:12.209647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399298ab-d4e3-46b1-b7b9-e42bfac64453 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:12.210130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399298ab-d4e3-46b1-b7b9-e42bfac64453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:12.211786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399298ab-d4e3-46b1-b7b9-e42bfac64453 None admin] RBAC: Adding query filter params (role.id=dda86b29d55a42c48f50fdd9fc4d5b61, user.id=f43f5f85c2a5481089c942df5a3f27a9, scope.system=all) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:12.212355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399298ab-d4e3-46b1-b7b9-e42bfac64453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:12.214119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399298ab-d4e3-46b1-b7b9-e42bfac64453 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:12.228378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 172/334] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Jun 22 12:10:12 2022] GET /identity/v3/role_assignments?user.id=f43f5f85c2a5481089c942df5a3f27a9&scope.system=all&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:13.644336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39417389-2dde-4786-87e9-27a402785051 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:13.644823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39417389-2dde-4786-87e9-27a402785051 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:13.644823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39417389-2dde-4786-87e9-27a402785051 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:13.646586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 163/335] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:13.654756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f5b79-3c9f-472c-9c84-cd1ad72f076e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:13.655193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f5b79-3c9f-472c-9c84-cd1ad72f076e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:13.655371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f5b79-3c9f-472c-9c84-cd1ad72f076e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:13.656986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 173/336] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:13.660388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b867003-f512-468e-9e60-66d0bbac7f90 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:13.660683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b867003-f512-468e-9e60-66d0bbac7f90 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:13.660971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b867003-f512-468e-9e60-66d0bbac7f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:13.680979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2b867003-f512-468e-9e60-66d0bbac7f90 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:13.682187 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2b867003-f512-468e-9e60-66d0bbac7f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:13.685836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc940b6-f8f2-421e-a87f-8d158e1ad392 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:13.686129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc940b6-f8f2-421e-a87f-8d158e1ad392 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:13.686412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc940b6-f8f2-421e-a87f-8d158e1ad392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:13.713183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-abc940b6-f8f2-421e-a87f-8d158e1ad392 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:13.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-abc940b6-f8f2-421e-a87f-8d158e1ad392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:13.764045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:13.784508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:13.822582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 164/337] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:13.837699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 174/338] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:13.853919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b867003-f512-468e-9e60-66d0bbac7f90 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:13.880946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc940b6-f8f2-421e-a87f-8d158e1ad392 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:14.038729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b867003-f512-468e-9e60-66d0bbac7f90 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:14.106765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaf56a-eeeb-4982-b1dc-a393af1a5d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:14.107972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaf56a-eeeb-4982-b1dc-a393af1a5d19 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:14.108480 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc940b6-f8f2-421e-a87f-8d158e1ad392 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:14.108619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaf56a-eeeb-4982-b1dc-a393af1a5d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:14.108953 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaf56a-eeeb-4982-b1dc-a393af1a5d19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:14.133158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbaf56a-eeeb-4982-b1dc-a393af1a5d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-fdbaf56a-eeeb-4982-b1dc-a393af1a5d19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:14.148043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:14.149015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:14.149801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:14.152615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 165/339] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:10:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:14.157990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaf56a-eeeb-4982-b1dc-a393af1a5d19 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:14.180864 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c3e18-7ddc-4157-9c6e-0e8ff116250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:14.181676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3e18-7ddc-4157-9c6e-0e8ff116250b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:14.181965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3e18-7ddc-4157-9c6e-0e8ff116250b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:14.182249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3e18-7ddc-4157-9c6e-0e8ff116250b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:14.205445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c3e18-7ddc-4157-9c6e-0e8ff116250b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-522c3e18-7ddc-4157-9c6e-0e8ff116250b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:14.221696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:14.222637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:14.223409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 175/340] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:14.229228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c3e18-7ddc-4157-9c6e-0e8ff116250b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:14.235547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:14.283540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:14.367107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c3e18-7ddc-4157-9c6e-0e8ff116250b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:14.382896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaf56a-eeeb-4982-b1dc-a393af1a5d19 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:14.419638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988a8a4-b2e8-42f6-817b-f7c1e9b092fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:14.420350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988a8a4-b2e8-42f6-817b-f7c1e9b092fa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:14.420638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988a8a4-b2e8-42f6-817b-f7c1e9b092fa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:14.420919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988a8a4-b2e8-42f6-817b-f7c1e9b092fa None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:14.421684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988a8a4-b2e8-42f6-817b-f7c1e9b092fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:14.421999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988a8a4-b2e8-42f6-817b-f7c1e9b092fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:14.423389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988a8a4-b2e8-42f6-817b-f7c1e9b092fa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:14.436971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 176/341] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:14.437921 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eddb94-e44b-476a-9cef-4e37f1728931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:14.438816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eddb94-e44b-476a-9cef-4e37f1728931 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:14.439331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eddb94-e44b-476a-9cef-4e37f1728931 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:14.439796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eddb94-e44b-476a-9cef-4e37f1728931 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:14.440768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eddb94-e44b-476a-9cef-4e37f1728931 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:14.441271 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eddb94-e44b-476a-9cef-4e37f1728931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:14.442088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988a8a4-b2e8-42f6-817b-f7c1e9b092fa None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:14.443074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eddb94-e44b-476a-9cef-4e37f1728931 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:14.456721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 166/342] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:14.462282 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eddb94-e44b-476a-9cef-4e37f1728931 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:14.584387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:14.598926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988a8a4-b2e8-42f6-817b-f7c1e9b092fa None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:14.626960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eddb94-e44b-476a-9cef-4e37f1728931 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:14.640043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:14.651219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde25fe8-111b-4950-8df9-5004bf813ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:14.651219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde25fe8-111b-4950-8df9-5004bf813ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:14.651219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde25fe8-111b-4950-8df9-5004bf813ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:14.651219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde25fe8-111b-4950-8df9-5004bf813ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:14.686832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6ae5d-7a60-4a13-9d4c-a497299f3c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:14.688203 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ae5d-7a60-4a13-9d4c-a497299f3c99 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:14.688704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ae5d-7a60-4a13-9d4c-a497299f3c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:14.689176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ae5d-7a60-4a13-9d4c-a497299f3c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:14.749684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde25fe8-111b-4950-8df9-5004bf813ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:14.751172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde25fe8-111b-4950-8df9-5004bf813ee1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:14.799998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6ae5d-7a60-4a13-9d4c-a497299f3c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:14.801837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6ae5d-7a60-4a13-9d4c-a497299f3c99 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:14.868439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:14.880719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 177/343] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 12:10:14.887591 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde25fe8-111b-4950-8df9-5004bf813ee1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:14.957537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 167/344] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:14.959229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fafc13-f363-4558-9546-f40fffb0d257 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:14.959710 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fafc13-f363-4558-9546-f40fffb0d257 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:14.960445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fafc13-f363-4558-9546-f40fffb0d257 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:14.962029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 168/345] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:14.966389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:14.967549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fafc13-f363-4558-9546-f40fffb0d257 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:15.080580 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fafc13-f363-4558-9546-f40fffb0d257 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:15.116569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f9a90-8033-4ee4-b42a-650f09afb262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:15.118311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9a90-8033-4ee4-b42a-650f09afb262 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.118808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9a90-8033-4ee4-b42a-650f09afb262 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.119275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9a90-8033-4ee4-b42a-650f09afb262 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.120775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f9a90-8033-4ee4-b42a-650f09afb262 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:15.122422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f9a90-8033-4ee4-b42a-650f09afb262 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:15.129931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 169/346] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:14 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:15.131718 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d1983-5015-4809-869f-690f94d6e505 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.132275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d1983-5015-4809-869f-690f94d6e505 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.133304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d1983-5015-4809-869f-690f94d6e505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.134464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde25fe8-111b-4950-8df9-5004bf813ee1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:15.151382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cb2d1983-5015-4809-869f-690f94d6e505 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:15.152954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cb2d1983-5015-4809-869f-690f94d6e505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:15.200072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe13ca-762c-4e17-a3a8-85ad2edb117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:15.202800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe13ca-762c-4e17-a3a8-85ad2edb117e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.204354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe13ca-762c-4e17-a3a8-85ad2edb117e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.204850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe13ca-762c-4e17-a3a8-85ad2edb117e None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.211504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe13ca-762c-4e17-a3a8-85ad2edb117e None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:15.213359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe13ca-762c-4e17-a3a8-85ad2edb117e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:15.215315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 178/347] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:14 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:15.219888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe13ca-762c-4e17-a3a8-85ad2edb117e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:15.260384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:15.266994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 170/348] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:15.267848 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d1983-5015-4809-869f-690f94d6e505 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:15.316493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:15.373999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe13ca-762c-4e17-a3a8-85ad2edb117e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:15.419784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9081d98-1a83-452a-ab89-1dd32dc2b2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:15.420722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9081d98-1a83-452a-ab89-1dd32dc2b2dc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.421368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9081d98-1a83-452a-ab89-1dd32dc2b2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.421647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9081d98-1a83-452a-ab89-1dd32dc2b2dc None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.423992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d1983-5015-4809-869f-690f94d6e505 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:15.437370 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9081d98-1a83-452a-ab89-1dd32dc2b2dc None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:15.439208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9081d98-1a83-452a-ab89-1dd32dc2b2dc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:15.446087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 179/349] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:15 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:15.446087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9081d98-1a83-452a-ab89-1dd32dc2b2dc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:15.471475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c5c50-ecb7-4324-b395-51609c5a4599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:15.473184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c5c50-ecb7-4324-b395-51609c5a4599 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.473585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c5c50-ecb7-4324-b395-51609c5a4599 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.473986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c5c50-ecb7-4324-b395-51609c5a4599 None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.475381 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c5c50-ecb7-4324-b395-51609c5a4599 None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:15.477144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c5c50-ecb7-4324-b395-51609c5a4599 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:15.480602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 171/350] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:15 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:15.482155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b8411-8568-44ea-873e-3ce8f2cde662 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.482649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b8411-8568-44ea-873e-3ce8f2cde662 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.483157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b8411-8568-44ea-873e-3ce8f2cde662 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.485078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 172/351] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:15.490067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b8411-8568-44ea-873e-3ce8f2cde662 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:15.569456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9081d98-1a83-452a-ab89-1dd32dc2b2dc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:15.577348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:15.608405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:15.617793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b8f29-7c8a-41fc-984f-1deb45f22917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:15.618952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b8f29-7c8a-41fc-984f-1deb45f22917 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.619246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b8f29-7c8a-41fc-984f-1deb45f22917 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.619574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b8f29-7c8a-41fc-984f-1deb45f22917 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.627650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b8411-8568-44ea-873e-3ce8f2cde662 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:15.637324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b8f29-7c8a-41fc-984f-1deb45f22917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f20b8f29-7c8a-41fc-984f-1deb45f22917 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:15.649382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:15.650350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:15.651151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 180/352] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:15.652593 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b8f29-7c8a-41fc-984f-1deb45f22917 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:15.684635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c73ebc-5976-4a6c-9308-54b2f649e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:15.685351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c73ebc-5976-4a6c-9308-54b2f649e641 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.685638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c73ebc-5976-4a6c-9308-54b2f649e641 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.685912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c73ebc-5976-4a6c-9308-54b2f649e641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.686758 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c73ebc-5976-4a6c-9308-54b2f649e641 None admin] RBAC: Adding query filter params (group.id=bd211322099f4c489d0ec86af16f0f1b, role.id=0ec7b267a5724203a4845cf7da3a6ab8, scope.project.id=fa0ac34fcb3543da82900c7dad597219) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:15.687071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c73ebc-5976-4a6c-9308-54b2f649e641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:15.688552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c73ebc-5976-4a6c-9308-54b2f649e641 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:15.700140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 173/353] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 12:10:15 2022] GET /identity/v3/role_assignments?group.id=bd211322099f4c489d0ec86af16f0f1b&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=0ec7b267a5724203a4845cf7da3a6ab8 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:15.700140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2312d9-c9f4-4e13-b0e6-fa7b7ff5426a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.700140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2312d9-c9f4-4e13-b0e6-fa7b7ff5426a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.700140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2312d9-c9f4-4e13-b0e6-fa7b7ff5426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.717132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fe2312d9-c9f4-4e13-b0e6-fa7b7ff5426a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:15.718433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fe2312d9-c9f4-4e13-b0e6-fa7b7ff5426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:15.816527 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 174/354] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:15.822115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19e05-9b09-4d8c-857b-8952942b43fa None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.822407 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19e05-9b09-4d8c-857b-8952942b43fa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.822694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed19e05-9b09-4d8c-857b-8952942b43fa None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.824302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 175/355] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:15.824989 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed19e05-9b09-4d8c-857b-8952942b43fa None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:15.831550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b8f29-7c8a-41fc-984f-1deb45f22917 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:15.877205 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda13f90-6eef-41e6-875f-3f0eec043685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:15.878013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda13f90-6eef-41e6-875f-3f0eec043685 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.878461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda13f90-6eef-41e6-875f-3f0eec043685 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.878945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda13f90-6eef-41e6-875f-3f0eec043685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.879931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda13f90-6eef-41e6-875f-3f0eec043685 None admin] RBAC: Adding query filter params (group.id=bd211322099f4c489d0ec86af16f0f1b, role.id=dda86b29d55a42c48f50fdd9fc4d5b61, scope.project.id=fa0ac34fcb3543da82900c7dad597219) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:15.880441 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda13f90-6eef-41e6-875f-3f0eec043685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:15.882325 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda13f90-6eef-41e6-875f-3f0eec043685 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:15.888935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 181/356] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 12:10:15 2022] GET /identity/v3/role_assignments?group.id=bd211322099f4c489d0ec86af16f0f1b&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:15.890712 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c10f-3d2c-4fb9-b986-4df74fc63048 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:15.891138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c10f-3d2c-4fb9-b986-4df74fc63048 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:15.891589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c10f-3d2c-4fb9-b986-4df74fc63048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:15.911253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5047c10f-3d2c-4fb9-b986-4df74fc63048 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:15.913019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5047c10f-3d2c-4fb9-b986-4df74fc63048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:15.926924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:15.972224 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:16.000264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 182/357] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:16.001191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c10f-3d2c-4fb9-b986-4df74fc63048 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:16.007127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed19e05-9b09-4d8c-857b-8952942b43fa None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:16.051123 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cddbb-7275-4f4c-b7e0-498290dca9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:16.052291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cddbb-7275-4f4c-b7e0-498290dca9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:16.052797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cddbb-7275-4f4c-b7e0-498290dca9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:16.053267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cddbb-7275-4f4c-b7e0-498290dca9d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:16.054246 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cddbb-7275-4f4c-b7e0-498290dca9d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:16.055277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cddbb-7275-4f4c-b7e0-498290dca9d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:16.057169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cddbb-7275-4f4c-b7e0-498290dca9d4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:16.067595 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 176/358] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:16.069489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c104e-e519-41e8-afc1-b73c07e0881a None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:16.069969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c104e-e519-41e8-afc1-b73c07e0881a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:16.070515 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c104e-e519-41e8-afc1-b73c07e0881a None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:16.074256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 177/359] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:16.075494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c104e-e519-41e8-afc1-b73c07e0881a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:16.156956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c10f-3d2c-4fb9-b986-4df74fc63048 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:16.194587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9f269-3b0f-4a1a-83f4-7db12cc0ffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:16.194801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c104e-e519-41e8-afc1-b73c07e0881a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:16.196386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f269-3b0f-4a1a-83f4-7db12cc0ffd3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:16.196914 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f269-3b0f-4a1a-83f4-7db12cc0ffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:16.197362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f269-3b0f-4a1a-83f4-7db12cc0ffd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:16.209233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9f269-3b0f-4a1a-83f4-7db12cc0ffd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-aad9f269-3b0f-4a1a-83f4-7db12cc0ffd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:16.218727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:16.219850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:16.220873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:16.222313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:16.224218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 183/360] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:10:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:16.225664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d913ae-9b53-4f60-94eb-baf9d222dac6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:16.226097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d913ae-9b53-4f60-94eb-baf9d222dac6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:16.226597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d913ae-9b53-4f60-94eb-baf9d222dac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:16.244731 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09775f1d-7610-404a-a8d8-7bec1ea21986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:16.245404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09775f1d-7610-404a-a8d8-7bec1ea21986 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:16.245696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09775f1d-7610-404a-a8d8-7bec1ea21986 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:16.245980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09775f1d-7610-404a-a8d8-7bec1ea21986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:16.246342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-98d913ae-9b53-4f60-94eb-baf9d222dac6 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:16.247675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-98d913ae-9b53-4f60-94eb-baf9d222dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:16.282105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:16.336255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 184/361] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:16.337410 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d913ae-9b53-4f60-94eb-baf9d222dac6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:16.344893 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09775f1d-7610-404a-a8d8-7bec1ea21986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:16.346376 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09775f1d-7610-404a-a8d8-7bec1ea21986 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:16.480439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d913ae-9b53-4f60-94eb-baf9d222dac6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:16.502628 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 178/362] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:16.503421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09775f1d-7610-404a-a8d8-7bec1ea21986 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:16.529204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfd37f-a234-4bf5-83ad-9300468b1fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:16.530367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfd37f-a234-4bf5-83ad-9300468b1fea None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:16.530838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfd37f-a234-4bf5-83ad-9300468b1fea None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:16.531313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfd37f-a234-4bf5-83ad-9300468b1fea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:16.535173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:16.548510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfd37f-a234-4bf5-83ad-9300468b1fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-4dbfd37f-a234-4bf5-83ad-9300468b1fea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:16.563433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:16.564563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:16.565454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 185/363] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:16.566164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfd37f-a234-4bf5-83ad-9300468b1fea None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:16.598022 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:16.643642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09775f1d-7610-404a-a8d8-7bec1ea21986 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:16.684473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560b05b-ae56-4215-bd2b-a30e219f2c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:16.685334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560b05b-ae56-4215-bd2b-a30e219f2c58 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:16.685632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560b05b-ae56-4215-bd2b-a30e219f2c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:16.685918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560b05b-ae56-4215-bd2b-a30e219f2c58 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:16.686680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560b05b-ae56-4215-bd2b-a30e219f2c58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:16.687003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560b05b-ae56-4215-bd2b-a30e219f2c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:16.688420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560b05b-ae56-4215-bd2b-a30e219f2c58 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:16.701869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 179/364] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:16.701869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560b05b-ae56-4215-bd2b-a30e219f2c58 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:16.715918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfd37f-a234-4bf5-83ad-9300468b1fea None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:16.762572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26912481-32a3-4601-9a9f-06fe6ed56651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:16.764042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26912481-32a3-4601-9a9f-06fe6ed56651 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:16.765040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26912481-32a3-4601-9a9f-06fe6ed56651 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:16.765780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26912481-32a3-4601-9a9f-06fe6ed56651 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:16.782455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26912481-32a3-4601-9a9f-06fe6ed56651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-26912481-32a3-4601-9a9f-06fe6ed56651 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:16.793069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:16.794133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:16.794955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 186/365] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:10:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:16.795654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26912481-32a3-4601-9a9f-06fe6ed56651 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:16.823815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:16.851984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560b05b-ae56-4215-bd2b-a30e219f2c58 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:16.896338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655e7c9-49b3-4673-9d7e-c489fda8a99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:16.897872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655e7c9-49b3-4673-9d7e-c489fda8a99c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:16.899105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655e7c9-49b3-4673-9d7e-c489fda8a99c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:16.900006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655e7c9-49b3-4673-9d7e-c489fda8a99c None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:16.901708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655e7c9-49b3-4673-9d7e-c489fda8a99c None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:16.903677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655e7c9-49b3-4673-9d7e-c489fda8a99c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:16.906800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 180/366] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:16 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:16.907922 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655e7c9-49b3-4673-9d7e-c489fda8a99c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:16.928265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:16.953265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26912481-32a3-4601-9a9f-06fe6ed56651 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:17.001183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed297cc-aab4-49c3-9f30-e5ef85d27f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:17.001866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed297cc-aab4-49c3-9f30-e5ef85d27f86 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:17.002157 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed297cc-aab4-49c3-9f30-e5ef85d27f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:17.002438 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed297cc-aab4-49c3-9f30-e5ef85d27f86 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:17.003202 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed297cc-aab4-49c3-9f30-e5ef85d27f86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:17.003517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed297cc-aab4-49c3-9f30-e5ef85d27f86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:17.005096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed297cc-aab4-49c3-9f30-e5ef85d27f86 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:17.018921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 187/367] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:17.019757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed297cc-aab4-49c3-9f30-e5ef85d27f86 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:17.057047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655e7c9-49b3-4673-9d7e-c489fda8a99c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:17.105753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98010ea5-c51d-4864-a641-2314c5e58f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:17.106575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010ea5-c51d-4864-a641-2314c5e58f8c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:17.106868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010ea5-c51d-4864-a641-2314c5e58f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:17.107152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010ea5-c51d-4864-a641-2314c5e58f8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:17.130296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:17.149032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed297cc-aab4-49c3-9f30-e5ef85d27f86 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:17.181124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98010ea5-c51d-4864-a641-2314c5e58f8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:17.182685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98010ea5-c51d-4864-a641-2314c5e58f8c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:17.187307 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a6650-09d1-4673-98d9-a8ea234d9a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:17.188255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a6650-09d1-4673-98d9-a8ea234d9a44 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:17.188822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a6650-09d1-4673-98d9-a8ea234d9a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:17.189316 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a6650-09d1-4673-98d9-a8ea234d9a44 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:17.190309 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a6650-09d1-4673-98d9-a8ea234d9a44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:17.190822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a6650-09d1-4673-98d9-a8ea234d9a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:17.192807 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a6650-09d1-4673-98d9-a8ea234d9a44 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:17.203642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 188/368] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:17.204821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a6650-09d1-4673-98d9-a8ea234d9a44 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:17.208821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:17.300225 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 181/369] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:17.301325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98010ea5-c51d-4864-a641-2314c5e58f8c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:17.322137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a6650-09d1-4673-98d9-a8ea234d9a44 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:17.359114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:17.361245 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d0a5-15ef-4d60-a6e1-cbe6d42239a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:17.362337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d0a5-15ef-4d60-a6e1-cbe6d42239a8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:17.362629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d0a5-15ef-4d60-a6e1-cbe6d42239a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:17.362907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d0a5-15ef-4d60-a6e1-cbe6d42239a8 None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:17.364440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d0a5-15ef-4d60-a6e1-cbe6d42239a8 None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:17.366372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d0a5-15ef-4d60-a6e1-cbe6d42239a8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:17.368494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 189/370] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:17 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:17.369422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d0a5-15ef-4d60-a6e1-cbe6d42239a8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:17.411904 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98010ea5-c51d-4864-a641-2314c5e58f8c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:17.447962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dfd2e-bde2-412d-a73b-7172d007f5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:17.448880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dfd2e-bde2-412d-a73b-7172d007f5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:17.449164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dfd2e-bde2-412d-a73b-7172d007f5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:17.449445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dfd2e-bde2-412d-a73b-7172d007f5e3 None admin] PATH_INFO: `/v3/users/4d2a0c04904140b0b0aa8dddcd4dffa1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:17.450770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dfd2e-bde2-412d-a73b-7172d007f5e3 None admin] RBAC: Authorizing `identity:get_user(user_id=4d2a0c04904140b0b0aa8dddcd4dffa1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:17.452249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dfd2e-bde2-412d-a73b-7172d007f5e3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:17.452540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:17.453909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 182/371] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:10:17 2022] GET /identity/v3/users/4d2a0c04904140b0b0aa8dddcd4dffa1 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:17.454774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dfd2e-bde2-412d-a73b-7172d007f5e3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:17.491534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d0a5-15ef-4d60-a6e1-cbe6d42239a8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:17.534965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12917df-6759-4ad2-abe9-08cd22291696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:17.535726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12917df-6759-4ad2-abe9-08cd22291696 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:17.536032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12917df-6759-4ad2-abe9-08cd22291696 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:17.536369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12917df-6759-4ad2-abe9-08cd22291696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:17.566054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dfd2e-bde2-412d-a73b-7172d007f5e3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:17.588848 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:17.606329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15455724-a843-4777-92bb-15681e543b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:17.606985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455724-a843-4777-92bb-15681e543b2b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:17.607272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455724-a843-4777-92bb-15681e543b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:17.607545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15455724-a843-4777-92bb-15681e543b2b None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:17.609626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15455724-a843-4777-92bb-15681e543b2b None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:17.611089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15455724-a843-4777-92bb-15681e543b2b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:17.613990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12917df-6759-4ad2-abe9-08cd22291696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:17.615751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12917df-6759-4ad2-abe9-08cd22291696 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:17.617888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 183/372] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:17 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:17.618784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15455724-a843-4777-92bb-15681e543b2b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:17.720464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:17.726697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15455724-a843-4777-92bb-15681e543b2b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:17.729197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 190/373] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:17.731142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12917df-6759-4ad2-abe9-08cd22291696 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:17.772661 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f210c-d8e0-4569-939b-16fd02b26347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:17.773363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f210c-d8e0-4569-939b-16fd02b26347 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:17.773649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f210c-d8e0-4569-939b-16fd02b26347 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:17.773980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f210c-d8e0-4569-939b-16fd02b26347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:17.774773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f210c-d8e0-4569-939b-16fd02b26347 None admin] RBAC: Adding query filter params (group.id=bd211322099f4c489d0ec86af16f0f1b, role.id=dda86b29d55a42c48f50fdd9fc4d5b61, scope.project.id=aa8cd07280d947a396d40811bab95347) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:17.775089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f210c-d8e0-4569-939b-16fd02b26347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:17.776558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f210c-d8e0-4569-939b-16fd02b26347 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:17.784709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 184/374] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 12:10:17 2022] GET /identity/v3/role_assignments?group.id=bd211322099f4c489d0ec86af16f0f1b&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:17.785722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f210c-d8e0-4569-939b-16fd02b26347 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:17.881563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12917df-6759-4ad2-abe9-08cd22291696 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:17.911359 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:17.932343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da8b9-f100-482d-936d-d15b472c1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:17.933767 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da8b9-f100-482d-936d-d15b472c1f0a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:17.934412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da8b9-f100-482d-936d-d15b472c1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:17.935821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da8b9-f100-482d-936d-d15b472c1f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:17.937597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63da8b9-f100-482d-936d-d15b472c1f0a None admin] RBAC: Adding query filter params (role.id=0473bb110e5b46a28efa9ef9abc7659b, user.id=4d2a0c04904140b0b0aa8dddcd4dffa1, scope.system=all) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:17.938260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63da8b9-f100-482d-936d-d15b472c1f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:17.941185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63da8b9-f100-482d-936d-d15b472c1f0a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:17.956124 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 191/375] 10.222.0.66 () {56 vars in 1308 bytes} [Wed Jun 22 12:10:17 2022] GET /identity/v3/role_assignments?user.id=4d2a0c04904140b0b0aa8dddcd4dffa1&scope.system=all&role.id=0473bb110e5b46a28efa9ef9abc7659b => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:17.957277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da8b9-f100-482d-936d-d15b472c1f0a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:18.002882 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:18.050404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f210c-d8e0-4569-939b-16fd02b26347 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:18.120361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da8b9-f100-482d-936d-d15b472c1f0a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:18.138320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5a816-5c34-4fa2-b1bd-5149376fe0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:18.139451 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5a816-5c34-4fa2-b1bd-5149376fe0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:18.139861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5a816-5c34-4fa2-b1bd-5149376fe0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:18.140534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5a816-5c34-4fa2-b1bd-5149376fe0e0 None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:18.141872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5a816-5c34-4fa2-b1bd-5149376fe0e0 None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:18.143426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5a816-5c34-4fa2-b1bd-5149376fe0e0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:18.145374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 185/376] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:17 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:18.152009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5a816-5c34-4fa2-b1bd-5149376fe0e0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:18.179068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c313d-6e41-4af0-8bf4-05e4b139629c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:18.180348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c313d-6e41-4af0-8bf4-05e4b139629c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:18.180781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c313d-6e41-4af0-8bf4-05e4b139629c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:18.181219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c313d-6e41-4af0-8bf4-05e4b139629c None admin] PATH_INFO: `/v3/projects/4bd14a2971f0418089231e7139d946ba` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:18.187126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c313d-6e41-4af0-8bf4-05e4b139629c None admin] RBAC: Authorizing `identity:get_project(project_id=4bd14a2971f0418089231e7139d946ba)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:18.188681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c313d-6e41-4af0-8bf4-05e4b139629c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:18.192949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 192/377] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:17 2022] GET /identity/v3/projects/4bd14a2971f0418089231e7139d946ba => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:18.194325 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b815c-526b-4a00-af98-0b3aaa740ff5 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:18.194614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b815c-526b-4a00-af98-0b3aaa740ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:18.194890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b815c-526b-4a00-af98-0b3aaa740ff5 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:18.198008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 193/378] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:18.206022 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b815c-526b-4a00-af98-0b3aaa740ff5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:18.332840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5a816-5c34-4fa2-b1bd-5149376fe0e0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:18.369014 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:18.378231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:18.394695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b815c-526b-4a00-af98-0b3aaa740ff5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:18.397553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442af79d-ef0e-4f9b-bfaa-e7bc84f1fe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:18.398938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442af79d-ef0e-4f9b-bfaa-e7bc84f1fe9e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:18.399327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442af79d-ef0e-4f9b-bfaa-e7bc84f1fe9e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:18.399702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442af79d-ef0e-4f9b-bfaa-e7bc84f1fe9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:18.401680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442af79d-ef0e-4f9b-bfaa-e7bc84f1fe9e None admin] RBAC: Adding query filter params (group.id=bd211322099f4c489d0ec86af16f0f1b, role.id=0ec7b267a5724203a4845cf7da3a6ab8, scope.project.id=aa8cd07280d947a396d40811bab95347) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:18.402123 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442af79d-ef0e-4f9b-bfaa-e7bc84f1fe9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:18.403752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442af79d-ef0e-4f9b-bfaa-e7bc84f1fe9e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:18.412562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 186/379] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 12:10:18 2022] GET /identity/v3/role_assignments?group.id=bd211322099f4c489d0ec86af16f0f1b&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=0ec7b267a5724203a4845cf7da3a6ab8 => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:18.416252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b55295-21f6-4244-af48-17d18ac2d5b8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:18.416740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b55295-21f6-4244-af48-17d18ac2d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:18.417179 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b55295-21f6-4244-af48-17d18ac2d5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:18.467609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03c8c1-d4a4-4cd4-b7c6-ea5badc7f77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:18.468811 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03c8c1-d4a4-4cd4-b7c6-ea5badc7f77c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:18.469262 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03c8c1-d4a4-4cd4-b7c6-ea5badc7f77c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:18.469702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03c8c1-d4a4-4cd4-b7c6-ea5badc7f77c None admin] PATH_INFO: `/v3/groups/58f435a516a446f3b304a36cd7ee28a0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:18.471449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-29b55295-21f6-4244-af48-17d18ac2d5b8 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:18.475929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-29b55295-21f6-4244-af48-17d18ac2d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:18.488952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03c8c1-d4a4-4cd4-b7c6-ea5badc7f77c None admin] RBAC: Authorizing `identity:get_group(group_id=58f435a516a446f3b304a36cd7ee28a0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:18.488952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03c8c1-d4a4-4cd4-b7c6-ea5badc7f77c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:18.488952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 194/380] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:18 2022] GET /identity/v3/groups/58f435a516a446f3b304a36cd7ee28a0 => generated 229 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:18.495603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03c8c1-d4a4-4cd4-b7c6-ea5badc7f77c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:18.588200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 187/381] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:18.589967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17443-f41f-45fc-b16c-65a99861839b None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:18.590262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17443-f41f-45fc-b16c-65a99861839b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:18.590540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17443-f41f-45fc-b16c-65a99861839b None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:18.591876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 188/382] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:18.597336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94a0b-1517-4268-9701-6d2758357fcd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:18.597738 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94a0b-1517-4268-9701-6d2758357fcd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:18.598021 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a94a0b-1517-4268-9701-6d2758357fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:18.618551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c3a94a0b-1517-4268-9701-6d2758357fcd None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:18.619755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c3a94a0b-1517-4268-9701-6d2758357fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:18.662853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03c8c1-d4a4-4cd4-b7c6-ea5badc7f77c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:18.706796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506368e-6273-4d49-8755-e99169ba89e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:18.707522 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506368e-6273-4d49-8755-e99169ba89e9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:18.707814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506368e-6273-4d49-8755-e99169ba89e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:18.708214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506368e-6273-4d49-8755-e99169ba89e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:18.709068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506368e-6273-4d49-8755-e99169ba89e9 None admin] RBAC: Adding query filter params (group.id=58f435a516a446f3b304a36cd7ee28a0, role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=4bd14a2971f0418089231e7139d946ba) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:18.709387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506368e-6273-4d49-8755-e99169ba89e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:18.709845 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 189/383] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:18.711318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a94a0b-1517-4268-9701-6d2758357fcd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:18.715746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506368e-6273-4d49-8755-e99169ba89e9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:18.728342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 195/384] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 12:10:18 2022] GET /identity/v3/role_assignments?group.id=58f435a516a446f3b304a36cd7ee28a0&scope.project.id=4bd14a2971f0418089231e7139d946ba&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:18.740737 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506368e-6273-4d49-8755-e99169ba89e9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:18.791189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:18.797404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:18.911719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a94a0b-1517-4268-9701-6d2758357fcd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:18.934723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506368e-6273-4d49-8755-e99169ba89e9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:18.980360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b568d1c-c495-4c8f-81f1-fe9aef8fb1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:18.981520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568d1c-c495-4c8f-81f1-fe9aef8fb1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:18.982218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568d1c-c495-4c8f-81f1-fe9aef8fb1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:18.983540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568d1c-c495-4c8f-81f1-fe9aef8fb1f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:19.009550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e952ed0-f48d-48f0-b1ad-8bc05adcc585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:19.010771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e952ed0-f48d-48f0-b1ad-8bc05adcc585 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:19.011269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e952ed0-f48d-48f0-b1ad-8bc05adcc585 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:19.011743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e952ed0-f48d-48f0-b1ad-8bc05adcc585 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:19.013538 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b568d1c-c495-4c8f-81f1-fe9aef8fb1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6b568d1c-c495-4c8f-81f1-fe9aef8fb1f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:19.023824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:19.024784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:19.025584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:19.039977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 196/385] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:19.043334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e952ed0-f48d-48f0-b1ad-8bc05adcc585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:19.046134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b568d1c-c495-4c8f-81f1-fe9aef8fb1f2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-9e952ed0-f48d-48f0-b1ad-8bc05adcc585 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:19.052168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:19.053043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:19.053826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:19.056681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 190/386] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:10:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:19.062212 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e952ed0-f48d-48f0-b1ad-8bc05adcc585 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:19.216466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:19.235469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b568d1c-c495-4c8f-81f1-fe9aef8fb1f2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:19.268796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e952ed0-f48d-48f0-b1ad-8bc05adcc585 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:19.274875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:19.310817 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa62555-8e60-4537-b028-58029a6109bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:19.311504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa62555-8e60-4537-b028-58029a6109bc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:19.311792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa62555-8e60-4537-b028-58029a6109bc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:19.312092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa62555-8e60-4537-b028-58029a6109bc None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:19.312858 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa62555-8e60-4537-b028-58029a6109bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:19.313173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa62555-8e60-4537-b028-58029a6109bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:19.314597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa62555-8e60-4537-b028-58029a6109bc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:19.331317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 197/387] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:19.338413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa62555-8e60-4537-b028-58029a6109bc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:19.353152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cb06e-5520-4486-830f-98a55a93d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:19.353152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb06e-5520-4486-830f-98a55a93d140 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:19.353471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb06e-5520-4486-830f-98a55a93d140 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:19.353718 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb06e-5520-4486-830f-98a55a93d140 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:19.354507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cb06e-5520-4486-830f-98a55a93d140 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:19.355064 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cb06e-5520-4486-830f-98a55a93d140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:19.358302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cb06e-5520-4486-830f-98a55a93d140 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:19.376084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 191/388] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:19.386256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cb06e-5520-4486-830f-98a55a93d140 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:19.562709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cb06e-5520-4486-830f-98a55a93d140 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:19.582143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa62555-8e60-4537-b028-58029a6109bc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:19.601009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63265e8c-33cd-461a-92fe-48956d0b67ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:19.602760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63265e8c-33cd-461a-92fe-48956d0b67ba None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:19.603275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63265e8c-33cd-461a-92fe-48956d0b67ba None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:19.603770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63265e8c-33cd-461a-92fe-48956d0b67ba None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:19.605217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63265e8c-33cd-461a-92fe-48956d0b67ba None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:19.606878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63265e8c-33cd-461a-92fe-48956d0b67ba None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:19.609110 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 192/389] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:19 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:19.614667 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63265e8c-33cd-461a-92fe-48956d0b67ba None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:19.661038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:19.700807 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b3e81-3c59-4c7c-9eb9-0bd7b6e8cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:19.701697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b3e81-3c59-4c7c-9eb9-0bd7b6e8cd92 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:19.701982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b3e81-3c59-4c7c-9eb9-0bd7b6e8cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:19.702260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b3e81-3c59-4c7c-9eb9-0bd7b6e8cd92 None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:19.704721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b3e81-3c59-4c7c-9eb9-0bd7b6e8cd92 None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:19.706184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b3e81-3c59-4c7c-9eb9-0bd7b6e8cd92 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:19.708234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 198/390] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:19 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:19.714195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b3e81-3c59-4c7c-9eb9-0bd7b6e8cd92 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:19.731452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63265e8c-33cd-461a-92fe-48956d0b67ba None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:19.771618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a2c5f-1df2-401e-80b2-d4b793813178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:19.772879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a2c5f-1df2-401e-80b2-d4b793813178 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:19.773918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a2c5f-1df2-401e-80b2-d4b793813178 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:19.774410 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:19.774994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a2c5f-1df2-401e-80b2-d4b793813178 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:19.777468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a2c5f-1df2-401e-80b2-d4b793813178 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:19.779884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a2c5f-1df2-401e-80b2-d4b793813178 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:19.782330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 193/391] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:19 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:19.788256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a2c5f-1df2-401e-80b2-d4b793813178 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:19.913216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a2c5f-1df2-401e-80b2-d4b793813178 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:19.916338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:19.949195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b3e81-3c59-4c7c-9eb9-0bd7b6e8cd92 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:19.952751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a105516-5d6b-4ae3-8288-5603b6cfada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:19.953643 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105516-5d6b-4ae3-8288-5603b6cfada4 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:19.953932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105516-5d6b-4ae3-8288-5603b6cfada4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:19.955260 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105516-5d6b-4ae3-8288-5603b6cfada4 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219/groups/bd211322099f4c489d0ec86af16f0f1b/roles/0ec7b267a5724203a4845cf7da3a6ab8` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:19.957593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a105516-5d6b-4ae3-8288-5603b6cfada4 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa0ac34fcb3543da82900c7dad597219, group_id=bd211322099f4c489d0ec86af16f0f1b, role_id=0ec7b267a5724203a4845cf7da3a6ab8)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:19.959057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a105516-5d6b-4ae3-8288-5603b6cfada4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:19.988389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 194/392] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Jun 22 12:10:19 2022] PUT /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219/groups/bd211322099f4c489d0ec86af16f0f1b/roles/0ec7b267a5724203a4845cf7da3a6ab8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:19.994805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c6aec-c802-4b81-bd66-5779804f0638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:19.995691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c6aec-c802-4b81-bd66-5779804f0638 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:19.995972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c6aec-c802-4b81-bd66-5779804f0638 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:19.996275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c6aec-c802-4b81-bd66-5779804f0638 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:19.997536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c6aec-c802-4b81-bd66-5779804f0638 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:19.999018 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c6aec-c802-4b81-bd66-5779804f0638 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:20.001184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 199/393] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:19 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:20.007062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a105516-5d6b-4ae3-8288-5603b6cfada4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:20.132047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a105516-5d6b-4ae3-8288-5603b6cfada4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:20.174095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c72ead-bcbf-4610-9671-92a77061e0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:20.174991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72ead-bcbf-4610-9671-92a77061e0b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:20.175332 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72ead-bcbf-4610-9671-92a77061e0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:20.175620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72ead-bcbf-4610-9671-92a77061e0b7 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219/groups/bd211322099f4c489d0ec86af16f0f1b/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:20.177708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c72ead-bcbf-4610-9671-92a77061e0b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa0ac34fcb3543da82900c7dad597219, group_id=bd211322099f4c489d0ec86af16f0f1b, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:20.179207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c72ead-bcbf-4610-9671-92a77061e0b7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:20.199334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 195/394] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Jun 22 12:10:20 2022] PUT /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219/groups/bd211322099f4c489d0ec86af16f0f1b/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:20.599944 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abdc77-7c61-4f96-8c4e-f5ececf6da5e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:20.600261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abdc77-7c61-4f96-8c4e-f5ececf6da5e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:20.600558 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abdc77-7c61-4f96-8c4e-f5ececf6da5e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:20.602323 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 200/395] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:20.608634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736512a7-4425-4749-a799-2d971adb5c3f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:20.608929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736512a7-4425-4749-a799-2d971adb5c3f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:20.609216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736512a7-4425-4749-a799-2d971adb5c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:20.637095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-736512a7-4425-4749-a799-2d971adb5c3f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:20.638315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-736512a7-4425-4749-a799-2d971adb5c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:20.659704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:20.726912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 196/396] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:20.757283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abdc77-7c61-4f96-8c4e-f5ececf6da5e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:20.879176 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:20.905810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abdc77-7c61-4f96-8c4e-f5ececf6da5e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:20.920356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49166ee7-3f91-428f-b285-a2272fdf4fa8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:20.921308 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49166ee7-3f91-428f-b285-a2272fdf4fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:20.921846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49166ee7-3f91-428f-b285-a2272fdf4fa8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:20.923425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 197/397] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:10:20.929402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e8ab-06b3-42bf-9573-e2e225b2a5ce None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:20.929987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e8ab-06b3-42bf-9573-e2e225b2a5ce None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:20.930466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e8ab-06b3-42bf-9573-e2e225b2a5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:20.943169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1fb15-fd52-4ce7-ade4-4a2f1cfbb20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:20.943971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fb15-fd52-4ce7-ade4-4a2f1cfbb20e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:20.944565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fb15-fd52-4ce7-ade4-4a2f1cfbb20e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:20.944848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fb15-fd52-4ce7-ade4-4a2f1cfbb20e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:20.958812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1fb15-fd52-4ce7-ade4-4a2f1cfbb20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-25c1fb15-fd52-4ce7-ade4-4a2f1cfbb20e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:20.967889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:20.970360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:20.971166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 201/398] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:20.973386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b207e8ab-06b3-42bf-9573-e2e225b2a5ce None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:20.975125 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1fb15-fd52-4ce7-ade4-4a2f1cfbb20e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:20.975426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b207e8ab-06b3-42bf-9573-e2e225b2a5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:21.106420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 198/399] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:21.133104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1fb15-fd52-4ce7-ade4-4a2f1cfbb20e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:21.157296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207e8ab-06b3-42bf-9573-e2e225b2a5ce None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:21.198094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088d332-3ea1-4278-a967-3aafef50cf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:21.198772 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088d332-3ea1-4278-a967-3aafef50cf67 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:21.199061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088d332-3ea1-4278-a967-3aafef50cf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:21.199345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088d332-3ea1-4278-a967-3aafef50cf67 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:21.200124 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088d332-3ea1-4278-a967-3aafef50cf67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:21.200441 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088d332-3ea1-4278-a967-3aafef50cf67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:21.201827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088d332-3ea1-4278-a967-3aafef50cf67 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:21.219590 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 202/400] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:21.226159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088d332-3ea1-4278-a967-3aafef50cf67 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:21.243824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:21.294727 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:21.319083 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207e8ab-06b3-42bf-9573-e2e225b2a5ce None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:21.358678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8bce3-37f6-49c1-9239-8403bae3b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:21.359508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8bce3-37f6-49c1-9239-8403bae3b9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:21.359796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8bce3-37f6-49c1-9239-8403bae3b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:21.360166 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8bce3-37f6-49c1-9239-8403bae3b9f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:21.373315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8bce3-37f6-49c1-9239-8403bae3b9f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-bae8bce3-37f6-49c1-9239-8403bae3b9f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:21.382708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:21.383660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:21.384497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:21.388449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 199/401] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:10:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:21.390654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8bce3-37f6-49c1-9239-8403bae3b9f6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:21.495067 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088d332-3ea1-4278-a967-3aafef50cf67 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:21.539634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8bce3-37f6-49c1-9239-8403bae3b9f6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:21.555349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38feb156-96b5-4379-a4f9-0ff9c946d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:21.556867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feb156-96b5-4379-a4f9-0ff9c946d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:21.557385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feb156-96b5-4379-a4f9-0ff9c946d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:21.558211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feb156-96b5-4379-a4f9-0ff9c946d8b4 None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:21.559653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38feb156-96b5-4379-a4f9-0ff9c946d8b4 None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:21.562027 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38feb156-96b5-4379-a4f9-0ff9c946d8b4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:21.565051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 203/402] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:21 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:21.566682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7c540-73c0-483c-a3d5-09d1af9ae56f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:21.567170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7c540-73c0-483c-a3d5-09d1af9ae56f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:21.567669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7c540-73c0-483c-a3d5-09d1af9ae56f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:21.573704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 204/403] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:21.573704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7c540-73c0-483c-a3d5-09d1af9ae56f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:21.587597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04433443-b141-4306-a612-4929a5e53b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:21.589021 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04433443-b141-4306-a612-4929a5e53b4b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:21.589557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04433443-b141-4306-a612-4929a5e53b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:21.589982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04433443-b141-4306-a612-4929a5e53b4b None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:21.591137 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04433443-b141-4306-a612-4929a5e53b4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:21.591614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04433443-b141-4306-a612-4929a5e53b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:21.594031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04433443-b141-4306-a612-4929a5e53b4b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:21.605690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 200/404] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:21.607339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc81c0-535a-4fb4-81c6-b55d8eaaa57d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:21.607639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc81c0-535a-4fb4-81c6-b55d8eaaa57d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:21.608001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc81c0-535a-4fb4-81c6-b55d8eaaa57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:21.613855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:21.627380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e4fc81c0-535a-4fb4-81c6-b55d8eaaa57d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:21.628599 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e4fc81c0-535a-4fb4-81c6-b55d8eaaa57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:21.674760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:21.706299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7c540-73c0-483c-a3d5-09d1af9ae56f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:21.736681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 201/405] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:21.737912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc81c0-535a-4fb4-81c6-b55d8eaaa57d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:21.761330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd28e8-eafd-4f21-9b81-060d928c5576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:21.762203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd28e8-eafd-4f21-9b81-060d928c5576 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:21.762488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd28e8-eafd-4f21-9b81-060d928c5576 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:21.762936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd28e8-eafd-4f21-9b81-060d928c5576 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:21.764850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd28e8-eafd-4f21-9b81-060d928c5576 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:21.766515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd28e8-eafd-4f21-9b81-060d928c5576 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:21.768538 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 205/406] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:21 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:21.769313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd28e8-eafd-4f21-9b81-060d928c5576 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:21.862717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc81c0-535a-4fb4-81c6-b55d8eaaa57d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:21.892543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd28e8-eafd-4f21-9b81-060d928c5576 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:21.900314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb0a43-feee-466a-b794-b58a4fdb79e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:21.901619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb0a43-feee-466a-b794-b58a4fdb79e3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:21.902197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb0a43-feee-466a-b794-b58a4fdb79e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:21.902680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb0a43-feee-466a-b794-b58a4fdb79e3 None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:21.904125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb0a43-feee-466a-b794-b58a4fdb79e3 None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:21.905768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb0a43-feee-466a-b794-b58a4fdb79e3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:21.907952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 202/407] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:21 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:21.909183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb0a43-feee-466a-b794-b58a4fdb79e3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:21.912343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:21.931724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec571f-f05c-484c-bf3c-c172198ce489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:21.932544 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec571f-f05c-484c-bf3c-c172198ce489 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:21.932834 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec571f-f05c-484c-bf3c-c172198ce489 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:21.933116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec571f-f05c-484c-bf3c-c172198ce489 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:21.944325 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec571f-f05c-484c-bf3c-c172198ce489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-a8ec571f-f05c-484c-bf3c-c172198ce489 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:21.952425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:21.953334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:21.954518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:21.958643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 206/408] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:10:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:21.959761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec571f-f05c-484c-bf3c-c172198ce489 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:21.966294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:22.035242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb0a43-feee-466a-b794-b58a4fdb79e3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:22.079697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f28474-076a-4428-8d00-49128cc9a0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:22.080611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f28474-076a-4428-8d00-49128cc9a0ff None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:22.080951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f28474-076a-4428-8d00-49128cc9a0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:22.081263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f28474-076a-4428-8d00-49128cc9a0ff None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347/groups/bd211322099f4c489d0ec86af16f0f1b/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:22.083944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f28474-076a-4428-8d00-49128cc9a0ff None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8cd07280d947a396d40811bab95347, group_id=bd211322099f4c489d0ec86af16f0f1b, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:22.086208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f28474-076a-4428-8d00-49128cc9a0ff None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:22.097228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec571f-f05c-484c-bf3c-c172198ce489 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:22.106479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 203/409] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Jun 22 12:10:21 2022] PUT /identity/v3/projects/aa8cd07280d947a396d40811bab95347/groups/bd211322099f4c489d0ec86af16f0f1b/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:22.107612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f28474-076a-4428-8d00-49128cc9a0ff None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:22.139064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63742-3feb-4ca7-9d53-b2e5ee1a39f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:22.140091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63742-3feb-4ca7-9d53-b2e5ee1a39f7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:22.140787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63742-3feb-4ca7-9d53-b2e5ee1a39f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:22.141072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63742-3feb-4ca7-9d53-b2e5ee1a39f7 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:22.142483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b63742-3feb-4ca7-9d53-b2e5ee1a39f7 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:22.144407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b63742-3feb-4ca7-9d53-b2e5ee1a39f7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:22.146554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 207/410] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:21 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:22.152727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63742-3feb-4ca7-9d53-b2e5ee1a39f7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:22.182108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:22.229009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f28474-076a-4428-8d00-49128cc9a0ff None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:22.229958 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:22.266595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63742-3feb-4ca7-9d53-b2e5ee1a39f7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:22.268716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277269c3-f0ce-4541-9c55-f96900bdc3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:22.269641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277269c3-f0ce-4541-9c55-f96900bdc3bd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:22.270154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277269c3-f0ce-4541-9c55-f96900bdc3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:22.270634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277269c3-f0ce-4541-9c55-f96900bdc3bd None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:22.271589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277269c3-f0ce-4541-9c55-f96900bdc3bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:22.272156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277269c3-f0ce-4541-9c55-f96900bdc3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:22.273987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277269c3-f0ce-4541-9c55-f96900bdc3bd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:22.284565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 204/411] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:22.291033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277269c3-f0ce-4541-9c55-f96900bdc3bd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:22.305571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0db51-76ea-40db-b7c7-86873ba955a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:22.306481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0db51-76ea-40db-b7c7-86873ba955a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:22.307007 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0db51-76ea-40db-b7c7-86873ba955a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:22.307007 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0db51-76ea-40db-b7c7-86873ba955a5 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347/groups/bd211322099f4c489d0ec86af16f0f1b/roles/0ec7b267a5724203a4845cf7da3a6ab8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:22.309442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0db51-76ea-40db-b7c7-86873ba955a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8cd07280d947a396d40811bab95347, group_id=bd211322099f4c489d0ec86af16f0f1b, role_id=0ec7b267a5724203a4845cf7da3a6ab8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:22.310939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0db51-76ea-40db-b7c7-86873ba955a5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:22.332232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 208/412] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Jun 22 12:10:22 2022] PUT /identity/v3/projects/aa8cd07280d947a396d40811bab95347/groups/bd211322099f4c489d0ec86af16f0f1b/roles/0ec7b267a5724203a4845cf7da3a6ab8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:22.412881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277269c3-f0ce-4541-9c55-f96900bdc3bd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:22.452041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:22.455543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf5904-afc7-4e0e-8658-e6b89d679465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:22.456520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf5904-afc7-4e0e-8658-e6b89d679465 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:22.457232 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf5904-afc7-4e0e-8658-e6b89d679465 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:22.457523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf5904-afc7-4e0e-8658-e6b89d679465 None admin] PATH_INFO: `/v3/groups/58f435a516a446f3b304a36cd7ee28a0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:22.459054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf5904-afc7-4e0e-8658-e6b89d679465 None admin] RBAC: Authorizing `identity:get_group(group_id=58f435a516a446f3b304a36cd7ee28a0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:22.461038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf5904-afc7-4e0e-8658-e6b89d679465 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:22.463092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 205/413] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:22 2022] GET /identity/v3/groups/58f435a516a446f3b304a36cd7ee28a0 => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:22.469136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0db51-76ea-40db-b7c7-86873ba955a5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:22.587051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0db51-76ea-40db-b7c7-86873ba955a5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:22.612718 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f16b58-ba60-483a-a03c-e0fcaeca0e57 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:22.613033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f16b58-ba60-483a-a03c-e0fcaeca0e57 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:22.613287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f16b58-ba60-483a-a03c-e0fcaeca0e57 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:22.614668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 206/414] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:10:22.620648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2d014-67c7-48cc-b818-343b3801651a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:22.620935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2d014-67c7-48cc-b818-343b3801651a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:22.621219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2d014-67c7-48cc-b818-343b3801651a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:22.630777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:22.639588 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-95b2d014-67c7-48cc-b818-343b3801651a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:22.642082 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-95b2d014-67c7-48cc-b818-343b3801651a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:22.646021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113ce37-1a2e-46a6-8ab1-411327a58712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:22.646897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113ce37-1a2e-46a6-8ab1-411327a58712 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:22.647182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113ce37-1a2e-46a6-8ab1-411327a58712 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:22.647458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113ce37-1a2e-46a6-8ab1-411327a58712 None admin] PATH_INFO: `/v3/projects/4bd14a2971f0418089231e7139d946ba` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:22.649933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113ce37-1a2e-46a6-8ab1-411327a58712 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd14a2971f0418089231e7139d946ba)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:22.651396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113ce37-1a2e-46a6-8ab1-411327a58712 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:22.657869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 209/415] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:22 2022] GET /identity/v3/projects/4bd14a2971f0418089231e7139d946ba => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:22.660879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113ce37-1a2e-46a6-8ab1-411327a58712 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:22.771847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 207/416] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:22.823758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113ce37-1a2e-46a6-8ab1-411327a58712 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:22.829086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2d014-67c7-48cc-b818-343b3801651a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:22.890117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25c31c-7f72-4039-897c-d811806aa86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:22.891730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25c31c-7f72-4039-897c-d811806aa86d None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:22.892045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25c31c-7f72-4039-897c-d811806aa86d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:22.892644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25c31c-7f72-4039-897c-d811806aa86d None admin] PATH_INFO: `/v3/projects/4bd14a2971f0418089231e7139d946ba/groups/58f435a516a446f3b304a36cd7ee28a0/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:22.895426 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25c31c-7f72-4039-897c-d811806aa86d None admin] RBAC: Authorizing `identity:create_grant(project_id=4bd14a2971f0418089231e7139d946ba, group_id=58f435a516a446f3b304a36cd7ee28a0, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:22.897202 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25c31c-7f72-4039-897c-d811806aa86d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:22.916799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 210/417] 10.222.0.66 () {58 vars in 1442 bytes} [Wed Jun 22 12:10:22 2022] PUT /identity/v3/projects/4bd14a2971f0418089231e7139d946ba/groups/58f435a516a446f3b304a36cd7ee28a0/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:22.918448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502aa3-f88f-41f1-a592-e493c02b8cce None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:22.918746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502aa3-f88f-41f1-a592-e493c02b8cce None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:22.919067 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502aa3-f88f-41f1-a592-e493c02b8cce None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:22.921463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 211/418] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:22.928044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d26d-5622-4141-9861-bd0984bf60ec None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:22.928362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d26d-5622-4141-9861-bd0984bf60ec None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:22.928652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d26d-5622-4141-9861-bd0984bf60ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:22.947662 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-daf3d26d-5622-4141-9861-bd0984bf60ec None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:22.948981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-daf3d26d-5622-4141-9861-bd0984bf60ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:22.961405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2d014-67c7-48cc-b818-343b3801651a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:22.988230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:23.009052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95106d18-789a-4db9-ac2f-598aae2877c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:23.010616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95106d18-789a-4db9-ac2f-598aae2877c2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:23.011068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95106d18-789a-4db9-ac2f-598aae2877c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:23.011361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95106d18-789a-4db9-ac2f-598aae2877c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:23.021453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:23.029062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95106d18-789a-4db9-ac2f-598aae2877c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-95106d18-789a-4db9-ac2f-598aae2877c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:23.040372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:23.041745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:23.043551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 208/419] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:23.048408 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95106d18-789a-4db9-ac2f-598aae2877c2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:23.070862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 212/420] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:23.119253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d26d-5622-4141-9861-bd0984bf60ec None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:23.174145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95106d18-789a-4db9-ac2f-598aae2877c2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:23.214984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d61d86-ee7b-4877-9b67-207703d01604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:23.216199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d61d86-ee7b-4877-9b67-207703d01604 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:23.216635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d61d86-ee7b-4877-9b67-207703d01604 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:23.217213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d61d86-ee7b-4877-9b67-207703d01604 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:23.218937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d61d86-ee7b-4877-9b67-207703d01604 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:23.219405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d61d86-ee7b-4877-9b67-207703d01604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:23.220962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d61d86-ee7b-4877-9b67-207703d01604 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:23.233163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 209/421] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:23.239140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d61d86-ee7b-4877-9b67-207703d01604 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:23.273614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d26d-5622-4141-9861-bd0984bf60ec None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:23.319654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38336157-2ce4-4bac-96a3-492fce69e796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:23.320956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336157-2ce4-4bac-96a3-492fce69e796 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:23.321241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336157-2ce4-4bac-96a3-492fce69e796 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:23.321518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336157-2ce4-4bac-96a3-492fce69e796 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:23.332395 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:23.340505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38336157-2ce4-4bac-96a3-492fce69e796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-38336157-2ce4-4bac-96a3-492fce69e796 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:23.355045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:23.355970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:23.356776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 213/422] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:10:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:23.365539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38336157-2ce4-4bac-96a3-492fce69e796 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:23.423309 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:23.441594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d61d86-ee7b-4877-9b67-207703d01604 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:23.480493 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36866f75-36a9-4022-930b-f6a66e523256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:23.481152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866f75-36a9-4022-930b-f6a66e523256 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:23.481439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866f75-36a9-4022-930b-f6a66e523256 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:23.481720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866f75-36a9-4022-930b-f6a66e523256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:23.505075 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38336157-2ce4-4bac-96a3-492fce69e796 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:23.547736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1cca-98fb-4263-bfb6-14e0e84827e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:23.548678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1cca-98fb-4263-bfb6-14e0e84827e5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:23.549138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1cca-98fb-4263-bfb6-14e0e84827e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:23.549565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1cca-98fb-4263-bfb6-14e0e84827e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:23.550488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c1cca-98fb-4263-bfb6-14e0e84827e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:23.550946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c1cca-98fb-4263-bfb6-14e0e84827e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:23.552543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c1cca-98fb-4263-bfb6-14e0e84827e5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:23.576334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 214/423] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:23.581314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1cca-98fb-4263-bfb6-14e0e84827e5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:23.592161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36866f75-36a9-4022-930b-f6a66e523256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:23.594695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36866f75-36a9-4022-930b-f6a66e523256 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:23.666210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:23.774500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 210/424] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:23.780132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36866f75-36a9-4022-930b-f6a66e523256 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:23.811136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1cca-98fb-4263-bfb6-14e0e84827e5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:23.841026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:23.889166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4ec90-2d97-461f-b234-e41ae9127a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:23.889819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4ec90-2d97-461f-b234-e41ae9127a00 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:23.890104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4ec90-2d97-461f-b234-e41ae9127a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:23.890634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4ec90-2d97-461f-b234-e41ae9127a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:23.973252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36866f75-36a9-4022-930b-f6a66e523256 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:24.033411 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4ec90-2d97-461f-b234-e41ae9127a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:24.034880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4ec90-2d97-461f-b234-e41ae9127a00 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:24.047034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735d2f-52cf-49a2-9dba-29224353c8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:24.047907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735d2f-52cf-49a2-9dba-29224353c8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:24.048210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735d2f-52cf-49a2-9dba-29224353c8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:24.048483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735d2f-52cf-49a2-9dba-29224353c8e0 None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:24.049692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735d2f-52cf-49a2-9dba-29224353c8e0 None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:24.051528 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735d2f-52cf-49a2-9dba-29224353c8e0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:24.053560 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 211/425] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:23 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:24.065552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735d2f-52cf-49a2-9dba-29224353c8e0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:24.088462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:24.197805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 215/426] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 12:10:24.205058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4ec90-2d97-461f-b234-e41ae9127a00 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:24.223598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:24.271262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735d2f-52cf-49a2-9dba-29224353c8e0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:24.339211 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afcd88-884f-49d9-827b-53948cfed6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:24.340000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afcd88-884f-49d9-827b-53948cfed6ee None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:24.340314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afcd88-884f-49d9-827b-53948cfed6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:24.340590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afcd88-884f-49d9-827b-53948cfed6ee None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:24.342766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afcd88-884f-49d9-827b-53948cfed6ee None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:24.344245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afcd88-884f-49d9-827b-53948cfed6ee None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:24.345900 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 212/427] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:24 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:24.355084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afcd88-884f-49d9-827b-53948cfed6ee None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:24.403902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4ec90-2d97-461f-b234-e41ae9127a00 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:24.478848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed25755-9ed9-4027-bff1-67090a6428ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:24.479733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed25755-9ed9-4027-bff1-67090a6428ed None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:24.480049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed25755-9ed9-4027-bff1-67090a6428ed None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:24.480325 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed25755-9ed9-4027-bff1-67090a6428ed None admin] PATH_INFO: `/v3/projects/fa0ac34fcb3543da82900c7dad597219` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:24.482221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed25755-9ed9-4027-bff1-67090a6428ed None admin] RBAC: Authorizing `identity:get_project(project_id=fa0ac34fcb3543da82900c7dad597219)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:24.483684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed25755-9ed9-4027-bff1-67090a6428ed None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:24.487507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:24.493937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 216/428] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:24 2022] GET /identity/v3/projects/fa0ac34fcb3543da82900c7dad597219 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:24.497188 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed25755-9ed9-4027-bff1-67090a6428ed None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:24.526156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afcd88-884f-49d9-827b-53948cfed6ee None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:24.590499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa6878-c643-4cce-a2f6-1b4cec463c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:24.591077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6878-c643-4cce-a2f6-1b4cec463c16 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:24.591363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6878-c643-4cce-a2f6-1b4cec463c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:24.591641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6878-c643-4cce-a2f6-1b4cec463c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:24.592518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa6878-c643-4cce-a2f6-1b4cec463c16 None admin] RBAC: Adding query filter params (group.id=bd211322099f4c489d0ec86af16f0f1b, role.id=dda86b29d55a42c48f50fdd9fc4d5b61, scope.project.id=fa0ac34fcb3543da82900c7dad597219) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:24.593003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa6878-c643-4cce-a2f6-1b4cec463c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:24.594856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa6878-c643-4cce-a2f6-1b4cec463c16 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:24.602917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 213/429] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 12:10:24 2022] GET /identity/v3/role_assignments?group.id=bd211322099f4c489d0ec86af16f0f1b&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 611 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:24.656746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:24.686280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed25755-9ed9-4027-bff1-67090a6428ed None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:24.745297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484e6a3-16db-4969-a85c-8574af454542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:24.746169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484e6a3-16db-4969-a85c-8574af454542 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:24.746448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484e6a3-16db-4969-a85c-8574af454542 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:24.746794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484e6a3-16db-4969-a85c-8574af454542 None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:24.753002 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484e6a3-16db-4969-a85c-8574af454542 None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:24.754510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484e6a3-16db-4969-a85c-8574af454542 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:24.756779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 217/430] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:24 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:24.762956 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa6878-c643-4cce-a2f6-1b4cec463c16 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:24.821057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f6cd3-452d-4f13-875f-cab14e9a8e96 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:24.821421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f6cd3-452d-4f13-875f-cab14e9a8e96 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:24.821624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f6cd3-452d-4f13-875f-cab14e9a8e96 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:24.823121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 218/431] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:24.829222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97638bf1-5a64-4f3c-8e9c-b347678979b7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:24.829512 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97638bf1-5a64-4f3c-8e9c-b347678979b7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:24.829791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97638bf1-5a64-4f3c-8e9c-b347678979b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:24.863797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-97638bf1-5a64-4f3c-8e9c-b347678979b7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:24.864956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-97638bf1-5a64-4f3c-8e9c-b347678979b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:24.904951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa6878-c643-4cce-a2f6-1b4cec463c16 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:24.947154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2790fc-5d5b-434f-9ae3-626a27ad0c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:24.947813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2790fc-5d5b-434f-9ae3-626a27ad0c51 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:24.948637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2790fc-5d5b-434f-9ae3-626a27ad0c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:24.948637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2790fc-5d5b-434f-9ae3-626a27ad0c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:24.949228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2790fc-5d5b-434f-9ae3-626a27ad0c51 None admin] RBAC: Adding query filter params (group.id=bd211322099f4c489d0ec86af16f0f1b, role.id=0ec7b267a5724203a4845cf7da3a6ab8, scope.project.id=fa0ac34fcb3543da82900c7dad597219) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:24.949538 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2790fc-5d5b-434f-9ae3-626a27ad0c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:24.950983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2790fc-5d5b-434f-9ae3-626a27ad0c51 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:24.956123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 219/432] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:24.957494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f5da-4287-4b7a-8e42-b9433be579bf None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:24.957779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f5da-4287-4b7a-8e42-b9433be579bf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:24.958052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f5da-4287-4b7a-8e42-b9433be579bf None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:24.959485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 220/433] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:24.962742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 214/434] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 12:10:24 2022] GET /identity/v3/role_assignments?group.id=bd211322099f4c489d0ec86af16f0f1b&scope.project.id=fa0ac34fcb3543da82900c7dad597219&role.id=0ec7b267a5724203a4845cf7da3a6ab8 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:24.965249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9985c-3194-46d2-9e6a-94ed518ce4ca None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:24.965596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9985c-3194-46d2-9e6a-94ed518ce4ca None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:24.965880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9985c-3194-46d2-9e6a-94ed518ce4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:24.983256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2790fc-5d5b-434f-9ae3-626a27ad0c51 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:24.986071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-41c9985c-3194-46d2-9e6a-94ed518ce4ca None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:24.987438 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-41c9985c-3194-46d2-9e6a-94ed518ce4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:25.000467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:25.078771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 221/435] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:25.109490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9985c-3194-46d2-9e6a-94ed518ce4ca None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:25.115397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2790fc-5d5b-434f-9ae3-626a27ad0c51 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:25.120392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:25.156590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f02cbf-d2b9-48c0-93ed-d288e6aa08c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:25.157428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f02cbf-d2b9-48c0-93ed-d288e6aa08c3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:25.157718 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f02cbf-d2b9-48c0-93ed-d288e6aa08c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:25.158000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f02cbf-d2b9-48c0-93ed-d288e6aa08c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:25.172622 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f02cbf-d2b9-48c0-93ed-d288e6aa08c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f4f02cbf-d2b9-48c0-93ed-d288e6aa08c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:25.181707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:25.182672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:25.183467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 215/436] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:25.188558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f02cbf-d2b9-48c0-93ed-d288e6aa08c3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:25.247744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9985c-3194-46d2-9e6a-94ed518ce4ca None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:25.275444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:25.293225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91017c-91d7-4503-b16d-e14536518ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:25.294283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91017c-91d7-4503-b16d-e14536518ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:25.294835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91017c-91d7-4503-b16d-e14536518ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:25.295331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91017c-91d7-4503-b16d-e14536518ee0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:25.310150 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91017c-91d7-4503-b16d-e14536518ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:25.317721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f02cbf-d2b9-48c0-93ed-d288e6aa08c3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9d91017c-91d7-4503-b16d-e14536518ee0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:25.319423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:25.322769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:25.323555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 222/437] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:10:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:25.327473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91017c-91d7-4503-b16d-e14536518ee0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:25.362637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73aa7e-94b6-419b-b62a-d2204e788421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:25.363683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73aa7e-94b6-419b-b62a-d2204e788421 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:25.363967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73aa7e-94b6-419b-b62a-d2204e788421 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:25.364293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73aa7e-94b6-419b-b62a-d2204e788421 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:25.365050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73aa7e-94b6-419b-b62a-d2204e788421 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:25.365360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73aa7e-94b6-419b-b62a-d2204e788421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:25.366822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73aa7e-94b6-419b-b62a-d2204e788421 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:25.376406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 216/438] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:10:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:25.377566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac63b7-f940-4066-8265-976e00a4b574 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:25.377854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac63b7-f940-4066-8265-976e00a4b574 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:25.378129 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac63b7-f940-4066-8265-976e00a4b574 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:25.379371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 217/439] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:25.381449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac63b7-f940-4066-8265-976e00a4b574 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:25.413911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:25.459166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91017c-91d7-4503-b16d-e14536518ee0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:25.504562 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3bd11-2a49-4d92-a555-cba16588c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:25.505235 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3bd11-2a49-4d92-a555-cba16588c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:25.505523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3bd11-2a49-4d92-a555-cba16588c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:25.505801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3bd11-2a49-4d92-a555-cba16588c8f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:25.506554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3bd11-2a49-4d92-a555-cba16588c8f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:25.506785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac63b7-f940-4066-8265-976e00a4b574 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:25.506883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3bd11-2a49-4d92-a555-cba16588c8f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:25.508785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3bd11-2a49-4d92-a555-cba16588c8f9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:25.517403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 223/440] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:25.518607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4f5ee-fb7c-42b9-bd90-3220405d517a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:25.518910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4f5ee-fb7c-42b9-bd90-3220405d517a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:25.519198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4f5ee-fb7c-42b9-bd90-3220405d517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:25.535890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-02f4f5ee-fb7c-42b9-bd90-3220405d517a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:25.537138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-02f4f5ee-fb7c-42b9-bd90-3220405d517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:25.538056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:25.544165 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d82068-7b24-4ae4-b844-94e6e0c4bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:25.544816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d82068-7b24-4ae4-b844-94e6e0c4bc23 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:25.545109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d82068-7b24-4ae4-b844-94e6e0c4bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:25.545389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d82068-7b24-4ae4-b844-94e6e0c4bc23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:25.603801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 224/441] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:25.604686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4f5ee-fb7c-42b9-bd90-3220405d517a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:25.615280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d82068-7b24-4ae4-b844-94e6e0c4bc23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:25.617364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d82068-7b24-4ae4-b844-94e6e0c4bc23 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:25.676156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:25.716625 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 218/442] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:25.717465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d82068-7b24-4ae4-b844-94e6e0c4bc23 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:25.721035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4f5ee-fb7c-42b9-bd90-3220405d517a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:25.747036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:25.756440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66187b8-cb4e-4db9-836f-aef14f8459a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:25.757148 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66187b8-cb4e-4db9-836f-aef14f8459a4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:25.757988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66187b8-cb4e-4db9-836f-aef14f8459a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:25.758276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66187b8-cb4e-4db9-836f-aef14f8459a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:25.817904 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d82068-7b24-4ae4-b844-94e6e0c4bc23 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:25.825505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66187b8-cb4e-4db9-836f-aef14f8459a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:25.826991 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66187b8-cb4e-4db9-836f-aef14f8459a4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:25.852569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0b253-5064-4511-9bfa-d633c9fc31a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:25.853365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0b253-5064-4511-9bfa-d633c9fc31a6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:25.853650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0b253-5064-4511-9bfa-d633c9fc31a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:25.853927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0b253-5064-4511-9bfa-d633c9fc31a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:25.863913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0b253-5064-4511-9bfa-d633c9fc31a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-b1f0b253-5064-4511-9bfa-d633c9fc31a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:25.872174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:25.873023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:25.873842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 219/443] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:10:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:25.874481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0b253-5064-4511-9bfa-d633c9fc31a6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:25.886143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:25.928368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 225/444] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:25.929738 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66187b8-cb4e-4db9-836f-aef14f8459a4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:25.965699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:25.976889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0b253-5064-4511-9bfa-d633c9fc31a6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:26.011479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7c3c5-c05f-455d-ae97-5fef1eb38a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:26.012378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c3c5-c05f-455d-ae97-5fef1eb38a09 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:26.012663 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c3c5-c05f-455d-ae97-5fef1eb38a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:26.012938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c3c5-c05f-455d-ae97-5fef1eb38a09 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:26.014142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7c3c5-c05f-455d-ae97-5fef1eb38a09 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:26.015842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7c3c5-c05f-455d-ae97-5fef1eb38a09 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:26.017555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 220/445] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:25 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:26.018316 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7c3c5-c05f-455d-ae97-5fef1eb38a09 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:26.041342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66187b8-cb4e-4db9-836f-aef14f8459a4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:26.075649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f92ba-e1db-42b5-8982-46ba8d4e3d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:26.076349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f92ba-e1db-42b5-8982-46ba8d4e3d2b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:26.076638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f92ba-e1db-42b5-8982-46ba8d4e3d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:26.076918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f92ba-e1db-42b5-8982-46ba8d4e3d2b None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:26.077665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f92ba-e1db-42b5-8982-46ba8d4e3d2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:26.077977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f92ba-e1db-42b5-8982-46ba8d4e3d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:26.079354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f92ba-e1db-42b5-8982-46ba8d4e3d2b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:26.087548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 226/446] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:26.088380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f92ba-e1db-42b5-8982-46ba8d4e3d2b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:26.111319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:26.118690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7c3c5-c05f-455d-ae97-5fef1eb38a09 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:26.153326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbecd-c16e-43fc-a12d-bf9bb6b5b822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:26.154192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbecd-c16e-43fc-a12d-bf9bb6b5b822 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:26.154541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbecd-c16e-43fc-a12d-bf9bb6b5b822 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:26.154761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbecd-c16e-43fc-a12d-bf9bb6b5b822 None admin] PATH_INFO: `/v3/projects/aa8cd07280d947a396d40811bab95347` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:26.155938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedbecd-c16e-43fc-a12d-bf9bb6b5b822 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8cd07280d947a396d40811bab95347)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:26.157422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedbecd-c16e-43fc-a12d-bf9bb6b5b822 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:26.159123 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 221/447] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:26 2022] GET /identity/v3/projects/aa8cd07280d947a396d40811bab95347 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:26.159885 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbecd-c16e-43fc-a12d-bf9bb6b5b822 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:26.188259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:26.191100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f92ba-e1db-42b5-8982-46ba8d4e3d2b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:26.224330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea956e17-7588-47eb-adf7-b90b6ad5edb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:26.225179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956e17-7588-47eb-adf7-b90b6ad5edb8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:26.225468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956e17-7588-47eb-adf7-b90b6ad5edb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:26.225747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea956e17-7588-47eb-adf7-b90b6ad5edb8 None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:26.227442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea956e17-7588-47eb-adf7-b90b6ad5edb8 None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:26.228918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea956e17-7588-47eb-adf7-b90b6ad5edb8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:26.230554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 227/448] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:26 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:26.231316 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea956e17-7588-47eb-adf7-b90b6ad5edb8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:26.267010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbecd-c16e-43fc-a12d-bf9bb6b5b822 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:26.301424 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4db2ab-f8a2-4f73-87f1-e823a94b5d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:26.302070 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4db2ab-f8a2-4f73-87f1-e823a94b5d7a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:26.302357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4db2ab-f8a2-4f73-87f1-e823a94b5d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:26.302636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4db2ab-f8a2-4f73-87f1-e823a94b5d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:26.318642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:26.331092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea956e17-7588-47eb-adf7-b90b6ad5edb8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:26.364245 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875598e4-f14a-46cd-a5f8-f1f3ec7295ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:26.365096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875598e4-f14a-46cd-a5f8-f1f3ec7295ab None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:26.365379 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875598e4-f14a-46cd-a5f8-f1f3ec7295ab None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:26.365650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875598e4-f14a-46cd-a5f8-f1f3ec7295ab None admin] PATH_INFO: `/v3/groups/bd211322099f4c489d0ec86af16f0f1b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:26.366845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875598e4-f14a-46cd-a5f8-f1f3ec7295ab None admin] RBAC: Authorizing `identity:get_group(group_id=bd211322099f4c489d0ec86af16f0f1b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:26.368306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875598e4-f14a-46cd-a5f8-f1f3ec7295ab None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:26.369929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 228/449] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:26 2022] GET /identity/v3/groups/bd211322099f4c489d0ec86af16f0f1b => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:26.370668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875598e4-f14a-46cd-a5f8-f1f3ec7295ab None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:26.372065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4db2ab-f8a2-4f73-87f1-e823a94b5d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:26.373521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4db2ab-f8a2-4f73-87f1-e823a94b5d7a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:26.400012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:26.471982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 222/450] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:26.472713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4db2ab-f8a2-4f73-87f1-e823a94b5d7a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:26.479583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875598e4-f14a-46cd-a5f8-f1f3ec7295ab None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:26.513544 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076910d-c604-418a-a041-020b08a4178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:26.514200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076910d-c604-418a-a041-020b08a4178f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:26.514488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076910d-c604-418a-a041-020b08a4178f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:26.514773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076910d-c604-418a-a041-020b08a4178f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:26.515872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076910d-c604-418a-a041-020b08a4178f None admin] RBAC: Adding query filter params (group.id=bd211322099f4c489d0ec86af16f0f1b, role.id=dda86b29d55a42c48f50fdd9fc4d5b61, scope.project.id=aa8cd07280d947a396d40811bab95347) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:26.516218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076910d-c604-418a-a041-020b08a4178f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:26.517676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076910d-c604-418a-a041-020b08a4178f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:26.524040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 229/451] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 12:10:26 2022] GET /identity/v3/role_assignments?group.id=bd211322099f4c489d0ec86af16f0f1b&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=dda86b29d55a42c48f50fdd9fc4d5b61 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:26.524877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076910d-c604-418a-a041-020b08a4178f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:26.551628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:26.591601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4db2ab-f8a2-4f73-87f1-e823a94b5d7a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:26.622737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:26.635151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafffd59-169e-485c-ab99-cef842f14776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:26.636202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafffd59-169e-485c-ab99-cef842f14776 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:26.636494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafffd59-169e-485c-ab99-cef842f14776 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:26.636826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafffd59-169e-485c-ab99-cef842f14776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:26.637694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafffd59-169e-485c-ab99-cef842f14776 None admin] RBAC: Adding query filter params (group.id=bd211322099f4c489d0ec86af16f0f1b, role.id=0ec7b267a5724203a4845cf7da3a6ab8, scope.project.id=aa8cd07280d947a396d40811bab95347) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:26.638014 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafffd59-169e-485c-ab99-cef842f14776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:26.639500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafffd59-169e-485c-ab99-cef842f14776 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:26.646623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 223/452] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 12:10:26 2022] GET /identity/v3/role_assignments?group.id=bd211322099f4c489d0ec86af16f0f1b&scope.project.id=aa8cd07280d947a396d40811bab95347&role.id=0ec7b267a5724203a4845cf7da3a6ab8 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:26.652429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076910d-c604-418a-a041-020b08a4178f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:26.697710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a49817-3182-4c62-8fe9-c42cd5389c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:26.698619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a49817-3182-4c62-8fe9-c42cd5389c09 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:26.698903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a49817-3182-4c62-8fe9-c42cd5389c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:26.699185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a49817-3182-4c62-8fe9-c42cd5389c09 None admin] PATH_INFO: `/v3/projects/4bd14a2971f0418089231e7139d946ba` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:26.700554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a49817-3182-4c62-8fe9-c42cd5389c09 None admin] RBAC: Authorizing `identity:get_project(project_id=4bd14a2971f0418089231e7139d946ba)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:26.702066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a49817-3182-4c62-8fe9-c42cd5389c09 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:26.703906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 230/453] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:10:26 2022] GET /identity/v3/projects/4bd14a2971f0418089231e7139d946ba => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:26.710416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafffd59-169e-485c-ab99-cef842f14776 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:26.832278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafffd59-169e-485c-ab99-cef842f14776 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:26.870832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4bf9a-dbb4-4224-8c2f-b57e4a3251b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:26.871696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4bf9a-dbb4-4224-8c2f-b57e4a3251b1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:26.871979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4bf9a-dbb4-4224-8c2f-b57e4a3251b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:26.872342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4bf9a-dbb4-4224-8c2f-b57e4a3251b1 None admin] PATH_INFO: `/v3/groups/58f435a516a446f3b304a36cd7ee28a0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:26.873541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4bf9a-dbb4-4224-8c2f-b57e4a3251b1 None admin] RBAC: Authorizing `identity:get_group(group_id=58f435a516a446f3b304a36cd7ee28a0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:26.874983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4bf9a-dbb4-4224-8c2f-b57e4a3251b1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:26.876652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 224/454] 10.222.0.66 () {56 vars in 1180 bytes} [Wed Jun 22 12:10:26 2022] GET /identity/v3/groups/58f435a516a446f3b304a36cd7ee28a0 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:26.882694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a49817-3182-4c62-8fe9-c42cd5389c09 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:26.974430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:26.995614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a49817-3182-4c62-8fe9-c42cd5389c09 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:27.034761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e2e56-7bbe-4328-852e-2143e1ae1468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:27.035423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e2e56-7bbe-4328-852e-2143e1ae1468 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:27.035707 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e2e56-7bbe-4328-852e-2143e1ae1468 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:27.035985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e2e56-7bbe-4328-852e-2143e1ae1468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:27.036905 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e2e56-7bbe-4328-852e-2143e1ae1468 None admin] RBAC: Adding query filter params (group.id=58f435a516a446f3b304a36cd7ee28a0, role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=4bd14a2971f0418089231e7139d946ba) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:27.037223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e2e56-7bbe-4328-852e-2143e1ae1468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:27.038784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e2e56-7bbe-4328-852e-2143e1ae1468 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:27.045096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 231/455] 10.222.0.66 () {56 vars in 1376 bytes} [Wed Jun 22 12:10:26 2022] GET /identity/v3/role_assignments?group.id=58f435a516a446f3b304a36cd7ee28a0&scope.project.id=4bd14a2971f0418089231e7139d946ba&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:29.473994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd80fa-92b5-434c-9d82-fc4984a1bcfb None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:29.474505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd80fa-92b5-434c-9d82-fc4984a1bcfb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:29.474580 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd80fa-92b5-434c-9d82-fc4984a1bcfb None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:29.477962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 225/456] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:29.483422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464be541-3c64-4707-a511-2ab1f8d5bebe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:29.483870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464be541-3c64-4707-a511-2ab1f8d5bebe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:29.484085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464be541-3c64-4707-a511-2ab1f8d5bebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:29.505084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-464be541-3c64-4707-a511-2ab1f8d5bebe None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:29.506663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-464be541-3c64-4707-a511-2ab1f8d5bebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:29.593358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 232/457] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:29.642918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd80fa-92b5-434c-9d82-fc4984a1bcfb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:29.730698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:29.789829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd80fa-92b5-434c-9d82-fc4984a1bcfb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:29.835089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd54287-a43a-4762-93b7-29069249dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:29.835958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd54287-a43a-4762-93b7-29069249dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:29.836261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd54287-a43a-4762-93b7-29069249dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:29.836540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd54287-a43a-4762-93b7-29069249dd3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:29.848818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd54287-a43a-4762-93b7-29069249dd3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:29.857642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd54287-a43a-4762-93b7-29069249dd3d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-bbd54287-a43a-4762-93b7-29069249dd3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:29.875556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:29.876468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:29.877295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:29.877295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:29.877295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:29.877295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:29.881136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 226/458] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:29.887159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464be541-3c64-4707-a511-2ab1f8d5bebe None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:30.025258 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:30.048615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464be541-3c64-4707-a511-2ab1f8d5bebe None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:30.083440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e869418-5a88-4720-8911-4a836fa52510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:30.084147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e869418-5a88-4720-8911-4a836fa52510 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.084437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e869418-5a88-4720-8911-4a836fa52510 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.084716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e869418-5a88-4720-8911-4a836fa52510 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.085010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb547-00bc-47ec-8afc-c47779774a96 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.085489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb547-00bc-47ec-8afc-c47779774a96 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.085597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e869418-5a88-4720-8911-4a836fa52510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:30.085771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb547-00bc-47ec-8afc-c47779774a96 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.085867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e869418-5a88-4720-8911-4a836fa52510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:30.087200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e869418-5a88-4720-8911-4a836fa52510 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:30.087416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 227/459] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:30.092476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd98d2-a105-4190-b9f7-7009b5668904 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.092760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd98d2-a105-4190-b9f7-7009b5668904 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.093037 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd98d2-a105-4190-b9f7-7009b5668904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.106211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 233/460] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:30.111487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e869418-5a88-4720-8911-4a836fa52510 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:30.126592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-85bd98d2-a105-4190-b9f7-7009b5668904 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:30.127776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-85bd98d2-a105-4190-b9f7-7009b5668904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:30.215670 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 228/461] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:30.217148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd208-425a-4f58-a28a-b932178110b2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.217441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd208-425a-4f58-a28a-b932178110b2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.217721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd208-425a-4f58-a28a-b932178110b2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.223230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 229/462] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:30.224564 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97f392-9518-4f08-976f-381ce10b372c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.224856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97f392-9518-4f08-976f-381ce10b372c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.225159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97f392-9518-4f08-976f-381ce10b372c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.227322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 230/463] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:30.228226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbf52a-c032-4bba-aecf-1359c5050b8b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.228512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbf52a-c032-4bba-aecf-1359c5050b8b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.228891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbf52a-c032-4bba-aecf-1359c5050b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.235287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e869418-5a88-4720-8911-4a836fa52510 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:30.246527 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d1cbf52a-c032-4bba-aecf-1359c5050b8b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:30.248007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d1cbf52a-c032-4bba-aecf-1359c5050b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:30.273236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f2639-fb94-4a04-a9d6-7942ba110d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:30.274202 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2639-fb94-4a04-a9d6-7942ba110d67 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.274689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2639-fb94-4a04-a9d6-7942ba110d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.275141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2639-fb94-4a04-a9d6-7942ba110d67 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.276160 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f2639-fb94-4a04-a9d6-7942ba110d67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:30.277852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f2639-fb94-4a04-a9d6-7942ba110d67 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:30.284340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:30.293984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:30.308336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 234/464] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:10:30 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:10:30.310478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdfdd5-be54-4312-b1d7-8f751f4c3b4e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.310837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdfdd5-be54-4312-b1d7-8f751f4c3b4e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.311197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdfdd5-be54-4312-b1d7-8f751f4c3b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.330911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0ffdfdd5-be54-4312-b1d7-8f751f4c3b4e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:30.332235 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0ffdfdd5-be54-4312-b1d7-8f751f4c3b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:30.335565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 231/465] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:30.337601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbf52a-c032-4bba-aecf-1359c5050b8b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:30.416386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 235/466] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:30.417395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdfdd5-be54-4312-b1d7-8f751f4c3b4e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:30.453437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbf52a-c032-4bba-aecf-1359c5050b8b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:30.505532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8704d-54f5-48b6-a20e-78f934770c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:30.507050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8704d-54f5-48b6-a20e-78f934770c0d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.508004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8704d-54f5-48b6-a20e-78f934770c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.508446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8704d-54f5-48b6-a20e-78f934770c0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.528358 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8704d-54f5-48b6-a20e-78f934770c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:30.530047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8704d-54f5-48b6-a20e-78f934770c0d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f2b8704d-54f5-48b6-a20e-78f934770c0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:30.551417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:30.552432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:30.553444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:30.553444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:30.553444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:30.553444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:30.555899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 232/467] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:30.556907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8704d-54f5-48b6-a20e-78f934770c0d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:30.567970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdfdd5-be54-4312-b1d7-8f751f4c3b4e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:30.584754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:30.602251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:30.613665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcf5a4-7585-4428-b125-f0927c84bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:30.615496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcf5a4-7585-4428-b125-f0927c84bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.616010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcf5a4-7585-4428-b125-f0927c84bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.616488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcf5a4-7585-4428-b125-f0927c84bdb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.634279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcf5a4-7585-4428-b125-f0927c84bdb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:30.636142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcf5a4-7585-4428-b125-f0927c84bdb1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-73fcf5a4-7585-4428-b125-f0927c84bdb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:30.660771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:30.661856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:30.662885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:30.662885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:30.662885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:30.662885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:30.662885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 236/468] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:30.663143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcf5a4-7585-4428-b125-f0927c84bdb1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:30.683437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8704d-54f5-48b6-a20e-78f934770c0d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:30.728359 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f16ec-e2f8-48c1-bd34-a00bb1145bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:30.729562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f16ec-e2f8-48c1-bd34-a00bb1145bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.730025 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f16ec-e2f8-48c1-bd34-a00bb1145bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.730736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f16ec-e2f8-48c1-bd34-a00bb1145bc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.744050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f16ec-e2f8-48c1-bd34-a00bb1145bc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:30.746598 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f16ec-e2f8-48c1-bd34-a00bb1145bc6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ac2f16ec-e2f8-48c1-bd34-a00bb1145bc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:30.771699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:30.772872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:30.773905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:30.773905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:30.773905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:30.773905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:30.776064 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 233/469] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:30.777010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f16ec-e2f8-48c1-bd34-a00bb1145bc6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:30.795042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcf5a4-7585-4428-b125-f0927c84bdb1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:30.834347 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f99405-2476-4dd2-b4e3-bc4196979aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:30.835016 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f99405-2476-4dd2-b4e3-bc4196979aae None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.835850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f99405-2476-4dd2-b4e3-bc4196979aae None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.836164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f99405-2476-4dd2-b4e3-bc4196979aae None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.836896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f99405-2476-4dd2-b4e3-bc4196979aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:30.837208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f99405-2476-4dd2-b4e3-bc4196979aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:30.838600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f99405-2476-4dd2-b4e3-bc4196979aae None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:30.855158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 237/470] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:30.855158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f99405-2476-4dd2-b4e3-bc4196979aae None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:30.881831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:30.900676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:30.910859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f16ec-e2f8-48c1-bd34-a00bb1145bc6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:30.948520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40d7e2-eeca-4ce4-9a33-1a416febd753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:30.949189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d7e2-eeca-4ce4-9a33-1a416febd753 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.949474 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d7e2-eeca-4ce4-9a33-1a416febd753 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.949755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d7e2-eeca-4ce4-9a33-1a416febd753 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.950491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40d7e2-eeca-4ce4-9a33-1a416febd753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:30.950799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40d7e2-eeca-4ce4-9a33-1a416febd753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:30.952218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40d7e2-eeca-4ce4-9a33-1a416febd753 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:30.962740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f99405-2476-4dd2-b4e3-bc4196979aae None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:30.964850 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 234/471] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:30.966195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2f116-f9d0-451c-8393-50d59add257b None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:30.966490 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2f116-f9d0-451c-8393-50d59add257b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:30.966775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2f116-f9d0-451c-8393-50d59add257b None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:30.972158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 235/472] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:30.972158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2f116-f9d0-451c-8393-50d59add257b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:31.012864 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f1e49-557d-4af2-a875-16150fe02ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:31.013644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1e49-557d-4af2-a875-16150fe02ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:31.013939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1e49-557d-4af2-a875-16150fe02ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:31.014223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1e49-557d-4af2-a875-16150fe02ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:31.014964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f1e49-557d-4af2-a875-16150fe02ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:31.015534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f1e49-557d-4af2-a875-16150fe02ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:31.016982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f1e49-557d-4af2-a875-16150fe02ad1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:31.029405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 238/473] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:31.030199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f1e49-557d-4af2-a875-16150fe02ad1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:31.096111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2f116-f9d0-451c-8393-50d59add257b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:31.133036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116865a3-2fea-47df-b198-846dcb9ac168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:31.134015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116865a3-2fea-47df-b198-846dcb9ac168 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:31.134448 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116865a3-2fea-47df-b198-846dcb9ac168 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:31.134875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116865a3-2fea-47df-b198-846dcb9ac168 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:31.135742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116865a3-2fea-47df-b198-846dcb9ac168 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:31.137391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116865a3-2fea-47df-b198-846dcb9ac168 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:31.138918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:31.142839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f1e49-557d-4af2-a875-16150fe02ad1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:31.145047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:31.161673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 236/474] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:10:30 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:10:31.162854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aed547-728b-4cb0-9332-f766ea6023e7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:31.163145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aed547-728b-4cb0-9332-f766ea6023e7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:31.163975 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aed547-728b-4cb0-9332-f766ea6023e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:31.182428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d4aed547-728b-4cb0-9332-f766ea6023e7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:31.183683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d4aed547-728b-4cb0-9332-f766ea6023e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:31.211225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8ac5a-c0b5-4904-8fdc-582640fa3d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:31.213149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8ac5a-c0b5-4904-8fdc-582640fa3d72 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:31.214067 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8ac5a-c0b5-4904-8fdc-582640fa3d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:31.214629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8ac5a-c0b5-4904-8fdc-582640fa3d72 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:31.215940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8ac5a-c0b5-4904-8fdc-582640fa3d72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:31.218585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8ac5a-c0b5-4904-8fdc-582640fa3d72 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:31.252273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 239/475] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:10:31 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:10:31.253026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8ac5a-c0b5-4904-8fdc-582640fa3d72 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:31.280084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 237/476] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:31.301311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aed547-728b-4cb0-9332-f766ea6023e7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:31.374503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8ac5a-c0b5-4904-8fdc-582640fa3d72 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:31.416103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87713a2a-ccdc-4a4f-84f7-117db8ba906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:31.416753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713a2a-ccdc-4a4f-84f7-117db8ba906a None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:31.417041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713a2a-ccdc-4a4f-84f7-117db8ba906a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:31.417322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713a2a-ccdc-4a4f-84f7-117db8ba906a None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:31.418038 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87713a2a-ccdc-4a4f-84f7-117db8ba906a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:31.419543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87713a2a-ccdc-4a4f-84f7-117db8ba906a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:31.430924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aed547-728b-4cb0-9332-f766ea6023e7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:31.443282 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 240/477] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:10:31 2022] POST /identity/v3/users => generated 249 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:10:31.458902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:31.480126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e84c8-62d2-4b27-bd07-c11321a189ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:31.481308 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e84c8-62d2-4b27-bd07-c11321a189ed None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:31.481893 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e84c8-62d2-4b27-bd07-c11321a189ed None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:31.482382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e84c8-62d2-4b27-bd07-c11321a189ed None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:31.483472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e84c8-62d2-4b27-bd07-c11321a189ed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:31.485220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e84c8-62d2-4b27-bd07-c11321a189ed None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:31.493095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.sql.core [None req-2a9e84c8-62d2-4b27-bd07-c11321a189ed None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 12:10:31.493095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 12:10:31.493095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [parameters: {'id': '9e5496be0fd744a8bfaffc88bcc0bf64', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 12:10:31.493095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80176) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-2a9e84c8-62d2-4b27-bd07-c11321a189ed None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application conn.query(q) Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application result.read() Jun 22 12:10:31.512168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return ref.to_dict() Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 12:10:31.513526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application next(self.gen) Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application yield resource Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application next(self.gen) Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise self.value Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application session.commit() Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 12:10:31.514542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self.session.flush() Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application compat.raise_( Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 12:10:31.515676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 12:10:31.518300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application conn.query(q) Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application result.read() Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 12:10:31.520604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [parameters: {'id': '9e5496be0fd744a8bfaffc88bcc0bf64', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:31.523464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 12:10:31.525486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:31.527518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 238/478] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Jun 22 12:10:31 2022] POST /identity/v3/roles => generated 144 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:31.527675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87713a2a-ccdc-4a4f-84f7-117db8ba906a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:31.546684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:31.652931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87713a2a-ccdc-4a4f-84f7-117db8ba906a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:31.690083 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cda2f-98a4-496c-ace3-aaf2f23c0ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:31.690891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cda2f-98a4-496c-ace3-aaf2f23c0ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:31.691177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cda2f-98a4-496c-ace3-aaf2f23c0ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:31.691458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cda2f-98a4-496c-ace3-aaf2f23c0ed2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:31.702199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cda2f-98a4-496c-ace3-aaf2f23c0ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ab0cda2f-98a4-496c-ace3-aaf2f23c0ed2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:31.710928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:31.712003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:31.713117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 241/479] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:10:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:31.719752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e84c8-62d2-4b27-bd07-c11321a189ed None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:31.830241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e84c8-62d2-4b27-bd07-c11321a189ed None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:31.866054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b92a8-1180-48b2-aea1-71018072046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:31.867554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b92a8-1180-48b2-aea1-71018072046a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:31.867987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b92a8-1180-48b2-aea1-71018072046a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:31.868433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b92a8-1180-48b2-aea1-71018072046a None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:31.869347 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b92a8-1180-48b2-aea1-71018072046a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:31.869807 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b92a8-1180-48b2-aea1-71018072046a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:31.871498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b92a8-1180-48b2-aea1-71018072046a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:31.884222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 239/480] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:32.732947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce72f-13fe-47e8-92c0-a811eb4f5296 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:32.733976 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce72f-13fe-47e8-92c0-a811eb4f5296 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:32.734471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce72f-13fe-47e8-92c0-a811eb4f5296 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:32.736456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 242/481] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:32.742371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644cdbb-c0e8-4e28-8a6c-fbe1353e25c7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:32.742830 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644cdbb-c0e8-4e28-8a6c-fbe1353e25c7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:32.743015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644cdbb-c0e8-4e28-8a6c-fbe1353e25c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:32.769720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2644cdbb-c0e8-4e28-8a6c-fbe1353e25c7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:32.770932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2644cdbb-c0e8-4e28-8a6c-fbe1353e25c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:32.829102 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:32.867609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 240/482] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:32.907991 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bce72f-13fe-47e8-92c0-a811eb4f5296 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:33.015114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:33.053264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bce72f-13fe-47e8-92c0-a811eb4f5296 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:33.108758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38709685-f59c-4c9a-892d-1079fdc533b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:33.109584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38709685-f59c-4c9a-892d-1079fdc533b5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:33.109871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38709685-f59c-4c9a-892d-1079fdc533b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:33.110152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38709685-f59c-4c9a-892d-1079fdc533b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:33.124856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38709685-f59c-4c9a-892d-1079fdc533b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-38709685-f59c-4c9a-892d-1079fdc533b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:33.132650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:33.133567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:33.134859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 243/483] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:33.142074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644cdbb-c0e8-4e28-8a6c-fbe1353e25c7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:33.265815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644cdbb-c0e8-4e28-8a6c-fbe1353e25c7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:33.307777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400cf80-5fe0-4a87-83c8-ec009f39577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:33.308486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400cf80-5fe0-4a87-83c8-ec009f39577e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:33.308764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400cf80-5fe0-4a87-83c8-ec009f39577e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:33.309047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400cf80-5fe0-4a87-83c8-ec009f39577e None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:33.309813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400cf80-5fe0-4a87-83c8-ec009f39577e None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:33.310121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400cf80-5fe0-4a87-83c8-ec009f39577e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:33.311506 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400cf80-5fe0-4a87-83c8-ec009f39577e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:33.320605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 241/484] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:33.326104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38709685-f59c-4c9a-892d-1079fdc533b5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:33.484724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38709685-f59c-4c9a-892d-1079fdc533b5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:33.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:33.521839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377369d-f6b6-4f2c-a7b7-ffe78dc0ac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:33.522720 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377369d-f6b6-4f2c-a7b7-ffe78dc0ac34 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:33.523019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377369d-f6b6-4f2c-a7b7-ffe78dc0ac34 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:33.523306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377369d-f6b6-4f2c-a7b7-ffe78dc0ac34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:33.534499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377369d-f6b6-4f2c-a7b7-ffe78dc0ac34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:33.536107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377369d-f6b6-4f2c-a7b7-ffe78dc0ac34 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5377369d-f6b6-4f2c-a7b7-ffe78dc0ac34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:33.555412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:33.556377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:33.557229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:33.557229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:33.557229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:33.557229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:33.561289 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 244/485] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:33.562726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400cf80-5fe0-4a87-83c8-ec009f39577e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:33.604999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:33.679962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400cf80-5fe0-4a87-83c8-ec009f39577e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:33.721186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f8b1a-a939-4626-bd81-d7b4aa863d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:33.721856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f8b1a-a939-4626-bd81-d7b4aa863d05 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:33.722147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f8b1a-a939-4626-bd81-d7b4aa863d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:33.722424 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f8b1a-a939-4626-bd81-d7b4aa863d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:33.723153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f8b1a-a939-4626-bd81-d7b4aa863d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:33.723461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f8b1a-a939-4626-bd81-d7b4aa863d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:33.724884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f8b1a-a939-4626-bd81-d7b4aa863d05 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:33.749267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 242/486] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:33.754924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377369d-f6b6-4f2c-a7b7-ffe78dc0ac34 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:33.900212 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c2f4-637b-4572-a0dd-2d562c7b7777 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:33.900535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c2f4-637b-4572-a0dd-2d562c7b7777 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:33.900773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c2f4-637b-4572-a0dd-2d562c7b7777 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:33.902364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 243/487] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:33.907482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5e609-df8e-42fd-960b-9db4009d03fa None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:33.907777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5e609-df8e-42fd-960b-9db4009d03fa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:33.908087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5e609-df8e-42fd-960b-9db4009d03fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:33.912503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377369d-f6b6-4f2c-a7b7-ffe78dc0ac34 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:33.946853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-61a5e609-df8e-42fd-960b-9db4009d03fa None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:33.948576 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-61a5e609-df8e-42fd-960b-9db4009d03fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:33.954133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879e1a0-b4c6-4b3a-b675-b146ce96cd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:33.955222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e1a0-b4c6-4b3a-b675-b146ce96cd39 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:33.955732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e1a0-b4c6-4b3a-b675-b146ce96cd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:33.956245 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e1a0-b4c6-4b3a-b675-b146ce96cd39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:33.968096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879e1a0-b4c6-4b3a-b675-b146ce96cd39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:33.969915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879e1a0-b4c6-4b3a-b675-b146ce96cd39 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2879e1a0-b4c6-4b3a-b675-b146ce96cd39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:33.987953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:33.988948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:33.989837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:33.989837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:33.989837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:33.989837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:33.989837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:33.989837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:33.989837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:33.989837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:33.989837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:10:33.989837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:33.989837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 245/488] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 12:10:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:33.990912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8c3a-1cd6-4629-988f-4700e2ba2d7f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:33.991008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8c3a-1cd6-4629-988f-4700e2ba2d7f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:33.991814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8c3a-1cd6-4629-988f-4700e2ba2d7f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:33.993365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 246/489] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:33.998492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992258e-daf5-4fa6-bb10-8de2e9782dd1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:33.998782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992258e-daf5-4fa6-bb10-8de2e9782dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:33.999066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992258e-daf5-4fa6-bb10-8de2e9782dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.018595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e992258e-daf5-4fa6-bb10-8de2e9782dd1 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:34.019804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e992258e-daf5-4fa6-bb10-8de2e9782dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:34.028672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 244/490] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:34.029812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5e609-df8e-42fd-960b-9db4009d03fa None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:34.060300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:34.063400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:34.100232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 247/491] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:34.101311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992258e-daf5-4fa6-bb10-8de2e9782dd1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:34.141749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5e609-df8e-42fd-960b-9db4009d03fa None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:34.179909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14618d8a-01e1-403f-850b-778e9f497d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:34.181060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14618d8a-01e1-403f-850b-778e9f497d54 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:34.181624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14618d8a-01e1-403f-850b-778e9f497d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:34.182104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14618d8a-01e1-403f-850b-778e9f497d54 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.183151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14618d8a-01e1-403f-850b-778e9f497d54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:34.183714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14618d8a-01e1-403f-850b-778e9f497d54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:34.185582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14618d8a-01e1-403f-850b-778e9f497d54 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:34.226622 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 245/492] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 12:10:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:34.227895 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14618d8a-01e1-403f-850b-778e9f497d54 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:34.231955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992258e-daf5-4fa6-bb10-8de2e9782dd1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:34.271396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3617212-0a93-43b9-99be-0e1a19376504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:34.272235 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3617212-0a93-43b9-99be-0e1a19376504 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:34.272551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3617212-0a93-43b9-99be-0e1a19376504 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:34.272831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3617212-0a93-43b9-99be-0e1a19376504 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.284168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3617212-0a93-43b9-99be-0e1a19376504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d3617212-0a93-43b9-99be-0e1a19376504 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:34.292575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:34.293502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:34.294310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 248/493] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:34.295609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3617212-0a93-43b9-99be-0e1a19376504 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:34.331529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:34.339622 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:34.356715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14618d8a-01e1-403f-850b-778e9f497d54 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:34.393781 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30cd06-434b-41e6-a989-10e881e82ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:34.394677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30cd06-434b-41e6-a989-10e881e82ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:34.395033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30cd06-434b-41e6-a989-10e881e82ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:34.395393 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30cd06-434b-41e6-a989-10e881e82ba8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.402748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3617212-0a93-43b9-99be-0e1a19376504 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:34.406184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30cd06-434b-41e6-a989-10e881e82ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-5e30cd06-434b-41e6-a989-10e881e82ba8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:34.414577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:34.415657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:34.416614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 246/494] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:34.417374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bea11-01f2-4a9d-b179-b137687bc149 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:34.417664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bea11-01f2-4a9d-b179-b137687bc149 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:34.417948 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bea11-01f2-4a9d-b179-b137687bc149 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.419451 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 247/495] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:34.420851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bea11-01f2-4a9d-b179-b137687bc149 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:34.451211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e981a5e-0227-4299-8d84-ab803b529920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:34.452234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e981a5e-0227-4299-8d84-ab803b529920 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:34.452856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e981a5e-0227-4299-8d84-ab803b529920 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:34.453569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e981a5e-0227-4299-8d84-ab803b529920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.527476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e981a5e-0227-4299-8d84-ab803b529920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:34.529227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e981a5e-0227-4299-8d84-ab803b529920 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:34.530663 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bea11-01f2-4a9d-b179-b137687bc149 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:34.563629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:34.568944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff3032-018a-4003-a2c7-7f56d840839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:34.570590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3032-018a-4003-a2c7-7f56d840839e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:34.570881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3032-018a-4003-a2c7-7f56d840839e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:34.571161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3032-018a-4003-a2c7-7f56d840839e None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.571925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff3032-018a-4003-a2c7-7f56d840839e None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:34.572624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff3032-018a-4003-a2c7-7f56d840839e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:34.574339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff3032-018a-4003-a2c7-7f56d840839e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:34.584635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 248/496] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:34.586479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff3032-018a-4003-a2c7-7f56d840839e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:34.597783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:34.639694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 249/497] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:34.641268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9be23-59ac-44ce-8b3c-afb2ba789d62 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:34.641563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9be23-59ac-44ce-8b3c-afb2ba789d62 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:34.641897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9be23-59ac-44ce-8b3c-afb2ba789d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.658597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0bb9be23-59ac-44ce-8b3c-afb2ba789d62 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:34.659774 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0bb9be23-59ac-44ce-8b3c-afb2ba789d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:34.698552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff3032-018a-4003-a2c7-7f56d840839e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:34.731368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 250/498] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:34.732248 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9be23-59ac-44ce-8b3c-afb2ba789d62 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:34.733136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9d931-9d3f-495c-8ca8-47ba17ab6266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:34.733808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9d931-9d3f-495c-8ca8-47ba17ab6266 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:34.734097 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9d931-9d3f-495c-8ca8-47ba17ab6266 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:34.734379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9d931-9d3f-495c-8ca8-47ba17ab6266 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.735131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9d931-9d3f-495c-8ca8-47ba17ab6266 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:34.735444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9d931-9d3f-495c-8ca8-47ba17ab6266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:34.736844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9d931-9d3f-495c-8ca8-47ba17ab6266 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:34.750087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 249/499] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:34.750087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9d931-9d3f-495c-8ca8-47ba17ab6266 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:34.807849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:34.828759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:34.847382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9be23-59ac-44ce-8b3c-afb2ba789d62 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:34.861425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9d931-9d3f-495c-8ca8-47ba17ab6266 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:34.899681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc662-dc78-4816-8a06-bf7b80ecdfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:34.900206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63698e7f-906e-4cd9-b1aa-f805e729af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:34.900846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc662-dc78-4816-8a06-bf7b80ecdfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:34.901300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc662-dc78-4816-8a06-bf7b80ecdfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:34.901428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63698e7f-906e-4cd9-b1aa-f805e729af2b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:34.901758 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc662-dc78-4816-8a06-bf7b80ecdfa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.901881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63698e7f-906e-4cd9-b1aa-f805e729af2b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:34.902329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63698e7f-906e-4cd9-b1aa-f805e729af2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.917628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63698e7f-906e-4cd9-b1aa-f805e729af2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:34.917775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fc662-dc78-4816-8a06-bf7b80ecdfa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:34.919185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63698e7f-906e-4cd9-b1aa-f805e729af2b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:34.919291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fc662-dc78-4816-8a06-bf7b80ecdfa1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-278fc662-dc78-4816-8a06-bf7b80ecdfa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:34.936322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:34.937190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:34.938023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:34.938023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:34.938023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:34.938023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-63698e7f-906e-4cd9-b1aa-f805e729af2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:34.938230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:34.938962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:34.939819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:34.939819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:34.939819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:34.939819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:34.940038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 250/500] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:34.940121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 251/501] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:34.940121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63698e7f-906e-4cd9-b1aa-f805e729af2b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:34.940250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed328e-50ff-4b24-8b24-56d5c1c5867e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:34.940250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed328e-50ff-4b24-8b24-56d5c1c5867e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:34.940250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed328e-50ff-4b24-8b24-56d5c1c5867e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:34.940861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 251/502] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:34.945343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed328e-50ff-4b24-8b24-56d5c1c5867e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.044615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63698e7f-906e-4cd9-b1aa-f805e729af2b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.048349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed328e-50ff-4b24-8b24-56d5c1c5867e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.061052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:35.070994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:35.080492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17739adb-f7ea-459f-8a05-f3fa59f3866e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:35.081313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17739adb-f7ea-459f-8a05-f3fa59f3866e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.081593 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17739adb-f7ea-459f-8a05-f3fa59f3866e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.081872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17739adb-f7ea-459f-8a05-f3fa59f3866e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.082416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9f7b-7f3f-41b3-8e17-fd6f98a02d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:35.083144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9f7b-7f3f-41b3-8e17-fd6f98a02d82 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.083429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9f7b-7f3f-41b3-8e17-fd6f98a02d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.083717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9f7b-7f3f-41b3-8e17-fd6f98a02d82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.093340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17739adb-f7ea-459f-8a05-f3fa59f3866e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:35.094471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d9f7b-7f3f-41b3-8e17-fd6f98a02d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:35.094788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17739adb-f7ea-459f-8a05-f3fa59f3866e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-150d9f7b-7f3f-41b3-8e17-fd6f98a02d82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:35.102666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:35.103548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:35.104372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 252/503] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:35.105025 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9f7b-7f3f-41b3-8e17-fd6f98a02d82 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-17739adb-f7ea-459f-8a05-f3fa59f3866e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:35.114445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:35.115428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:35.117207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:35.117207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:35.117207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:35.117207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:35.117207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 252/504] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:35.117207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17739adb-f7ea-459f-8a05-f3fa59f3866e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.213168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9f7b-7f3f-41b3-8e17-fd6f98a02d82 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.217600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17739adb-f7ea-459f-8a05-f3fa59f3866e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.247262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14584fef-8d36-4ec7-8023-8a4faa7658d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:35.247919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584fef-8d36-4ec7-8023-8a4faa7658d3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.248235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584fef-8d36-4ec7-8023-8a4faa7658d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.248510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14584fef-8d36-4ec7-8023-8a4faa7658d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.249237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14584fef-8d36-4ec7-8023-8a4faa7658d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:35.249544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14584fef-8d36-4ec7-8023-8a4faa7658d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:35.250929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14584fef-8d36-4ec7-8023-8a4faa7658d3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:35.253785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026f968-23af-4800-8de9-b501be9bbcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:35.254445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026f968-23af-4800-8de9-b501be9bbcce None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.254729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026f968-23af-4800-8de9-b501be9bbcce None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.255005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026f968-23af-4800-8de9-b501be9bbcce None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.255730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026f968-23af-4800-8de9-b501be9bbcce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:35.256066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026f968-23af-4800-8de9-b501be9bbcce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:35.257440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026f968-23af-4800-8de9-b501be9bbcce None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:35.262555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 253/505] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:35.263768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62542602-54ec-4f5e-b036-334536411efc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.264090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62542602-54ec-4f5e-b036-334536411efc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.264377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62542602-54ec-4f5e-b036-334536411efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.272526 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 253/506] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:35.273351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026f968-23af-4800-8de9-b501be9bbcce None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.280715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-62542602-54ec-4f5e-b036-334536411efc None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:35.281926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-62542602-54ec-4f5e-b036-334536411efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:35.303078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:35.317565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:35.349574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 254/507] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:35.350410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62542602-54ec-4f5e-b036-334536411efc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.377277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026f968-23af-4800-8de9-b501be9bbcce None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.412585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a70356-f39b-425b-b05e-6423d3c51a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:35.413311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a70356-f39b-425b-b05e-6423d3c51a13 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.413596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a70356-f39b-425b-b05e-6423d3c51a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.413872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a70356-f39b-425b-b05e-6423d3c51a13 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.414616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a70356-f39b-425b-b05e-6423d3c51a13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:35.414921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a70356-f39b-425b-b05e-6423d3c51a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:35.416321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a70356-f39b-425b-b05e-6423d3c51a13 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:35.429326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 254/508] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:35.429326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a70356-f39b-425b-b05e-6423d3c51a13 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.462974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62542602-54ec-4f5e-b036-334536411efc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.499546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21552c00-8b3f-4f5c-999b-fd071a480721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:35.500147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21552c00-8b3f-4f5c-999b-fd071a480721 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.500434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21552c00-8b3f-4f5c-999b-fd071a480721 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.500716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21552c00-8b3f-4f5c-999b-fd071a480721 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.501436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21552c00-8b3f-4f5c-999b-fd071a480721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:35.501742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21552c00-8b3f-4f5c-999b-fd071a480721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:35.503121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21552c00-8b3f-4f5c-999b-fd071a480721 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:35.515843 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 255/509] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:35.516572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21552c00-8b3f-4f5c-999b-fd071a480721 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.520686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:35.529791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a70356-f39b-425b-b05e-6423d3c51a13 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.548140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:35.564292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10f2e4-4fbe-4871-a848-ac48ccf6b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:35.565093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10f2e4-4fbe-4871-a848-ac48ccf6b6cd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.565372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10f2e4-4fbe-4871-a848-ac48ccf6b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.565645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10f2e4-4fbe-4871-a848-ac48ccf6b6cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.572435 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10f2e4-4fbe-4871-a848-ac48ccf6b6cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:35.573879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10f2e4-4fbe-4871-a848-ac48ccf6b6cd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-bc10f2e4-4fbe-4871-a848-ac48ccf6b6cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:35.588793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:35.589657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:35.590514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:35.590514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:35.590514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:35.590514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:35.590514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:35.590514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:35.590514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:35.590514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:35.590514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 255/510] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:35.591461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10f2e4-4fbe-4871-a848-ac48ccf6b6cd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.620246 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21552c00-8b3f-4f5c-999b-fd071a480721 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.655248 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6c9ec-e9ec-433c-99da-3520a9669c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:35.656059 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6c9ec-e9ec-433c-99da-3520a9669c03 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.656352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6c9ec-e9ec-433c-99da-3520a9669c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.656636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6c9ec-e9ec-433c-99da-3520a9669c03 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.664002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6c9ec-e9ec-433c-99da-3520a9669c03 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:35.665522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6c9ec-e9ec-433c-99da-3520a9669c03 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-53d6c9ec-e9ec-433c-99da-3520a9669c03 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:35.681476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:35.682397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:35.683256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:35.683256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:35.683256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:35.683256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:35.683256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:35.683256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:35.683256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:35.683256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:35.683256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 12:10:35.683256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:35.683256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 256/511] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:35.683820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6c9ec-e9ec-433c-99da-3520a9669c03 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.698414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10f2e4-4fbe-4871-a848-ac48ccf6b6cd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.732414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f7eeb-64e6-458d-97fa-d377aac3b794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:35.733201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f7eeb-64e6-458d-97fa-d377aac3b794 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.733478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f7eeb-64e6-458d-97fa-d377aac3b794 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.733787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f7eeb-64e6-458d-97fa-d377aac3b794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.744135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f7eeb-64e6-458d-97fa-d377aac3b794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:35.745599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f7eeb-64e6-458d-97fa-d377aac3b794 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-334f7eeb-64e6-458d-97fa-d377aac3b794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:35.762598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:35.763446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:35.764343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:35.764343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:35.764343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:35.764343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:35.764343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 256/512] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:35.764610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f7eeb-64e6-458d-97fa-d377aac3b794 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.767555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:35.783182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:35.792690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6c9ec-e9ec-433c-99da-3520a9669c03 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.829488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea1e95-9735-4cd9-b270-9c402196869c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:35.830279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea1e95-9735-4cd9-b270-9c402196869c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.830567 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea1e95-9735-4cd9-b270-9c402196869c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.830844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea1e95-9735-4cd9-b270-9c402196869c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.841720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea1e95-9735-4cd9-b270-9c402196869c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:35.843181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea1e95-9735-4cd9-b270-9c402196869c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-6cea1e95-9735-4cd9-b270-9c402196869c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:35.860773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:35.861809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:35.862858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:35.862858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:35.862858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:35.862858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:35.862858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 257/513] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:35.863315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea1e95-9735-4cd9-b270-9c402196869c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.870331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f7eeb-64e6-458d-97fa-d377aac3b794 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.904821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01caa3-4ee6-47ea-9928-42f60e484f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:35.905621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01caa3-4ee6-47ea-9928-42f60e484f92 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:35.905914 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01caa3-4ee6-47ea-9928-42f60e484f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:35.906192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01caa3-4ee6-47ea-9928-42f60e484f92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:35.914186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01caa3-4ee6-47ea-9928-42f60e484f92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:35.915645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01caa3-4ee6-47ea-9928-42f60e484f92 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0e01caa3-4ee6-47ea-9928-42f60e484f92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:35.930861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:35.931755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:35.932689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:35.932689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:35.932689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:35.932689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:35.932689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:35.932689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:35.932689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:35.932689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:35.932689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 12:10:35.932689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:35.932689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 257/514] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:35.933246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01caa3-4ee6-47ea-9928-42f60e484f92 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:35.970077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea1e95-9735-4cd9-b270-9c402196869c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:35.998803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:36.004750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1eb74-9cc7-45fe-8db8-7d3bd03fca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:36.005442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1eb74-9cc7-45fe-8db8-7d3bd03fca2d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:36.005728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1eb74-9cc7-45fe-8db8-7d3bd03fca2d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:36.006004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1eb74-9cc7-45fe-8db8-7d3bd03fca2d None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:36.007297 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1eb74-9cc7-45fe-8db8-7d3bd03fca2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:36.007630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1eb74-9cc7-45fe-8db8-7d3bd03fca2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:36.009115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1eb74-9cc7-45fe-8db8-7d3bd03fca2d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:36.027727 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 258/515] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:36.028437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1eb74-9cc7-45fe-8db8-7d3bd03fca2d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:36.031942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:36.045696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01caa3-4ee6-47ea-9928-42f60e484f92 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:36.079620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85972a1c-7a02-45cb-9ede-24f255f70c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:36.080310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85972a1c-7a02-45cb-9ede-24f255f70c0e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:36.080596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85972a1c-7a02-45cb-9ede-24f255f70c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:36.080870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85972a1c-7a02-45cb-9ede-24f255f70c0e None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:36.081703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85972a1c-7a02-45cb-9ede-24f255f70c0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:36.082006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85972a1c-7a02-45cb-9ede-24f255f70c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:36.083436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85972a1c-7a02-45cb-9ede-24f255f70c0e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:36.119294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 258/516] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 12:10:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:36.120193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85972a1c-7a02-45cb-9ede-24f255f70c0e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:36.132807 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1eb74-9cc7-45fe-8db8-7d3bd03fca2d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:36.167697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ac1c4-e3ce-42a2-846b-9c074106feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:36.168398 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ac1c4-e3ce-42a2-846b-9c074106feca None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:36.168678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ac1c4-e3ce-42a2-846b-9c074106feca None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:36.168962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ac1c4-e3ce-42a2-846b-9c074106feca None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:36.169678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ac1c4-e3ce-42a2-846b-9c074106feca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:36.169981 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ac1c4-e3ce-42a2-846b-9c074106feca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:36.171343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ac1c4-e3ce-42a2-846b-9c074106feca None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:36.183292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 259/517] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:36.184095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ac1c4-e3ce-42a2-846b-9c074106feca None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:36.222034 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85972a1c-7a02-45cb-9ede-24f255f70c0e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:36.242382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:36.248454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:36.257420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42062fad-eb54-4da9-a107-89a86a61d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:36.258089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42062fad-eb54-4da9-a107-89a86a61d2ca None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:36.258381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42062fad-eb54-4da9-a107-89a86a61d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:36.258660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42062fad-eb54-4da9-a107-89a86a61d2ca None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:36.259383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42062fad-eb54-4da9-a107-89a86a61d2ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:36.259695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42062fad-eb54-4da9-a107-89a86a61d2ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:36.261134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42062fad-eb54-4da9-a107-89a86a61d2ca None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:36.273153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 259/518] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:36.273961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42062fad-eb54-4da9-a107-89a86a61d2ca None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:36.289438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ac1c4-e3ce-42a2-846b-9c074106feca None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:36.322866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99146d77-cede-4f9d-843a-dee667e7f94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:36.323520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99146d77-cede-4f9d-843a-dee667e7f94a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:36.323798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99146d77-cede-4f9d-843a-dee667e7f94a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:36.324114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99146d77-cede-4f9d-843a-dee667e7f94a None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:36.324945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99146d77-cede-4f9d-843a-dee667e7f94a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:36.325253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99146d77-cede-4f9d-843a-dee667e7f94a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:36.326676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99146d77-cede-4f9d-843a-dee667e7f94a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:36.343399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 260/519] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 12:10:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:36.344249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99146d77-cede-4f9d-843a-dee667e7f94a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:36.374167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42062fad-eb54-4da9-a107-89a86a61d2ca None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:36.407634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05c3b6-d3e0-4308-8948-4e81004ed9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:36.408350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05c3b6-d3e0-4308-8948-4e81004ed9ab None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:36.408605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05c3b6-d3e0-4308-8948-4e81004ed9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:36.408881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05c3b6-d3e0-4308-8948-4e81004ed9ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:36.409710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05c3b6-d3e0-4308-8948-4e81004ed9ab None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=1df703568a334eea9550ac643d87b5fe) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:36.410026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05c3b6-d3e0-4308-8948-4e81004ed9ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:36.411475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05c3b6-d3e0-4308-8948-4e81004ed9ab None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:36.417708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 260/520] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:36 2022] GET /identity/v3/role_assignments?user.id=1df703568a334eea9550ac643d87b5fe&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:36.418295 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05c3b6-d3e0-4308-8948-4e81004ed9ab None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:36.446414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99146d77-cede-4f9d-843a-dee667e7f94a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:36.472878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:36.487695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838b2f-4331-4ccb-b6d6-2956c5e2cd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:36.488396 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838b2f-4331-4ccb-b6d6-2956c5e2cd4b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:36.488684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838b2f-4331-4ccb-b6d6-2956c5e2cd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:36.488964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838b2f-4331-4ccb-b6d6-2956c5e2cd4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:36.491260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:36.557017 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05c3b6-d3e0-4308-8948-4e81004ed9ab None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:36.567648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d838b2f-4331-4ccb-b6d6-2956c5e2cd4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:36.569170 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d838b2f-4331-4ccb-b6d6-2956c5e2cd4b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:36.596402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108f43b-69fc-48bb-ac75-32b0ed9ac5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:36.597081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108f43b-69fc-48bb-ac75-32b0ed9ac5f2 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:36.597371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108f43b-69fc-48bb-ac75-32b0ed9ac5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:36.597652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108f43b-69fc-48bb-ac75-32b0ed9ac5f2 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:36.598367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108f43b-69fc-48bb-ac75-32b0ed9ac5f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:36.599822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108f43b-69fc-48bb-ac75-32b0ed9ac5f2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:36.621123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 261/521] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:10:36 2022] POST /identity/v3/users => generated 247 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:10:36.622057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108f43b-69fc-48bb-ac75-32b0ed9ac5f2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:36.702486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 261/522] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:36.707877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838b2f-4331-4ccb-b6d6-2956c5e2cd4b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:36.737583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:36.774699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108f43b-69fc-48bb-ac75-32b0ed9ac5f2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:36.780797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:36.835838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838b2f-4331-4ccb-b6d6-2956c5e2cd4b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:36.839874 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110d0df-994d-4d16-b912-3c85b4adde42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:36.840968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110d0df-994d-4d16-b912-3c85b4adde42 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:36.841452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110d0df-994d-4d16-b912-3c85b4adde42 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:36.841947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110d0df-994d-4d16-b912-3c85b4adde42 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:36.852061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110d0df-994d-4d16-b912-3c85b4adde42 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:36.853813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110d0df-994d-4d16-b912-3c85b4adde42 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-4110d0df-994d-4d16-b912-3c85b4adde42 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:36.875403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:36.876793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 262/523] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:36.878033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110d0df-994d-4d16-b912-3c85b4adde42 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:36.880247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52295-4a01-45cc-8ea2-b272ae0a9167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:36.880379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52295-4a01-45cc-8ea2-b272ae0a9167 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:36.883860 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52295-4a01-45cc-8ea2-b272ae0a9167 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:36.883860 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52295-4a01-45cc-8ea2-b272ae0a9167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:36.973986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52295-4a01-45cc-8ea2-b272ae0a9167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:36.975836 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52295-4a01-45cc-8ea2-b272ae0a9167 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:36.996962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110d0df-994d-4d16-b912-3c85b4adde42 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:37.008761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:37.041024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eade882-3ec4-4463-9eef-4549d3402974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:37.041827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eade882-3ec4-4463-9eef-4549d3402974 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:37.042115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eade882-3ec4-4463-9eef-4549d3402974 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:37.042397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eade882-3ec4-4463-9eef-4549d3402974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:37.053844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eade882-3ec4-4463-9eef-4549d3402974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:37.055524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eade882-3ec4-4463-9eef-4549d3402974 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3eade882-3ec4-4463-9eef-4549d3402974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:37.074830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:37.075709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:37.076999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:37.076999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:37.076999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:37.076999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:37.076999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 263/524] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:37.076999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eade882-3ec4-4463-9eef-4549d3402974 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:37.094418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:37.110439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 262/525] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:37.111409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52295-4a01-45cc-8ea2-b272ae0a9167 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:37.195074 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eade882-3ec4-4463-9eef-4549d3402974 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:37.236454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52295-4a01-45cc-8ea2-b272ae0a9167 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:37.240222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5b1c6-e1be-49b1-8958-19a29f6aff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:37.240905 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5b1c6-e1be-49b1-8958-19a29f6aff0d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:37.241730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5b1c6-e1be-49b1-8958-19a29f6aff0d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:37.242013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5b1c6-e1be-49b1-8958-19a29f6aff0d None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:37.242860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5b1c6-e1be-49b1-8958-19a29f6aff0d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:37.243172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5b1c6-e1be-49b1-8958-19a29f6aff0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:37.244653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5b1c6-e1be-49b1-8958-19a29f6aff0d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:37.261800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:37.271640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 264/526] 10.222.0.66 () {56 vars in 1139 bytes} [Wed Jun 22 12:10:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:37.272782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5b1c6-e1be-49b1-8958-19a29f6aff0d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:37.276262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac359ad1-ea60-4597-b73d-733212430303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:37.277204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac359ad1-ea60-4597-b73d-733212430303 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:37.277587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac359ad1-ea60-4597-b73d-733212430303 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:37.278009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac359ad1-ea60-4597-b73d-733212430303 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:37.278841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac359ad1-ea60-4597-b73d-733212430303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:37.279307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac359ad1-ea60-4597-b73d-733212430303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:37.280868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac359ad1-ea60-4597-b73d-733212430303 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:37.296584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 263/527] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:37.297557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac359ad1-ea60-4597-b73d-733212430303 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:37.368890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:37.404811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac359ad1-ea60-4597-b73d-733212430303 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:37.413619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5b1c6-e1be-49b1-8958-19a29f6aff0d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:37.439514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d84e4-ee53-4eee-b682-b75478ccc67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:37.440351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d84e4-ee53-4eee-b682-b75478ccc67a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:37.440843 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d84e4-ee53-4eee-b682-b75478ccc67a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:37.441224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d84e4-ee53-4eee-b682-b75478ccc67a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:37.451832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4f85-13ac-4c46-a9e4-6c088ccf7d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:37.452671 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4f85-13ac-4c46-a9e4-6c088ccf7d39 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:37.452957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4f85-13ac-4c46-a9e4-6c088ccf7d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:37.453339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4f85-13ac-4c46-a9e4-6c088ccf7d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:37.465661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4f85-13ac-4c46-a9e4-6c088ccf7d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:37.467396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4f85-13ac-4c46-a9e4-6c088ccf7d39 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-383b4f85-13ac-4c46-a9e4-6c088ccf7d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:37.488345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:37.490878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:37.493078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:37.493078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:37.493078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:37.493078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:37.493078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 265/528] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:37.493078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4f85-13ac-4c46-a9e4-6c088ccf7d39 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:37.498098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:37.527723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d84e4-ee53-4eee-b682-b75478ccc67a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:37.529242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d84e4-ee53-4eee-b682-b75478ccc67a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:37.622408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4f85-13ac-4c46-a9e4-6c088ccf7d39 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:37.653898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 264/529] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:37.654181 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:37.654758 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d84e4-ee53-4eee-b682-b75478ccc67a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:37.670948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee57cca-8b66-4882-9044-30dda7178be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:37.672046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee57cca-8b66-4882-9044-30dda7178be4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:37.672339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee57cca-8b66-4882-9044-30dda7178be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:37.672881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee57cca-8b66-4882-9044-30dda7178be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:37.682936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee57cca-8b66-4882-9044-30dda7178be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:37.685191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee57cca-8b66-4882-9044-30dda7178be4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5ee57cca-8b66-4882-9044-30dda7178be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:37.705831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:37.707185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:37.708451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:37.708451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:37.708451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:37.708451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:37.708451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:37.708451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:37.708451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:37.708451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:37.708451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 266/530] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:37.708451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee57cca-8b66-4882-9044-30dda7178be4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:37.744448 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:37.769255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d84e4-ee53-4eee-b682-b75478ccc67a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:37.822435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec5a23-36b5-4e64-96d4-ca44f6c02cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:37.823567 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec5a23-36b5-4e64-96d4-ca44f6c02cea None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:37.824002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec5a23-36b5-4e64-96d4-ca44f6c02cea None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:37.824439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec5a23-36b5-4e64-96d4-ca44f6c02cea None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:37.825482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec5a23-36b5-4e64-96d4-ca44f6c02cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:37.825828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec5a23-36b5-4e64-96d4-ca44f6c02cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:37.827952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec5a23-36b5-4e64-96d4-ca44f6c02cea None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:37.837934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee57cca-8b66-4882-9044-30dda7178be4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:37.854104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 265/531] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:37.854104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec5a23-36b5-4e64-96d4-ca44f6c02cea None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:37.888731 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0374-dc3e-40fd-9219-453ecad4c967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:37.889489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0374-dc3e-40fd-9219-453ecad4c967 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:37.889780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0374-dc3e-40fd-9219-453ecad4c967 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:37.890069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0374-dc3e-40fd-9219-453ecad4c967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:37.905922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c0374-dc3e-40fd-9219-453ecad4c967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:37.908299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c0374-dc3e-40fd-9219-453ecad4c967 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-951c0374-dc3e-40fd-9219-453ecad4c967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:37.932138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:37.933030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:37.933867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:37.933867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:37.933867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:37.933867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:37.940391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 267/532] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:37.942367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0374-dc3e-40fd-9219-453ecad4c967 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:37.982991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec5a23-36b5-4e64-96d4-ca44f6c02cea None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:37.989394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:38.038959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a3677-63da-4b11-a3d9-4b5d03403f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:38.039627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a3677-63da-4b11-a3d9-4b5d03403f8e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.039945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a3677-63da-4b11-a3d9-4b5d03403f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.040217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a3677-63da-4b11-a3d9-4b5d03403f8e None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.041066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a3677-63da-4b11-a3d9-4b5d03403f8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:38.041338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a3677-63da-4b11-a3d9-4b5d03403f8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:38.042789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a3677-63da-4b11-a3d9-4b5d03403f8e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:38.060935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 266/533] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:38.060935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a3677-63da-4b11-a3d9-4b5d03403f8e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:38.067812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:38.092587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0374-dc3e-40fd-9219-453ecad4c967 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:38.129088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91684ab8-b348-404a-88be-e675110975f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:38.129886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91684ab8-b348-404a-88be-e675110975f8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.130222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91684ab8-b348-404a-88be-e675110975f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.130505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91684ab8-b348-404a-88be-e675110975f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.137869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91684ab8-b348-404a-88be-e675110975f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:38.139410 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91684ab8-b348-404a-88be-e675110975f8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-91684ab8-b348-404a-88be-e675110975f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:38.155361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:38.156572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:38.157412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:38.157412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:38.157412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:38.157412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:38.157412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:38.157412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:38.157412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:38.157412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:38.157412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 268/534] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:38.157412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91684ab8-b348-404a-88be-e675110975f8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:38.188610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a3677-63da-4b11-a3d9-4b5d03403f8e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:38.224933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4be87-be28-4b49-9390-9c3c5f93108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:38.226469 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4be87-be28-4b49-9390-9c3c5f93108d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.227008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4be87-be28-4b49-9390-9c3c5f93108d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.227478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4be87-be28-4b49-9390-9c3c5f93108d None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.228428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4be87-be28-4b49-9390-9c3c5f93108d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:38.228942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4be87-be28-4b49-9390-9c3c5f93108d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:38.230508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4be87-be28-4b49-9390-9c3c5f93108d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:38.247125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 267/535] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:38.248727 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4be87-be28-4b49-9390-9c3c5f93108d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:38.263313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:38.272221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91684ab8-b348-404a-88be-e675110975f8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:38.311482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360524a4-904f-4f4a-9bf5-9b07cb868db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:38.312458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360524a4-904f-4f4a-9bf5-9b07cb868db0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.312914 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360524a4-904f-4f4a-9bf5-9b07cb868db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.313338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360524a4-904f-4f4a-9bf5-9b07cb868db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.314322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360524a4-904f-4f4a-9bf5-9b07cb868db0 None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=d82125a47ce044b389684b97c7097ebe) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:38.314820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360524a4-904f-4f4a-9bf5-9b07cb868db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:38.316516 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360524a4-904f-4f4a-9bf5-9b07cb868db0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:38.319950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:38.323938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 269/536] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:38 2022] GET /identity/v3/role_assignments?user.id=d82125a47ce044b389684b97c7097ebe&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:38.325062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360524a4-904f-4f4a-9bf5-9b07cb868db0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:38.430920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4be87-be28-4b49-9390-9c3c5f93108d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:38.486397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360524a4-904f-4f4a-9bf5-9b07cb868db0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:38.509692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac89758-5bdd-4088-b7a9-1b96083b3cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:38.510744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac89758-5bdd-4088-b7a9-1b96083b3cfa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.511027 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac89758-5bdd-4088-b7a9-1b96083b3cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.511307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac89758-5bdd-4088-b7a9-1b96083b3cfa None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.512514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac89758-5bdd-4088-b7a9-1b96083b3cfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:38.512514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac89758-5bdd-4088-b7a9-1b96083b3cfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:38.513948 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac89758-5bdd-4088-b7a9-1b96083b3cfa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:38.529139 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1a006-30af-45d0-ae5d-c0092d4b2a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:38.530286 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1a006-30af-45d0-ae5d-c0092d4b2a08 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.530785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1a006-30af-45d0-ae5d-c0092d4b2a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.531053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 268/537] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:38.531478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1a006-30af-45d0-ae5d-c0092d4b2a08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.533371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bda3d-bf31-4308-a057-799e50ef1cc9 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.533666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bda3d-bf31-4308-a057-799e50ef1cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.533942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bda3d-bf31-4308-a057-799e50ef1cc9 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.535385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 269/538] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:10:38.541023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bda3d-bf31-4308-a057-799e50ef1cc9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:38.553064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1a006-30af-45d0-ae5d-c0092d4b2a08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:38.555404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1a006-30af-45d0-ae5d-c0092d4b2a08 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b1c1a006-30af-45d0-ae5d-c0092d4b2a08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:38.571443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:38.572588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:38.573421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:38.573421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:38.573421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:38.573421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:38.573421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:38.573421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:38.573421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:38.573421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:38.575472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 270/539] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:38.577041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19fb63-e359-4cb4-af69-347838732f19 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.577531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19fb63-e359-4cb4-af69-347838732f19 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.578003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19fb63-e359-4cb4-af69-347838732f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.595913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fb19fb63-e359-4cb4-af69-347838732f19 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:38.597464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fb19fb63-e359-4cb4-af69-347838732f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:38.612193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:38.657294 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bda3d-bf31-4308-a057-799e50ef1cc9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:38.671570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 271/540] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:38.672966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19fb63-e359-4cb4-af69-347838732f19 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:38.696795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:38.715882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688bf6f-66d9-43a4-b259-569755ea6c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:38.716591 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688bf6f-66d9-43a4-b259-569755ea6c32 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.716882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688bf6f-66d9-43a4-b259-569755ea6c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.717164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688bf6f-66d9-43a4-b259-569755ea6c32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.718017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688bf6f-66d9-43a4-b259-569755ea6c32 None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=eeb4a8bcbc374f139db9e6e134b6d681) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:38.718749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688bf6f-66d9-43a4-b259-569755ea6c32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:38.720042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688bf6f-66d9-43a4-b259-569755ea6c32 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:38.727690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 270/541] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:38 2022] GET /identity/v3/role_assignments?user.id=eeb4a8bcbc374f139db9e6e134b6d681&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:38.728753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688bf6f-66d9-43a4-b259-569755ea6c32 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:38.784314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19fb63-e359-4cb4-af69-347838732f19 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:38.823090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934444ee-c898-4c60-8e4f-b0bd032e87aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:38.824309 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934444ee-c898-4c60-8e4f-b0bd032e87aa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.824836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934444ee-c898-4c60-8e4f-b0bd032e87aa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.825310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934444ee-c898-4c60-8e4f-b0bd032e87aa None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.826320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934444ee-c898-4c60-8e4f-b0bd032e87aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:38.826865 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934444ee-c898-4c60-8e4f-b0bd032e87aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:38.828840 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934444ee-c898-4c60-8e4f-b0bd032e87aa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:38.849094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688bf6f-66d9-43a4-b259-569755ea6c32 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:38.849480 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 272/542] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:38.855066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934444ee-c898-4c60-8e4f-b0bd032e87aa None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:38.868409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:38.897729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f11b0-3419-45fe-b506-caaf7cb2f9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:38.898545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f11b0-3419-45fe-b506-caaf7cb2f9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.899626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f11b0-3419-45fe-b506-caaf7cb2f9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.899626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f11b0-3419-45fe-b506-caaf7cb2f9f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.911934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f11b0-3419-45fe-b506-caaf7cb2f9f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c50f11b0-3419-45fe-b506-caaf7cb2f9f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:38.921029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:38.921988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:38.922790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:38.923393 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 271/543] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:38.928060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e81f6-99b7-4975-a2ab-0598a5b1fb59 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:38.928060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e81f6-99b7-4975-a2ab-0598a5b1fb59 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:38.928060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e81f6-99b7-4975-a2ab-0598a5b1fb59 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:38.928060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 272/544] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:38.934202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e81f6-99b7-4975-a2ab-0598a5b1fb59 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:38.983405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934444ee-c898-4c60-8e4f-b0bd032e87aa None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:38.990095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:39.023325 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9cbe1-136d-4940-a706-9d325de8e72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:39.024275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cbe1-136d-4940-a706-9d325de8e72d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:39.024711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cbe1-136d-4940-a706-9d325de8e72d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:39.025129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cbe1-136d-4940-a706-9d325de8e72d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:39.026236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9cbe1-136d-4940-a706-9d325de8e72d None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=b37002ecc6384dc08fca3ddf6ca2f9e2) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:39.026709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9cbe1-136d-4940-a706-9d325de8e72d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:39.028452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9cbe1-136d-4940-a706-9d325de8e72d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:39.035079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 273/545] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:38 2022] GET /identity/v3/role_assignments?user.id=b37002ecc6384dc08fca3ddf6ca2f9e2&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:39.036614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032503ea-21d4-473a-81d2-3776b5827f77 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:39.037035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032503ea-21d4-473a-81d2-3776b5827f77 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:39.037463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032503ea-21d4-473a-81d2-3776b5827f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:39.070494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-032503ea-21d4-473a-81d2-3776b5827f77 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:39.073519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-032503ea-21d4-473a-81d2-3776b5827f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:39.086369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e81f6-99b7-4975-a2ab-0598a5b1fb59 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:39.162005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5a269-f397-477a-adc5-0f15f22815d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:39.163076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5a269-f397-477a-adc5-0f15f22815d2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:39.163559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5a269-f397-477a-adc5-0f15f22815d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:39.163982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5a269-f397-477a-adc5-0f15f22815d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:39.165045 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5a269-f397-477a-adc5-0f15f22815d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:39.165506 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5a269-f397-477a-adc5-0f15f22815d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:39.167145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5a269-f397-477a-adc5-0f15f22815d2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:39.186791 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 273/546] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:39.192517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5a269-f397-477a-adc5-0f15f22815d2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:39.228950 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 274/547] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:39.263836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032503ea-21d4-473a-81d2-3776b5827f77 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:39.266642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:39.340843 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5a269-f397-477a-adc5-0f15f22815d2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:39.361334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:39.410086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f72b9-fa4c-42a0-b0ac-71ea2829cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:39.410890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f72b9-fa4c-42a0-b0ac-71ea2829cce0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:39.411177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f72b9-fa4c-42a0-b0ac-71ea2829cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:39.411456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f72b9-fa4c-42a0-b0ac-71ea2829cce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:39.432616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f72b9-fa4c-42a0-b0ac-71ea2829cce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:39.434092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f72b9-fa4c-42a0-b0ac-71ea2829cce0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:39.441341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032503ea-21d4-473a-81d2-3776b5827f77 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-1b8f72b9-fa4c-42a0-b0ac-71ea2829cce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:39.468841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:39.469751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:39.471043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:39.471043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:39.471043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:39.471043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:39.471043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 274/548] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:39.482735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f72b9-fa4c-42a0-b0ac-71ea2829cce0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:39.515065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be301f27-af06-43fc-8b80-fa4a81474666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:39.516082 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be301f27-af06-43fc-8b80-fa4a81474666 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:39.516370 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be301f27-af06-43fc-8b80-fa4a81474666 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:39.516646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be301f27-af06-43fc-8b80-fa4a81474666 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:39.540609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be301f27-af06-43fc-8b80-fa4a81474666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-be301f27-af06-43fc-8b80-fa4a81474666 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:39.551810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:39.552823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:39.554664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:39.557542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 275/549] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:39.564607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be301f27-af06-43fc-8b80-fa4a81474666 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:39.681841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:39.698152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f72b9-fa4c-42a0-b0ac-71ea2829cce0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:39.728422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be301f27-af06-43fc-8b80-fa4a81474666 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:39.770276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266b2ce-4be0-4024-89ed-463ed9d3732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:39.770871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266b2ce-4be0-4024-89ed-463ed9d3732b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:39.773789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266b2ce-4be0-4024-89ed-463ed9d3732b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:39.774079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266b2ce-4be0-4024-89ed-463ed9d3732b None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:39.774854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266b2ce-4be0-4024-89ed-463ed9d3732b None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:39.775166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266b2ce-4be0-4024-89ed-463ed9d3732b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:39.776593 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266b2ce-4be0-4024-89ed-463ed9d3732b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:39.783865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a618c68-12c2-4829-a0fe-f950a5f48965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:39.784848 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a618c68-12c2-4829-a0fe-f950a5f48965 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:39.785488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a618c68-12c2-4829-a0fe-f950a5f48965 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:39.785969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a618c68-12c2-4829-a0fe-f950a5f48965 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:39.786138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 276/550] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:39.787130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a618c68-12c2-4829-a0fe-f950a5f48965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:39.787658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a618c68-12c2-4829-a0fe-f950a5f48965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:39.789364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a618c68-12c2-4829-a0fe-f950a5f48965 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:39.791647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266b2ce-4be0-4024-89ed-463ed9d3732b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:39.802880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 275/551] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:39.813042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a618c68-12c2-4829-a0fe-f950a5f48965 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:39.851628 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:39.905117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266b2ce-4be0-4024-89ed-463ed9d3732b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:39.930317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:39.950685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ea9e6-2318-4e43-bcd5-5607c66a293b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:39.951909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ea9e6-2318-4e43-bcd5-5607c66a293b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:39.952488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ea9e6-2318-4e43-bcd5-5607c66a293b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:39.952949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ea9e6-2318-4e43-bcd5-5607c66a293b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:39.978137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ea9e6-2318-4e43-bcd5-5607c66a293b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:39.982085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ea9e6-2318-4e43-bcd5-5607c66a293b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:40.024324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a618c68-12c2-4829-a0fe-f950a5f48965 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-fe8ea9e6-2318-4e43-bcd5-5607c66a293b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:40.035420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:40.036666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:40.037616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:40.037616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:40.037616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:40.037616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:40.039964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 277/552] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:40.046038 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ea9e6-2318-4e43-bcd5-5607c66a293b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:40.153324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff0e09-b78e-4885-9971-d877cb12517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:40.154367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff0e09-b78e-4885-9971-d877cb12517a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:40.154496 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff0e09-b78e-4885-9971-d877cb12517a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:40.154689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff0e09-b78e-4885-9971-d877cb12517a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:40.157600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ea9e6-2318-4e43-bcd5-5607c66a293b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:40.162430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff0e09-b78e-4885-9971-d877cb12517a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:40.163940 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff0e09-b78e-4885-9971-d877cb12517a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-34ff0e09-b78e-4885-9971-d877cb12517a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:40.196363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:40.197374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:40.198261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:40.198261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:40.198261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:40.198261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:40.198261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:40.198261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:40.198261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:40.198261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:40.198261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:10:40.198261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:40.198261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 276/553] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 12:10:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:40.203447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff0e09-b78e-4885-9971-d877cb12517a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:40.204578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45927a5b-b295-4e14-977d-2e3400ac7008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:40.205418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45927a5b-b295-4e14-977d-2e3400ac7008 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:40.205849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45927a5b-b295-4e14-977d-2e3400ac7008 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:40.206294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45927a5b-b295-4e14-977d-2e3400ac7008 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:40.207181 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45927a5b-b295-4e14-977d-2e3400ac7008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:40.207492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45927a5b-b295-4e14-977d-2e3400ac7008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:40.208921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45927a5b-b295-4e14-977d-2e3400ac7008 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:40.234519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 278/554] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:40.240535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45927a5b-b295-4e14-977d-2e3400ac7008 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:40.302770 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:40.340354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:40.379854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff0e09-b78e-4885-9971-d877cb12517a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:40.430061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45927a5b-b295-4e14-977d-2e3400ac7008 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:40.454300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be2faf-0f9a-4fdd-9e52-5c18ded46e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:40.455428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2faf-0f9a-4fdd-9e52-5c18ded46e03 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:40.455716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2faf-0f9a-4fdd-9e52-5c18ded46e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:40.456176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2faf-0f9a-4fdd-9e52-5c18ded46e03 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:40.457155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be2faf-0f9a-4fdd-9e52-5c18ded46e03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:40.457632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be2faf-0f9a-4fdd-9e52-5c18ded46e03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:40.459669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be2faf-0f9a-4fdd-9e52-5c18ded46e03 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:40.483577 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bcb05-5e64-4bb6-9cb0-0465f50bfb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:40.484419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bcb05-5e64-4bb6-9cb0-0465f50bfb2b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:40.484704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bcb05-5e64-4bb6-9cb0-0465f50bfb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:40.484983 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bcb05-5e64-4bb6-9cb0-0465f50bfb2b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:40.500740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 277/555] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 12:10:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:40.501895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bcb05-5e64-4bb6-9cb0-0465f50bfb2b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:40.503353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bcb05-5e64-4bb6-9cb0-0465f50bfb2b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:40.506209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be2faf-0f9a-4fdd-9e52-5c18ded46e03 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-677bcb05-5e64-4bb6-9cb0-0465f50bfb2b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:40.539917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:40.540946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:40.542381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:40.542381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:40.542381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:40.542381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:40.542381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:40.542381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:40.542381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:40.542381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:40.542381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:10:40.542381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:40.542381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 279/556] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:10:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:40.546937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bcb05-5e64-4bb6-9cb0-0465f50bfb2b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:40.688495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be2faf-0f9a-4fdd-9e52-5c18ded46e03 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:40.717179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:40.725278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bcb05-5e64-4bb6-9cb0-0465f50bfb2b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:40.725862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9295e-31bb-4ff1-9f10-7c3764f2abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:40.726683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9295e-31bb-4ff1-9f10-7c3764f2abb9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:40.727048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9295e-31bb-4ff1-9f10-7c3764f2abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:40.727334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9295e-31bb-4ff1-9f10-7c3764f2abb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:40.734819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:40.739656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9295e-31bb-4ff1-9f10-7c3764f2abb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:40.741695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9295e-31bb-4ff1-9f10-7c3764f2abb9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-cbe9295e-31bb-4ff1-9f10-7c3764f2abb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:40.761630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:40.762755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:40.763915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:40.763915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:40.763915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:40.763915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:40.765046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 278/557] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:40.766688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977a428-14a3-4bc7-8070-f228099437a1 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:40.767052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977a428-14a3-4bc7-8070-f228099437a1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:40.767410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977a428-14a3-4bc7-8070-f228099437a1 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:40.770005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcc130-a18f-4b44-800c-5a72bf9ba100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:40.770843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc130-a18f-4b44-800c-5a72bf9ba100 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:40.771257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc130-a18f-4b44-800c-5a72bf9ba100 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:40.771656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc130-a18f-4b44-800c-5a72bf9ba100 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:40.773234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcc130-a18f-4b44-800c-5a72bf9ba100 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:40.773656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 279/558] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:40.773873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcc130-a18f-4b44-800c-5a72bf9ba100 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:40.774702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977a428-14a3-4bc7-8070-f228099437a1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:40.775743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcc130-a18f-4b44-800c-5a72bf9ba100 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:40.799579 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 280/559] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 12:10:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:40.801652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c16f71-8fb0-4c5d-a7aa-ff710e925eab None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:40.802085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c16f71-8fb0-4c5d-a7aa-ff710e925eab None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:40.802935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c16f71-8fb0-4c5d-a7aa-ff710e925eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:40.824322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d5c16f71-8fb0-4c5d-a7aa-ff710e925eab None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:40.825775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d5c16f71-8fb0-4c5d-a7aa-ff710e925eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:40.900747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977a428-14a3-4bc7-8070-f228099437a1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:40.917920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 281/560] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:40.919093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c16f71-8fb0-4c5d-a7aa-ff710e925eab None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:40.962285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f0242-2b0f-475e-a017-fc8c133c453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:40.962976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f0242-2b0f-475e-a017-fc8c133c453b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:40.963337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f0242-2b0f-475e-a017-fc8c133c453b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:40.963692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f0242-2b0f-475e-a017-fc8c133c453b None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:40.964600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f0242-2b0f-475e-a017-fc8c133c453b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:40.964990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f0242-2b0f-475e-a017-fc8c133c453b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:40.966606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f0242-2b0f-475e-a017-fc8c133c453b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:40.984982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 280/561] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:40.986123 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f0242-2b0f-475e-a017-fc8c133c453b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:41.034037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:41.058930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c16f71-8fb0-4c5d-a7aa-ff710e925eab None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:41.064686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:41.094462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6d1c-a39d-4318-9c22-40d00994effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:41.095122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6d1c-a39d-4318-9c22-40d00994effb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.095961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6d1c-a39d-4318-9c22-40d00994effb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.096293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6d1c-a39d-4318-9c22-40d00994effb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.123405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f0242-2b0f-475e-a017-fc8c133c453b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:41.160437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228667da-90d5-4909-9976-20eaf015c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:41.161343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228667da-90d5-4909-9976-20eaf015c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.161757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228667da-90d5-4909-9976-20eaf015c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.162038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228667da-90d5-4909-9976-20eaf015c4f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.168853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6d1c-a39d-4318-9c22-40d00994effb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:41.170369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6d1c-a39d-4318-9c22-40d00994effb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:41.173596 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228667da-90d5-4909-9976-20eaf015c4f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-228667da-90d5-4909-9976-20eaf015c4f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:41.181602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:41.182680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:41.183512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 281/562] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:41.184819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228667da-90d5-4909-9976-20eaf015c4f0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:41.267317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:41.288476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 282/563] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:41.289830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d2e3-cf9a-4fd8-b261-91163a2cf850 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.290125 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d2e3-cf9a-4fd8-b261-91163a2cf850 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.290445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d2e3-cf9a-4fd8-b261-91163a2cf850 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.291968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 283/564] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:41.292479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d2e3-cf9a-4fd8-b261-91163a2cf850 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:41.298109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228667da-90d5-4909-9976-20eaf015c4f0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:41.308925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:41.338201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd6056-feeb-47ab-841d-40f4da789c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:41.339011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd6056-feeb-47ab-841d-40f4da789c8a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.339279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd6056-feeb-47ab-841d-40f4da789c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.339556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd6056-feeb-47ab-841d-40f4da789c8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.346555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd6056-feeb-47ab-841d-40f4da789c8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:41.348008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd6056-feeb-47ab-841d-40f4da789c8a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c6cd6056-feeb-47ab-841d-40f4da789c8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:41.363254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:41.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:41.365261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:41.365261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:41.365261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:41.365261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:41.365261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:41.365261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:41.365261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:41.365261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:41.365261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 282/565] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:41.365261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd6056-feeb-47ab-841d-40f4da789c8a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:41.410503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d2e3-cf9a-4fd8-b261-91163a2cf850 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:41.446650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef428e-6338-4790-856d-2f2c2816a402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:41.447367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef428e-6338-4790-856d-2f2c2816a402 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.447654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef428e-6338-4790-856d-2f2c2816a402 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.447933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef428e-6338-4790-856d-2f2c2816a402 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.448716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef428e-6338-4790-856d-2f2c2816a402 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:41.449491 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef428e-6338-4790-856d-2f2c2816a402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:41.450408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef428e-6338-4790-856d-2f2c2816a402 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:41.458358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 284/566] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:41.459635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ee16-c36e-4e2b-8baa-180f3bc2ea2f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.459957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ee16-c36e-4e2b-8baa-180f3bc2ea2f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.460373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ee16-c36e-4e2b-8baa-180f3bc2ea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.468840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd6056-feeb-47ab-841d-40f4da789c8a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:41.476466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5202ee16-c36e-4e2b-8baa-180f3bc2ea2f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:41.477658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5202ee16-c36e-4e2b-8baa-180f3bc2ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:41.503475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aaf7da-edfb-4ab3-a0b4-6cc62d0d96b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:41.504310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaf7da-edfb-4ab3-a0b4-6cc62d0d96b5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.504594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaf7da-edfb-4ab3-a0b4-6cc62d0d96b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.504869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaf7da-edfb-4ab3-a0b4-6cc62d0d96b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.515548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aaf7da-edfb-4ab3-a0b4-6cc62d0d96b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:41.517949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aaf7da-edfb-4ab3-a0b4-6cc62d0d96b5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:41.521688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-21aaf7da-edfb-4ab3-a0b4-6cc62d0d96b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:41.535651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:41.536764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:41.537931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:41.537931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:41.537931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:41.537931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:41.537931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 283/567] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:41.537931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aaf7da-edfb-4ab3-a0b4-6cc62d0d96b5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:41.552994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 285/568] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:41.555176 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad00d4-ce44-419a-a715-9a6a43a4cf74 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.555632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad00d4-ce44-419a-a715-9a6a43a4cf74 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.555904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad00d4-ce44-419a-a715-9a6a43a4cf74 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.557381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 286/569] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:41.562001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad00d4-ce44-419a-a715-9a6a43a4cf74 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:41.563985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:41.639983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aaf7da-edfb-4ab3-a0b4-6cc62d0d96b5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:41.670427 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad00d4-ce44-419a-a715-9a6a43a4cf74 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:41.674067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879b8d4-a5c8-4aa1-9974-54257c8310f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:41.674721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b8d4-a5c8-4aa1-9974-54257c8310f7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.675007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b8d4-a5c8-4aa1-9974-54257c8310f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.675288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879b8d4-a5c8-4aa1-9974-54257c8310f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.676104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879b8d4-a5c8-4aa1-9974-54257c8310f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:41.676417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879b8d4-a5c8-4aa1-9974-54257c8310f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:41.677853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879b8d4-a5c8-4aa1-9974-54257c8310f7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:41.689755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 284/570] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:41.690626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879b8d4-a5c8-4aa1-9974-54257c8310f7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:41.704528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dfe7b-27ec-4918-b37d-6f7cb9fb1162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:41.705322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dfe7b-27ec-4918-b37d-6f7cb9fb1162 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.705617 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dfe7b-27ec-4918-b37d-6f7cb9fb1162 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.705898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dfe7b-27ec-4918-b37d-6f7cb9fb1162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.716263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dfe7b-27ec-4918-b37d-6f7cb9fb1162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:41.718169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dfe7b-27ec-4918-b37d-6f7cb9fb1162 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-121dfe7b-27ec-4918-b37d-6f7cb9fb1162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:41.736315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:41.737333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:41.738218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:41.738218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:41.738218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:41.738218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:41.738218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 287/571] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:41.738883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6a3d-d2c9-46de-ad19-23dfc08b98a8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.739170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6a3d-d2c9-46de-ad19-23dfc08b98a8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.739446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6a3d-d2c9-46de-ad19-23dfc08b98a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.755988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d5eb6a3d-d2c9-46de-ad19-23dfc08b98a8 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:41.757265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d5eb6a3d-d2c9-46de-ad19-23dfc08b98a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:41.774840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:41.780457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:41.793828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879b8d4-a5c8-4aa1-9974-54257c8310f7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:41.824195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 288/572] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:41.825050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb6a3d-d2c9-46de-ad19-23dfc08b98a8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:41.841655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7062a8-7680-4acf-bd92-40240b585c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:41.842451 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7062a8-7680-4acf-bd92-40240b585c2f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.842685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7062a8-7680-4acf-bd92-40240b585c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.842966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7062a8-7680-4acf-bd92-40240b585c2f None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.843900 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7062a8-7680-4acf-bd92-40240b585c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:41.844006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7062a8-7680-4acf-bd92-40240b585c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:41.845366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7062a8-7680-4acf-bd92-40240b585c2f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:41.858148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 285/573] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:41.858923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7062a8-7680-4acf-bd92-40240b585c2f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:41.931763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb6a3d-d2c9-46de-ad19-23dfc08b98a8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:41.960183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7062a8-7680-4acf-bd92-40240b585c2f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:41.966266 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901e2e0-92df-4ff5-bd77-97eef2db8223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:41.967064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901e2e0-92df-4ff5-bd77-97eef2db8223 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:41.967348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901e2e0-92df-4ff5-bd77-97eef2db8223 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:41.967646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901e2e0-92df-4ff5-bd77-97eef2db8223 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:41.978397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901e2e0-92df-4ff5-bd77-97eef2db8223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3901e2e0-92df-4ff5-bd77-97eef2db8223 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:41.986313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:41.988384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 289/574] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:41.990413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901e2e0-92df-4ff5-bd77-97eef2db8223 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:42.003400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfafe0-5016-4918-b8c1-3a2aa1fa8bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:42.004981 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfafe0-5016-4918-b8c1-3a2aa1fa8bab None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:42.005427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfafe0-5016-4918-b8c1-3a2aa1fa8bab None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:42.005884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfafe0-5016-4918-b8c1-3a2aa1fa8bab None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/1df703568a334eea9550ac643d87b5fe/roles/14d046a572664f94934f225e9a3f3b64` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:42.014742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:42.021293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:42.025018 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfafe0-5016-4918-b8c1-3a2aa1fa8bab None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=1df703568a334eea9550ac643d87b5fe, role_id=14d046a572664f94934f225e9a3f3b64)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:42.026615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfafe0-5016-4918-b8c1-3a2aa1fa8bab None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:42.039084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 286/575] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:10:41 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/1df703568a334eea9550ac643d87b5fe/roles/14d046a572664f94934f225e9a3f3b64 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:42.039879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfafe0-5016-4918-b8c1-3a2aa1fa8bab None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:42.122481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901e2e0-92df-4ff5-bd77-97eef2db8223 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:42.158155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfafe0-5016-4918-b8c1-3a2aa1fa8bab None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:42.161975 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01163a2c-b2eb-4748-b6f0-f6b496406f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:42.162663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163a2c-b2eb-4748-b6f0-f6b496406f46 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:42.162987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163a2c-b2eb-4748-b6f0-f6b496406f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:42.163273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163a2c-b2eb-4748-b6f0-f6b496406f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:42.164066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01163a2c-b2eb-4748-b6f0-f6b496406f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:42.164428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01163a2c-b2eb-4748-b6f0-f6b496406f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:42.165857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01163a2c-b2eb-4748-b6f0-f6b496406f46 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:42.184909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 290/576] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:42.184909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01163a2c-b2eb-4748-b6f0-f6b496406f46 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:42.207924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40de9fc-b08b-442b-ac0e-cd61702d6113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:42.208757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40de9fc-b08b-442b-ac0e-cd61702d6113 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:42.209045 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40de9fc-b08b-442b-ac0e-cd61702d6113 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:42.209325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40de9fc-b08b-442b-ac0e-cd61702d6113 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:42.220888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40de9fc-b08b-442b-ac0e-cd61702d6113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-d40de9fc-b08b-442b-ac0e-cd61702d6113 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:42.228816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:42.229961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 287/577] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:42.230809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40de9fc-b08b-442b-ac0e-cd61702d6113 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:42.281735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:42.290412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:42.307864 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01163a2c-b2eb-4748-b6f0-f6b496406f46 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:42.343284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b124f17-656e-4d24-9f36-2e2d7d39c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:42.344106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b124f17-656e-4d24-9f36-2e2d7d39c2fd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:42.344397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b124f17-656e-4d24-9f36-2e2d7d39c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:42.344678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b124f17-656e-4d24-9f36-2e2d7d39c2fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:42.350433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40de9fc-b08b-442b-ac0e-cd61702d6113 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:42.351802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b124f17-656e-4d24-9f36-2e2d7d39c2fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:42.353301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b124f17-656e-4d24-9f36-2e2d7d39c2fd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7b124f17-656e-4d24-9f36-2e2d7d39c2fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:42.367766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:42.368884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:42.369796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:42.369796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:42.369796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:42.369796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:42.369796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:42.369796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:42.369796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:42.369796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:42.369796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 291/578] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:42.370281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b124f17-656e-4d24-9f36-2e2d7d39c2fd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:42.392117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91938519-229d-4a18-b532-471e3455fc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:42.392787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91938519-229d-4a18-b532-471e3455fc4a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:42.393073 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91938519-229d-4a18-b532-471e3455fc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:42.393350 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91938519-229d-4a18-b532-471e3455fc4a None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:42.394109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91938519-229d-4a18-b532-471e3455fc4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:42.394688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91938519-229d-4a18-b532-471e3455fc4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:42.395790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91938519-229d-4a18-b532-471e3455fc4a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:42.405985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 288/579] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:42.407003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91938519-229d-4a18-b532-471e3455fc4a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:42.487108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b124f17-656e-4d24-9f36-2e2d7d39c2fd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:42.516069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91938519-229d-4a18-b532-471e3455fc4a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:42.526472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43ce27-0594-4de9-b7d1-3b2c67e54bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:42.527281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43ce27-0594-4de9-b7d1-3b2c67e54bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:42.527565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43ce27-0594-4de9-b7d1-3b2c67e54bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:42.527848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43ce27-0594-4de9-b7d1-3b2c67e54bc2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:42.530699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:42.536867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43ce27-0594-4de9-b7d1-3b2c67e54bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:42.539064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43ce27-0594-4de9-b7d1-3b2c67e54bc2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:42.541026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:42.554322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ca533-7ee9-4521-93aa-177e0f8af8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:42.554984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ca533-7ee9-4521-93aa-177e0f8af8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:42.555267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ca533-7ee9-4521-93aa-177e0f8af8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:42.555541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ca533-7ee9-4521-93aa-177e0f8af8c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:42.556320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ca533-7ee9-4521-93aa-177e0f8af8c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:42.556626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ca533-7ee9-4521-93aa-177e0f8af8c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-be43ce27-0594-4de9-b7d1-3b2c67e54bc2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:42.557110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:42.557994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:42.564278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:42.564278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:42.564278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:42.564278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:42.564278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:42.564278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:42.564278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:42.564278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:42.564278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 12:10:42.564278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:42.564842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ca533-7ee9-4521-93aa-177e0f8af8c4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:42.564920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 292/580] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:42.564920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43ce27-0594-4de9-b7d1-3b2c67e54bc2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:42.569358 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 289/581] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:42.570609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ca533-7ee9-4521-93aa-177e0f8af8c4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:42.672997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43ce27-0594-4de9-b7d1-3b2c67e54bc2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:42.678341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ca533-7ee9-4521-93aa-177e0f8af8c4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:42.710258 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fa2e5-83a2-4ea3-9221-8be1d4a98030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:42.711069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa2e5-83a2-4ea3-9221-8be1d4a98030 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:42.711377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa2e5-83a2-4ea3-9221-8be1d4a98030 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:42.711732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa2e5-83a2-4ea3-9221-8be1d4a98030 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:42.712620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fa2e5-83a2-4ea3-9221-8be1d4a98030 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:42.713006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fa2e5-83a2-4ea3-9221-8be1d4a98030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:42.714544 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fa2e5-83a2-4ea3-9221-8be1d4a98030 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:42.714660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567c7b5-e0de-4da9-96d5-8deacf1afffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:42.715472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567c7b5-e0de-4da9-96d5-8deacf1afffd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:42.715832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567c7b5-e0de-4da9-96d5-8deacf1afffd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:42.716210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567c7b5-e0de-4da9-96d5-8deacf1afffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:42.727635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567c7b5-e0de-4da9-96d5-8deacf1afffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:42.732644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 293/582] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:42.732644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fa2e5-83a2-4ea3-9221-8be1d4a98030 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:42.732890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567c7b5-e0de-4da9-96d5-8deacf1afffd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-1567c7b5-e0de-4da9-96d5-8deacf1afffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:42.750514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:42.751605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:42.752631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:42.752631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:42.752631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:42.752631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:42.752631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 290/583] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:42.753219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567c7b5-e0de-4da9-96d5-8deacf1afffd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:42.783973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:42.802659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:42.849811 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fa2e5-83a2-4ea3-9221-8be1d4a98030 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:42.872066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567c7b5-e0de-4da9-96d5-8deacf1afffd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:42.890633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05932be5-f5e2-40ec-8d51-d59b5511dd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:42.891302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932be5-f5e2-40ec-8d51-d59b5511dd84 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:42.891588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932be5-f5e2-40ec-8d51-d59b5511dd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:42.891863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932be5-f5e2-40ec-8d51-d59b5511dd84 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:42.893228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05932be5-f5e2-40ec-8d51-d59b5511dd84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:42.893691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05932be5-f5e2-40ec-8d51-d59b5511dd84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:42.895135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05932be5-f5e2-40ec-8d51-d59b5511dd84 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:42.906786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388f9f6-fe94-4b77-813e-cf2c496572ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:42.907572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f9f6-fe94-4b77-813e-cf2c496572ed None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:42.907855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f9f6-fe94-4b77-813e-cf2c496572ed None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:42.908159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f9f6-fe94-4b77-813e-cf2c496572ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:42.919902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 294/584] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 12:10:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:42.919902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05932be5-f5e2-40ec-8d51-d59b5511dd84 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:42.925092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388f9f6-fe94-4b77-813e-cf2c496572ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:42.926712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388f9f6-fe94-4b77-813e-cf2c496572ed None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-5388f9f6-fe94-4b77-813e-cf2c496572ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:42.949326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:42.950236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:42.951154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:42.951154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:42.951154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:42.951154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:42.952176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 291/585] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:42.952986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388f9f6-fe94-4b77-813e-cf2c496572ed None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:43.027007 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05932be5-f5e2-40ec-8d51-d59b5511dd84 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:43.044870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:43.048415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:43.065887 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc944b-8b35-4e4b-a213-0bdfbd273d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:43.066571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc944b-8b35-4e4b-a213-0bdfbd273d68 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:43.066931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc944b-8b35-4e4b-a213-0bdfbd273d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:43.067283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc944b-8b35-4e4b-a213-0bdfbd273d68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:43.068227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc944b-8b35-4e4b-a213-0bdfbd273d68 None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=254b5c1a59e94596bf942192b4a30ac0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:43.068684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc944b-8b35-4e4b-a213-0bdfbd273d68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:43.070702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc944b-8b35-4e4b-a213-0bdfbd273d68 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:43.071312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388f9f6-fe94-4b77-813e-cf2c496572ed None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:43.088052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 295/586] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:42 2022] GET /identity/v3/role_assignments?user.id=254b5c1a59e94596bf942192b4a30ac0&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:43.088052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc944b-8b35-4e4b-a213-0bdfbd273d68 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:43.122464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16ef2c-61b8-4ab8-9fcb-ba31b2840723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:43.123154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16ef2c-61b8-4ab8-9fcb-ba31b2840723 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:43.123443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16ef2c-61b8-4ab8-9fcb-ba31b2840723 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:43.123725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16ef2c-61b8-4ab8-9fcb-ba31b2840723 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:43.124524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16ef2c-61b8-4ab8-9fcb-ba31b2840723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:43.124847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16ef2c-61b8-4ab8-9fcb-ba31b2840723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:43.126280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16ef2c-61b8-4ab8-9fcb-ba31b2840723 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:43.141545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 292/587] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:43.142198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16ef2c-61b8-4ab8-9fcb-ba31b2840723 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:43.235582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc944b-8b35-4e4b-a213-0bdfbd273d68 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:43.270868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16ef2c-61b8-4ab8-9fcb-ba31b2840723 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:43.277031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f429a-a87f-4a08-abb3-d1cfacf9eacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:43.278189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f429a-a87f-4a08-abb3-d1cfacf9eacc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:43.278625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f429a-a87f-4a08-abb3-d1cfacf9eacc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:43.279052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f429a-a87f-4a08-abb3-d1cfacf9eacc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:43.291002 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f429a-a87f-4a08-abb3-d1cfacf9eacc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:43.292696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f429a-a87f-4a08-abb3-d1cfacf9eacc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-4c4f429a-a87f-4a08-abb3-d1cfacf9eacc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:43.310921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:43.312030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:43.313141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:43.313141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:43.313141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:43.313141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:43.313409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98959a1f-d0ec-4742-a7f1-484335e13974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:43.313409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98959a1f-d0ec-4742-a7f1-484335e13974 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:43.313409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98959a1f-d0ec-4742-a7f1-484335e13974 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:43.313409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98959a1f-d0ec-4742-a7f1-484335e13974 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:43.313829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98959a1f-d0ec-4742-a7f1-484335e13974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:43.314137 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98959a1f-d0ec-4742-a7f1-484335e13974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:43.315498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98959a1f-d0ec-4742-a7f1-484335e13974 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:43.315858 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 296/588] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:43.317067 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f429a-a87f-4a08-abb3-d1cfacf9eacc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:43.326106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:43.335128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 293/589] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:43.336190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98959a1f-d0ec-4742-a7f1-484335e13974 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:43.354036 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:43.429354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f429a-a87f-4a08-abb3-d1cfacf9eacc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:43.469652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1066f-427b-43bc-8435-f1ac95b260f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:43.470458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1066f-427b-43bc-8435-f1ac95b260f8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:43.470744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1066f-427b-43bc-8435-f1ac95b260f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:43.471024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1066f-427b-43bc-8435-f1ac95b260f8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:43.479152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98959a1f-d0ec-4742-a7f1-484335e13974 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:43.481124 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1066f-427b-43bc-8435-f1ac95b260f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:43.482679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1066f-427b-43bc-8435-f1ac95b260f8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-05e1066f-427b-43bc-8435-f1ac95b260f8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:43.497542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:43.498765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 297/590] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:43.499929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1066f-427b-43bc-8435-f1ac95b260f8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:43.524745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e00d4b-9ef2-41fb-a3af-659535b2c5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:43.525517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00d4b-9ef2-41fb-a3af-659535b2c5bc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:43.525883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00d4b-9ef2-41fb-a3af-659535b2c5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:43.526401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00d4b-9ef2-41fb-a3af-659535b2c5bc None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:43.527512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e00d4b-9ef2-41fb-a3af-659535b2c5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:43.527911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e00d4b-9ef2-41fb-a3af-659535b2c5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:43.529414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e00d4b-9ef2-41fb-a3af-659535b2c5bc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:43.547473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 294/591] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:43.548531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e00d4b-9ef2-41fb-a3af-659535b2c5bc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:43.622419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:43.632010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1066f-427b-43bc-8435-f1ac95b260f8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:43.638484 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:43.673618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46c3d9-e18f-4ef0-93fb-db17ce039e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:43.674593 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46c3d9-e18f-4ef0-93fb-db17ce039e5c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:43.674981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46c3d9-e18f-4ef0-93fb-db17ce039e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:43.675356 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46c3d9-e18f-4ef0-93fb-db17ce039e5c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:43.683288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46c3d9-e18f-4ef0-93fb-db17ce039e5c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:43.684940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46c3d9-e18f-4ef0-93fb-db17ce039e5c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:43.694710 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e00d4b-9ef2-41fb-a3af-659535b2c5bc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3b46c3d9-e18f-4ef0-93fb-db17ce039e5c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:43.704088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:43.705227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:43.706374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:43.706374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:43.706374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:43.706374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:43.706374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:43.706374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:43.706374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:43.706374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:43.706374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 12:10:43.706374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:43.706374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 298/592] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:43.707093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46c3d9-e18f-4ef0-93fb-db17ce039e5c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:43.741366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2f0ac-eba7-40bc-958d-f3408ec95c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:43.742046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2f0ac-eba7-40bc-958d-f3408ec95c38 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:43.742334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2f0ac-eba7-40bc-958d-f3408ec95c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:43.742617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2f0ac-eba7-40bc-958d-f3408ec95c38 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:43.743477 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2f0ac-eba7-40bc-958d-f3408ec95c38 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:43.743794 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2f0ac-eba7-40bc-958d-f3408ec95c38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:43.745444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2f0ac-eba7-40bc-958d-f3408ec95c38 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:43.769153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 295/593] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 12:10:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:43.770087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2f0ac-eba7-40bc-958d-f3408ec95c38 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:43.831382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46c3d9-e18f-4ef0-93fb-db17ce039e5c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:43.871312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf336c-1424-41ba-8107-20f5d2f7e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:43.872308 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf336c-1424-41ba-8107-20f5d2f7e951 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:43.872757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf336c-1424-41ba-8107-20f5d2f7e951 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:43.873081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf336c-1424-41ba-8107-20f5d2f7e951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:43.873762 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2f0ac-eba7-40bc-958d-f3408ec95c38 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:43.880981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf336c-1424-41ba-8107-20f5d2f7e951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:43.882764 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf336c-1424-41ba-8107-20f5d2f7e951 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:43.892637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e4cf336c-1424-41ba-8107-20f5d2f7e951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:43.902054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:43.902979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:43.903854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:43.903854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:43.903854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:43.903854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:43.903854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:43.903854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:43.903854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:43.903854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:43.906777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 299/594] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:43.907881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf336c-1424-41ba-8107-20f5d2f7e951 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:43.910642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a5a9d-2372-4e0c-85f1-6efce0cdc0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:43.911562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a5a9d-2372-4e0c-85f1-6efce0cdc0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:43.911855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a5a9d-2372-4e0c-85f1-6efce0cdc0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:43.912188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a5a9d-2372-4e0c-85f1-6efce0cdc0c9 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:43.913126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a5a9d-2372-4e0c-85f1-6efce0cdc0c9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:43.913429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a5a9d-2372-4e0c-85f1-6efce0cdc0c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:43.914867 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a5a9d-2372-4e0c-85f1-6efce0cdc0c9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:43.926470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:43.933153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 296/595] 10.222.0.66 () {56 vars in 1139 bytes} [Wed Jun 22 12:10:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:43.933986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a5a9d-2372-4e0c-85f1-6efce0cdc0c9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:44.025466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf336c-1424-41ba-8107-20f5d2f7e951 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:44.036479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a5a9d-2372-4e0c-85f1-6efce0cdc0c9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:44.072043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba687-a13c-4f61-b95b-1dd1b3898f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:44.072043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba687-a13c-4f61-b95b-1dd1b3898f97 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.072043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba687-a13c-4f61-b95b-1dd1b3898f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.072043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba687-a13c-4f61-b95b-1dd1b3898f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.072782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa0a2-67ff-40bb-9fa5-5e015c4cfccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:44.073415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa0a2-67ff-40bb-9fa5-5e015c4cfccf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.073532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa0a2-67ff-40bb-9fa5-5e015c4cfccf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.073735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa0a2-67ff-40bb-9fa5-5e015c4cfccf None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.074536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efa0a2-67ff-40bb-9fa5-5e015c4cfccf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:44.074854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efa0a2-67ff-40bb-9fa5-5e015c4cfccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:44.076328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efa0a2-67ff-40bb-9fa5-5e015c4cfccf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:44.082876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba687-a13c-4f61-b95b-1dd1b3898f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:44.084669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba687-a13c-4f61-b95b-1dd1b3898f97 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:44.088941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 297/596] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:44.089854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa0a2-67ff-40bb-9fa5-5e015c4cfccf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-cc9ba687-a13c-4f61-b95b-1dd1b3898f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:44.104769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:44.105713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:44.106592 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:44.106592 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:44.106592 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:44.106592 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:44.108796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 300/597] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:44.109818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba687-a13c-4f61-b95b-1dd1b3898f97 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:44.131268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:44.178007 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:44.204471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa0a2-67ff-40bb-9fa5-5e015c4cfccf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:44.217820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba687-a13c-4f61-b95b-1dd1b3898f97 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:44.242054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72be5d8-ce1b-4b15-a309-db676b88d115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:44.242859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be5d8-ce1b-4b15-a309-db676b88d115 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.243143 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be5d8-ce1b-4b15-a309-db676b88d115 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.243424 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be5d8-ce1b-4b15-a309-db676b88d115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.254491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72be5d8-ce1b-4b15-a309-db676b88d115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:44.255474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687891f-857d-432b-9035-87816d03ff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:44.255983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72be5d8-ce1b-4b15-a309-db676b88d115 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:44.256587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687891f-857d-432b-9035-87816d03ff71 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.256912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687891f-857d-432b-9035-87816d03ff71 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.257253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687891f-857d-432b-9035-87816d03ff71 None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/d82125a47ce044b389684b97c7097ebe/roles/14d046a572664f94934f225e9a3f3b64` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.273260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687891f-857d-432b-9035-87816d03ff71 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=d82125a47ce044b389684b97c7097ebe, role_id=14d046a572664f94934f225e9a3f3b64)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:44.274855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687891f-857d-432b-9035-87816d03ff71 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f72be5d8-ce1b-4b15-a309-db676b88d115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:44.275847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:44.281929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:44.283054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:44.283054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:44.283054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:44.283054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:44.283054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 298/598] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:44.283054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72be5d8-ce1b-4b15-a309-db676b88d115 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:44.296271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 301/599] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:10:44 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/d82125a47ce044b389684b97c7097ebe/roles/14d046a572664f94934f225e9a3f3b64 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:44.297471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c676f0-faba-40df-a616-9d37ff81adf1 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.297764 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c676f0-faba-40df-a616-9d37ff81adf1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.298047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c676f0-faba-40df-a616-9d37ff81adf1 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.299576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 302/600] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:44.300367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c676f0-faba-40df-a616-9d37ff81adf1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:44.384823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:44.401854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72be5d8-ce1b-4b15-a309-db676b88d115 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:44.444574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a48f4-4474-45dc-9e12-af2864923c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:44.445648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a48f4-4474-45dc-9e12-af2864923c18 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.446119 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a48f4-4474-45dc-9e12-af2864923c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.446577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a48f4-4474-45dc-9e12-af2864923c18 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.447514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a48f4-4474-45dc-9e12-af2864923c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:44.448062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a48f4-4474-45dc-9e12-af2864923c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:44.449665 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a48f4-4474-45dc-9e12-af2864923c18 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:44.461050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c676f0-faba-40df-a616-9d37ff81adf1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:44.471476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 299/601] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:44.471476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f22377-8123-4f4c-8a05-d038099a230d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.471476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f22377-8123-4f4c-8a05-d038099a230d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.471476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f22377-8123-4f4c-8a05-d038099a230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.489845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:44.497055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b3f22377-8123-4f4c-8a05-d038099a230d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:44.498265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b3f22377-8123-4f4c-8a05-d038099a230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:44.516832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a87338-518f-4767-ae63-79b5e92f7b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:44.517515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a87338-518f-4767-ae63-79b5e92f7b33 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.517804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a87338-518f-4767-ae63-79b5e92f7b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.518086 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a87338-518f-4767-ae63-79b5e92f7b33 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.518821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a87338-518f-4767-ae63-79b5e92f7b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:44.519135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a87338-518f-4767-ae63-79b5e92f7b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:44.520569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a87338-518f-4767-ae63-79b5e92f7b33 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:44.535296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 303/602] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:44.535296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a87338-518f-4767-ae63-79b5e92f7b33 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:44.582790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 300/603] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:44.584101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f22377-8123-4f4c-8a05-d038099a230d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:44.665288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a87338-518f-4767-ae63-79b5e92f7b33 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:44.676172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:44.700683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f22377-8123-4f4c-8a05-d038099a230d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:44.713495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab1f64-8530-49bd-b38c-85b2938eb2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:44.714718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1f64-8530-49bd-b38c-85b2938eb2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.715094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1f64-8530-49bd-b38c-85b2938eb2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.715483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1f64-8530-49bd-b38c-85b2938eb2e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.725961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab1f64-8530-49bd-b38c-85b2938eb2e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:44.728247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab1f64-8530-49bd-b38c-85b2938eb2e3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:44.739165 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c2b52-a1d7-4a30-b084-99deb72dbe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:44.740252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c2b52-a1d7-4a30-b084-99deb72dbe2d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.740682 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c2b52-a1d7-4a30-b084-99deb72dbe2d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.741635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c2b52-a1d7-4a30-b084-99deb72dbe2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d8ab1f64-8530-49bd-b38c-85b2938eb2e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:44.747609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:44.748761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:44.749849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:44.749849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:44.749849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:44.749849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:44.749849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:44.749849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:44.749849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:44.749849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:44.751936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 304/604] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:44.752317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c2b52-a1d7-4a30-b084-99deb72dbe2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:44.752920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab1f64-8530-49bd-b38c-85b2938eb2e3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:44.754162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c2b52-a1d7-4a30-b084-99deb72dbe2d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-9f8c2b52-a1d7-4a30-b084-99deb72dbe2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:44.770017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:44.771134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:44.772354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:44.772354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:44.772354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:44.772354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:44.772354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:44.772354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:44.772354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:44.772354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:44.774222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 301/605] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:44.775168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c2b52-a1d7-4a30-b084-99deb72dbe2d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:44.795969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:44.876850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab1f64-8530-49bd-b38c-85b2938eb2e3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:44.914684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0ac9e-c1f7-4d88-922e-28dc25e8a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:44.915854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ac9e-c1f7-4d88-922e-28dc25e8a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.916329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ac9e-c1f7-4d88-922e-28dc25e8a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.916754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ac9e-c1f7-4d88-922e-28dc25e8a5e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.920302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c2b52-a1d7-4a30-b084-99deb72dbe2d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:44.928733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0ac9e-c1f7-4d88-922e-28dc25e8a5e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-32b0ac9e-c1f7-4d88-922e-28dc25e8a5e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:44.936917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:44.938055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:44.939087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:44.941494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 305/606] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:44.942453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0ac9e-c1f7-4d88-922e-28dc25e8a5e8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:44.963010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14e6a0-0f61-471b-8fa1-8da393f2ba3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:44.963999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14e6a0-0f61-471b-8fa1-8da393f2ba3e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:44.964447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14e6a0-0f61-471b-8fa1-8da393f2ba3e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:44.964870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14e6a0-0f61-471b-8fa1-8da393f2ba3e None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:44.965837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14e6a0-0f61-471b-8fa1-8da393f2ba3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:44.966281 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14e6a0-0f61-471b-8fa1-8da393f2ba3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:44.967998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14e6a0-0f61-471b-8fa1-8da393f2ba3e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:44.976827 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:44.984333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 302/607] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:44.985542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14e6a0-0f61-471b-8fa1-8da393f2ba3e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:45.055457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:45.063184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0ac9e-c1f7-4d88-922e-28dc25e8a5e8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:45.094225 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14e6a0-0f61-471b-8fa1-8da393f2ba3e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:45.099288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37633981-2029-4cbe-a6df-0c9e11146c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:45.100092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37633981-2029-4cbe-a6df-0c9e11146c89 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:45.101032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37633981-2029-4cbe-a6df-0c9e11146c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:45.101415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37633981-2029-4cbe-a6df-0c9e11146c89 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:45.102319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37633981-2029-4cbe-a6df-0c9e11146c89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:45.102728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37633981-2029-4cbe-a6df-0c9e11146c89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:45.104284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37633981-2029-4cbe-a6df-0c9e11146c89 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:45.118053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 306/608] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:45.119020 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37633981-2029-4cbe-a6df-0c9e11146c89 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:45.134008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15180bc2-2c2e-4ad8-9d35-8a598ca00749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:45.134971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15180bc2-2c2e-4ad8-9d35-8a598ca00749 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:45.135403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15180bc2-2c2e-4ad8-9d35-8a598ca00749 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:45.135855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15180bc2-2c2e-4ad8-9d35-8a598ca00749 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:45.136868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15180bc2-2c2e-4ad8-9d35-8a598ca00749 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:45.137357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15180bc2-2c2e-4ad8-9d35-8a598ca00749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:45.138944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15180bc2-2c2e-4ad8-9d35-8a598ca00749 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:45.149338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 303/609] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:45.150443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15180bc2-2c2e-4ad8-9d35-8a598ca00749 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:45.214248 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:45.227840 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37633981-2029-4cbe-a6df-0c9e11146c89 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:45.265501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15180bc2-2c2e-4ad8-9d35-8a598ca00749 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:45.267842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88ecbe-a6fe-4370-bc2d-a598887aaa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:45.268786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88ecbe-a6fe-4370-bc2d-a598887aaa3f None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:45.269079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88ecbe-a6fe-4370-bc2d-a598887aaa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:45.269357 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88ecbe-a6fe-4370-bc2d-a598887aaa3f None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/eeb4a8bcbc374f139db9e6e134b6d681/roles/14d046a572664f94934f225e9a3f3b64` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:45.284329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88ecbe-a6fe-4370-bc2d-a598887aaa3f None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=eeb4a8bcbc374f139db9e6e134b6d681, role_id=14d046a572664f94934f225e9a3f3b64)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:45.285789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88ecbe-a6fe-4370-bc2d-a598887aaa3f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:45.299954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 307/610] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:10:45 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/eeb4a8bcbc374f139db9e6e134b6d681/roles/14d046a572664f94934f225e9a3f3b64 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:45.300900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88ecbe-a6fe-4370-bc2d-a598887aaa3f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:45.302315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff69d1d-7788-4a3b-b9c9-8e43ee3f4b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:45.303216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff69d1d-7788-4a3b-b9c9-8e43ee3f4b8c None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:45.304137 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff69d1d-7788-4a3b-b9c9-8e43ee3f4b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:45.304371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff69d1d-7788-4a3b-b9c9-8e43ee3f4b8c None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/b37002ecc6384dc08fca3ddf6ca2f9e2/roles/14d046a572664f94934f225e9a3f3b64` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:45.313401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:45.323707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff69d1d-7788-4a3b-b9c9-8e43ee3f4b8c None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=b37002ecc6384dc08fca3ddf6ca2f9e2, role_id=14d046a572664f94934f225e9a3f3b64)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:45.326047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff69d1d-7788-4a3b-b9c9-8e43ee3f4b8c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:45.344851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 304/611] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:10:45 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/b37002ecc6384dc08fca3ddf6ca2f9e2/roles/14d046a572664f94934f225e9a3f3b64 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:45.346680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6458361-1d84-40c3-b2c0-fd8c44095f55 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:45.347177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6458361-1d84-40c3-b2c0-fd8c44095f55 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:45.347658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6458361-1d84-40c3-b2c0-fd8c44095f55 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:45.349641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 305/612] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:45.362841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ab85-1395-40ed-8103-e7621f537bd6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:45.363200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ab85-1395-40ed-8103-e7621f537bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:45.363429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ab85-1395-40ed-8103-e7621f537bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:45.388908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b0b8ab85-1395-40ed-8103-e7621f537bd6 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:45.390870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b0b8ab85-1395-40ed-8103-e7621f537bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:45.483031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88ecbe-a6fe-4370-bc2d-a598887aaa3f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:45.529411 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c8d0c-5a1c-40b5-be7c-37561e411c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:45.530241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c8d0c-5a1c-40b5-be7c-37561e411c63 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:45.530527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c8d0c-5a1c-40b5-be7c-37561e411c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:45.530800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c8d0c-5a1c-40b5-be7c-37561e411c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:45.546876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c8d0c-5a1c-40b5-be7c-37561e411c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:45.548413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c8d0c-5a1c-40b5-be7c-37561e411c63 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:45.548893 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 306/613] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e04c8d0c-5a1c-40b5-be7c-37561e411c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:45.568525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:45.569601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:45.570493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:45.570493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:45.570493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:45.570493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:45.572410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8ab85-1395-40ed-8103-e7621f537bd6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:45.579362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 308/614] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:45.584848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c8d0c-5a1c-40b5-be7c-37561e411c63 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:45.625355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:45.646272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:45.695131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8ab85-1395-40ed-8103-e7621f537bd6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:45.695371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c8d0c-5a1c-40b5-be7c-37561e411c63 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:45.731225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24d233-43ac-4ef3-9c04-7014047bc8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:45.736108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24d233-43ac-4ef3-9c04-7014047bc8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:45.736108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24d233-43ac-4ef3-9c04-7014047bc8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:45.736108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24d233-43ac-4ef3-9c04-7014047bc8d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:45.736108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24d233-43ac-4ef3-9c04-7014047bc8d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:45.736108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24d233-43ac-4ef3-9c04-7014047bc8d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:45.736108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24d233-43ac-4ef3-9c04-7014047bc8d7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:45.738504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77205be9-4b69-4e9a-ae08-68a0b907924d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:45.739498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205be9-4b69-4e9a-ae08-68a0b907924d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:45.739927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205be9-4b69-4e9a-ae08-68a0b907924d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:45.740370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205be9-4b69-4e9a-ae08-68a0b907924d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:45.752127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 309/615] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:45.755117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24d233-43ac-4ef3-9c04-7014047bc8d7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:45.764838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77205be9-4b69-4e9a-ae08-68a0b907924d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-77205be9-4b69-4e9a-ae08-68a0b907924d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:45.782283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:45.783453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:45.784556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 307/616] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:45.790032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77205be9-4b69-4e9a-ae08-68a0b907924d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:45.886989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24d233-43ac-4ef3-9c04-7014047bc8d7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:45.911570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:45.949943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe97a83-30bb-4ad1-a01b-c2fb43262b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:45.951755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe97a83-30bb-4ad1-a01b-c2fb43262b23 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:45.953163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe97a83-30bb-4ad1-a01b-c2fb43262b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:45.953543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe97a83-30bb-4ad1-a01b-c2fb43262b23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:45.955290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:45.960910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77205be9-4b69-4e9a-ae08-68a0b907924d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:45.969390 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe97a83-30bb-4ad1-a01b-c2fb43262b23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:45.975900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe97a83-30bb-4ad1-a01b-c2fb43262b23 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6fe97a83-30bb-4ad1-a01b-c2fb43262b23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:45.997494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:45.998656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:45.999815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:45.999815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:45.999815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:45.999815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:45.999815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:45.999815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:45.999815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:45.999815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:45.999815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:10:45.999815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:46.001768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 310/617] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 12:10:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:46.009199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe97a83-30bb-4ad1-a01b-c2fb43262b23 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:46.029676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcecac-80c9-4d28-9868-dd902f51c870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:46.030609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcecac-80c9-4d28-9868-dd902f51c870 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:46.031078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcecac-80c9-4d28-9868-dd902f51c870 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:46.031502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcecac-80c9-4d28-9868-dd902f51c870 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:46.032450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcecac-80c9-4d28-9868-dd902f51c870 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:46.032907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcecac-80c9-4d28-9868-dd902f51c870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:46.034519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcecac-80c9-4d28-9868-dd902f51c870 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:46.054897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 308/618] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:46.061220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcecac-80c9-4d28-9868-dd902f51c870 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:46.144160 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe97a83-30bb-4ad1-a01b-c2fb43262b23 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:46.184510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194e40d-19c3-45fc-bff1-88fb127a4ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:46.185188 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194e40d-19c3-45fc-bff1-88fb127a4ebe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:46.185516 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194e40d-19c3-45fc-bff1-88fb127a4ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:46.185795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194e40d-19c3-45fc-bff1-88fb127a4ebe None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:46.186635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194e40d-19c3-45fc-bff1-88fb127a4ebe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:46.186944 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194e40d-19c3-45fc-bff1-88fb127a4ebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:46.188402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194e40d-19c3-45fc-bff1-88fb127a4ebe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:46.207829 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 311/619] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 12:10:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:46.213274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194e40d-19c3-45fc-bff1-88fb127a4ebe None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:46.257970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcecac-80c9-4d28-9868-dd902f51c870 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:46.278257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:46.347143 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897a0c3-707a-453a-8507-23c59f132a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:46.348033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897a0c3-707a-453a-8507-23c59f132a72 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:46.348324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897a0c3-707a-453a-8507-23c59f132a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:46.348602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897a0c3-707a-453a-8507-23c59f132a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:46.358695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194e40d-19c3-45fc-bff1-88fb127a4ebe None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:46.371346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897a0c3-707a-453a-8507-23c59f132a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:46.372846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897a0c3-707a-453a-8507-23c59f132a72 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-0897a0c3-707a-453a-8507-23c59f132a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:46.405132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:46.406089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:46.406969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:46.406969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:46.406969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:46.406969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:46.406969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 309/620] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:46.421443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897a0c3-707a-453a-8507-23c59f132a72 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:46.433207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7347454-4532-468b-9129-422ad15d8b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:46.433873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347454-4532-468b-9129-422ad15d8b6d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:46.434157 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347454-4532-468b-9129-422ad15d8b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:46.434436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347454-4532-468b-9129-422ad15d8b6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:46.453617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:46.554252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897a0c3-707a-453a-8507-23c59f132a72 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:46.591754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7347454-4532-468b-9129-422ad15d8b6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:46.593257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7347454-4532-468b-9129-422ad15d8b6d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:46.601254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9c4cf-ac9c-4c20-b64f-5c4adf18e653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:46.602593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9c4cf-ac9c-4c20-b64f-5c4adf18e653 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:46.603026 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9c4cf-ac9c-4c20-b64f-5c4adf18e653 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:46.603445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9c4cf-ac9c-4c20-b64f-5c4adf18e653 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:46.604692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9c4cf-ac9c-4c20-b64f-5c4adf18e653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:46.605162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9c4cf-ac9c-4c20-b64f-5c4adf18e653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:46.607322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9c4cf-ac9c-4c20-b64f-5c4adf18e653 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:46.628103 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 310/621] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:46.630279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac530c-d37e-4f45-b107-06f7a5060141 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:46.630715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac530c-d37e-4f45-b107-06f7a5060141 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:46.631137 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac530c-d37e-4f45-b107-06f7a5060141 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:46.631708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:46.633161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 311/622] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:46.634909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac530c-d37e-4f45-b107-06f7a5060141 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:46.708065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 312/623] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 12:10:46.708993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12ff4e-999f-4db4-878f-fd9d24ace51c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:46.709416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12ff4e-999f-4db4-878f-fd9d24ace51c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:46.710524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12ff4e-999f-4db4-878f-fd9d24ace51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:46.733344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-dd12ff4e-999f-4db4-878f-fd9d24ace51c None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:46.735147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dd12ff4e-999f-4db4-878f-fd9d24ace51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:46.743271 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:46.780792 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac530c-d37e-4f45-b107-06f7a5060141 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:46.820131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 313/624] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:46.820131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12ff4e-999f-4db4-878f-fd9d24ace51c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:46.840569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ab66-f6bd-46b7-b5d6-37a28f67ec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:46.841607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ab66-f6bd-46b7-b5d6-37a28f67ec43 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:46.841995 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ab66-f6bd-46b7-b5d6-37a28f67ec43 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:46.842381 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ab66-f6bd-46b7-b5d6-37a28f67ec43 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:46.854891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6ab66-f6bd-46b7-b5d6-37a28f67ec43 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:46.856893 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6ab66-f6bd-46b7-b5d6-37a28f67ec43 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-a0a6ab66-f6bd-46b7-b5d6-37a28f67ec43 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:46.872056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:46.873148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:46.874274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:46.874274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:46.874274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:46.874274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:46.874274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:46.874274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:46.874274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:46.874274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:46.874274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:10:46.874274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:46.880062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 312/625] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:10:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:46.880062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ab66-f6bd-46b7-b5d6-37a28f67ec43 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:46.932434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:46.947859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12ff4e-999f-4db4-878f-fd9d24ace51c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:46.984183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bf09f-ec49-4040-991c-8a9bf7057bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:46.985594 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bf09f-ec49-4040-991c-8a9bf7057bae None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:46.986098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bf09f-ec49-4040-991c-8a9bf7057bae None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:46.986623 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bf09f-ec49-4040-991c-8a9bf7057bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:46.998540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bf09f-ec49-4040-991c-8a9bf7057bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:47.000437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bf09f-ec49-4040-991c-8a9bf7057bae None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:47.011525 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ab66-f6bd-46b7-b5d6-37a28f67ec43 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-401bf09f-ec49-4040-991c-8a9bf7057bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:47.020077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:47.020970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:47.021880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:47.021880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:47.021880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:47.021880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:47.025055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 314/626] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:47.026053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bf09f-ec49-4040-991c-8a9bf7057bae None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:47.057594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faec7b9-036f-4788-b18a-bf81f18d8dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:47.058932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec7b9-036f-4788-b18a-bf81f18d8dcc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.059220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec7b9-036f-4788-b18a-bf81f18d8dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.059499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec7b9-036f-4788-b18a-bf81f18d8dcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.061847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:47.073123 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faec7b9-036f-4788-b18a-bf81f18d8dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-6faec7b9-036f-4788-b18a-bf81f18d8dcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:47.083055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:47.084008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:47.084919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:47.089064 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 313/627] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:47.089925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faec7b9-036f-4788-b18a-bf81f18d8dcc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:47.152792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bf09f-ec49-4040-991c-8a9bf7057bae None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:47.176426 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:47.192997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1768e1-e425-4844-9796-8e3b11401d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:47.194679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1768e1-e425-4844-9796-8e3b11401d28 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.195247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1768e1-e425-4844-9796-8e3b11401d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.195860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1768e1-e425-4844-9796-8e3b11401d28 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.196968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1768e1-e425-4844-9796-8e3b11401d28 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:47.197606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1768e1-e425-4844-9796-8e3b11401d28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:47.199415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1768e1-e425-4844-9796-8e3b11401d28 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:47.201152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faec7b9-036f-4788-b18a-bf81f18d8dcc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:47.219821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 315/628] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 12:10:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:47.221105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1768e1-e425-4844-9796-8e3b11401d28 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:47.241253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd9db3-859d-4c75-821d-d40efbf06d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:47.241921 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd9db3-859d-4c75-821d-d40efbf06d1c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.242203 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd9db3-859d-4c75-821d-d40efbf06d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.242478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd9db3-859d-4c75-821d-d40efbf06d1c None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.243206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd9db3-859d-4c75-821d-d40efbf06d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:47.243549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd9db3-859d-4c75-821d-d40efbf06d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:47.244902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd9db3-859d-4c75-821d-d40efbf06d1c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:47.262023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 314/629] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:47.262961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd9db3-859d-4c75-821d-d40efbf06d1c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:47.323042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:47.341056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1768e1-e425-4844-9796-8e3b11401d28 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:47.370826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd9db3-859d-4c75-821d-d40efbf06d1c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:47.380471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e037f22-cd83-47c1-9698-25256f8fda89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:47.381627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037f22-cd83-47c1-9698-25256f8fda89 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.382145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037f22-cd83-47c1-9698-25256f8fda89 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.382687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037f22-cd83-47c1-9698-25256f8fda89 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.383716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e037f22-cd83-47c1-9698-25256f8fda89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:47.384274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e037f22-cd83-47c1-9698-25256f8fda89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:47.386004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e037f22-cd83-47c1-9698-25256f8fda89 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:47.396031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 316/630] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:47.397760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e037f22-cd83-47c1-9698-25256f8fda89 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:47.417472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab69e2-9b21-470b-877c-89de4b9f5b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:47.418398 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab69e2-9b21-470b-877c-89de4b9f5b79 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.418687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab69e2-9b21-470b-877c-89de4b9f5b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.418968 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab69e2-9b21-470b-877c-89de4b9f5b79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.431144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab69e2-9b21-470b-877c-89de4b9f5b79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:47.432630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab69e2-9b21-470b-877c-89de4b9f5b79 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:47.441042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-e2ab69e2-9b21-470b-877c-89de4b9f5b79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:47.453912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:47.454959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:47.456048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:47.456048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:47.456048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:47.456048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:47.462822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 315/631] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:47.464003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab69e2-9b21-470b-877c-89de4b9f5b79 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:47.516391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e037f22-cd83-47c1-9698-25256f8fda89 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:47.552937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facdef4-cd2d-4f04-b991-2efa87bb1c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:47.554471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facdef4-cd2d-4f04-b991-2efa87bb1c91 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.554863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facdef4-cd2d-4f04-b991-2efa87bb1c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.555247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facdef4-cd2d-4f04-b991-2efa87bb1c91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.562754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facdef4-cd2d-4f04-b991-2efa87bb1c91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:47.566141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facdef4-cd2d-4f04-b991-2efa87bb1c91 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2facdef4-cd2d-4f04-b991-2efa87bb1c91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:47.579896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:47.581005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:47.582103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:47.582103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:47.582103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:47.582103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:47.582103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:47.582103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:47.582103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:47.582103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:47.583449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab69e2-9b21-470b-877c-89de4b9f5b79 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:47.589279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 317/632] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:47.589279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facdef4-cd2d-4f04-b991-2efa87bb1c91 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:47.600350 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:47.638802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ed4d9-9d4c-43ba-8762-a0dfc2f261f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:47.639789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ed4d9-9d4c-43ba-8762-a0dfc2f261f5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.640478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ed4d9-9d4c-43ba-8762-a0dfc2f261f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.640903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ed4d9-9d4c-43ba-8762-a0dfc2f261f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.654394 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ed4d9-9d4c-43ba-8762-a0dfc2f261f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:47.656506 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ed4d9-9d4c-43ba-8762-a0dfc2f261f5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-430ed4d9-9d4c-43ba-8762-a0dfc2f261f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:47.679887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:47.681048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:47.682074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:47.682074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:47.682074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:47.682074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:47.688319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 316/633] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:47.689475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ed4d9-9d4c-43ba-8762-a0dfc2f261f5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:47.714205 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:47.721692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facdef4-cd2d-4f04-b991-2efa87bb1c91 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:47.758459 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f889d38-d4e6-497f-b196-7f1d70c85cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:47.759138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f889d38-d4e6-497f-b196-7f1d70c85cbe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.759423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f889d38-d4e6-497f-b196-7f1d70c85cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.759703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f889d38-d4e6-497f-b196-7f1d70c85cbe None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.760467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f889d38-d4e6-497f-b196-7f1d70c85cbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:47.760776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f889d38-d4e6-497f-b196-7f1d70c85cbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:47.762156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f889d38-d4e6-497f-b196-7f1d70c85cbe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:47.774755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 318/634] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:47.775589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f889d38-d4e6-497f-b196-7f1d70c85cbe None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:47.796768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ed4d9-9d4c-43ba-8762-a0dfc2f261f5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:47.830962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf35d3-2a61-48b7-bdc3-3336ceb08d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:47.831658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf35d3-2a61-48b7-bdc3-3336ceb08d35 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.831939 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf35d3-2a61-48b7-bdc3-3336ceb08d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.832240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf35d3-2a61-48b7-bdc3-3336ceb08d35 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.833038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf35d3-2a61-48b7-bdc3-3336ceb08d35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:47.833351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf35d3-2a61-48b7-bdc3-3336ceb08d35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:47.834817 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf35d3-2a61-48b7-bdc3-3336ceb08d35 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:47.846179 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 317/635] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:47.847489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4428f18-ac89-41cf-bab4-af09083fc8f2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.847784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4428f18-ac89-41cf-bab4-af09083fc8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.848102 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4428f18-ac89-41cf-bab4-af09083fc8f2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.849497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 318/636] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:47.851150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a2805-1351-4531-8481-ceafe24d9fdd None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.852003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a2805-1351-4531-8481-ceafe24d9fdd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.852003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a2805-1351-4531-8481-ceafe24d9fdd None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.856055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 319/637] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:47.856055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a2805-1351-4531-8481-ceafe24d9fdd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:47.877169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:47.879446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f889d38-d4e6-497f-b196-7f1d70c85cbe None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:47.913985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97c091-85b0-43b5-8a5a-b5f4369ecead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:47.914657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97c091-85b0-43b5-8a5a-b5f4369ecead None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:47.914934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97c091-85b0-43b5-8a5a-b5f4369ecead None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:47.915211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97c091-85b0-43b5-8a5a-b5f4369ecead None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:47.915934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97c091-85b0-43b5-8a5a-b5f4369ecead None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:47.916273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97c091-85b0-43b5-8a5a-b5f4369ecead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:47.917651 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97c091-85b0-43b5-8a5a-b5f4369ecead None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:47.929255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 319/638] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:47.930043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97c091-85b0-43b5-8a5a-b5f4369ecead None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:47.947453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:47.965814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a2805-1351-4531-8481-ceafe24d9fdd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:47.999928 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b229d-cfb5-4073-9118-896351a0a88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:48.000754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b229d-cfb5-4073-9118-896351a0a88a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.001034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b229d-cfb5-4073-9118-896351a0a88a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.001309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b229d-cfb5-4073-9118-896351a0a88a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.008330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b229d-cfb5-4073-9118-896351a0a88a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:48.009787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b229d-cfb5-4073-9118-896351a0a88a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-006b229d-cfb5-4073-9118-896351a0a88a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:48.024149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:48.025193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:48.026244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:48.026244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:48.026244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:48.026244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:48.026244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:48.026244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:48.026244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:48.026244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:48.028340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 320/639] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:48.029255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97c091-85b0-43b5-8a5a-b5f4369ecead None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:48.029638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ce95-513d-489a-a1d0-55890675ad24 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.029982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ce95-513d-489a-a1d0-55890675ad24 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.030278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ce95-513d-489a-a1d0-55890675ad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.048150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9856ce95-513d-489a-a1d0-55890675ad24 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:48.049464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9856ce95-513d-489a-a1d0-55890675ad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:48.072590 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e330ad2-9ae5-4c9f-9fec-da60a1e9029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:48.073247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e330ad2-9ae5-4c9f-9fec-da60a1e9029e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.073536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e330ad2-9ae5-4c9f-9fec-da60a1e9029e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.073820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e330ad2-9ae5-4c9f-9fec-da60a1e9029e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.074670 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e330ad2-9ae5-4c9f-9fec-da60a1e9029e None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=1df703568a334eea9550ac643d87b5fe) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:48.074991 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e330ad2-9ae5-4c9f-9fec-da60a1e9029e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:48.076484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e330ad2-9ae5-4c9f-9fec-da60a1e9029e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:48.082812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 320/640] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:47 2022] GET /identity/v3/role_assignments?user.id=1df703568a334eea9550ac643d87b5fe&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:48.083760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443d16-fb27-4921-b9c2-8693161e69d2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.084073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443d16-fb27-4921-b9c2-8693161e69d2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.084357 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443d16-fb27-4921-b9c2-8693161e69d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.104885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8e443d16-fb27-4921-b9c2-8693161e69d2 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:48.106063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8e443d16-fb27-4921-b9c2-8693161e69d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:48.134832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 321/641] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:48.135632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856ce95-513d-489a-a1d0-55890675ad24 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:48.149195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:48.196716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 321/642] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:48.197470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e443d16-fb27-4921-b9c2-8693161e69d2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:48.220486 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:48.265605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856ce95-513d-489a-a1d0-55890675ad24 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:48.305573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2e13f-4f1f-495c-b124-0c6b3fe8d1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:48.306384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e13f-4f1f-495c-b124-0c6b3fe8d1af None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.306673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e13f-4f1f-495c-b124-0c6b3fe8d1af None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.306955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2e13f-4f1f-495c-b124-0c6b3fe8d1af None admin] PATH_INFO: `/v3/users/glance` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.315505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e443d16-fb27-4921-b9c2-8693161e69d2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:48.315704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2e13f-4f1f-495c-b124-0c6b3fe8d1af None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:48.317168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2e13f-4f1f-495c-b124-0c6b3fe8d1af None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-d8a2e13f-4f1f-495c-b124-0c6b3fe8d1af None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:48.332518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:48.333775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:48.335293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:48.335293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:48.335293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:48.335293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:48.335293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:48.335293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:48.335293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:48.335293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:48.335293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 12:10:48.335293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:48.335293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 322/643] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:48.335921 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2e13f-4f1f-495c-b124-0c6b3fe8d1af None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:48.364471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6350c-fa78-4113-b0f8-d08cb77a927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:48.366267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6350c-fa78-4113-b0f8-d08cb77a927b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.366821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6350c-fa78-4113-b0f8-d08cb77a927b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.367437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6350c-fa78-4113-b0f8-d08cb77a927b None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.368278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6350c-fa78-4113-b0f8-d08cb77a927b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:48.368588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6350c-fa78-4113-b0f8-d08cb77a927b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:48.370155 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6350c-fa78-4113-b0f8-d08cb77a927b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:48.387384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 322/644] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:48.387384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6350c-fa78-4113-b0f8-d08cb77a927b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:48.411943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:48.447330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2e13f-4f1f-495c-b124-0c6b3fe8d1af None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:48.461934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:48.483823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206e89a-85ff-4b3a-bdfb-5c3a5be17d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:48.484705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e89a-85ff-4b3a-bdfb-5c3a5be17d95 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.485001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e89a-85ff-4b3a-bdfb-5c3a5be17d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.485414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e89a-85ff-4b3a-bdfb-5c3a5be17d95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.497027 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206e89a-85ff-4b3a-bdfb-5c3a5be17d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:48.497465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6350c-fa78-4113-b0f8-d08cb77a927b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-7206e89a-85ff-4b3a-bdfb-5c3a5be17d95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:48.505038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:48.506015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:48.507094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:48.511131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 323/645] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:48.512009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206e89a-85ff-4b3a-bdfb-5c3a5be17d95 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:48.534958 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99670d2-7d02-49da-a21f-884b4c9e2bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:48.535755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99670d2-7d02-49da-a21f-884b4c9e2bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.536120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99670d2-7d02-49da-a21f-884b4c9e2bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.536398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99670d2-7d02-49da-a21f-884b4c9e2bb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.547628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99670d2-7d02-49da-a21f-884b4c9e2bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b99670d2-7d02-49da-a21f-884b4c9e2bb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:48.555472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:48.556468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:48.557329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 323/646] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:48.558021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99670d2-7d02-49da-a21f-884b4c9e2bb3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:48.625471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206e89a-85ff-4b3a-bdfb-5c3a5be17d95 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:48.653866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:48.662353 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75597fd8-2f3b-46a3-844c-ca89ff243a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:48.663595 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597fd8-2f3b-46a3-844c-ca89ff243a24 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.663882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597fd8-2f3b-46a3-844c-ca89ff243a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.664182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75597fd8-2f3b-46a3-844c-ca89ff243a24 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.665022 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75597fd8-2f3b-46a3-844c-ca89ff243a24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:48.665382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75597fd8-2f3b-46a3-844c-ca89ff243a24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:48.666825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75597fd8-2f3b-46a3-844c-ca89ff243a24 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:48.677408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99670d2-7d02-49da-a21f-884b4c9e2bb3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:48.689276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 324/647] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 12:10:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:48.689276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75597fd8-2f3b-46a3-844c-ca89ff243a24 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:48.710084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:48.718058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a39d2a-36cb-4b79-9b24-12496c8ae8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:48.719216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39d2a-36cb-4b79-9b24-12496c8ae8b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.719702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39d2a-36cb-4b79-9b24-12496c8ae8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.720205 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39d2a-36cb-4b79-9b24-12496c8ae8b3 None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/254b5c1a59e94596bf942192b4a30ac0/roles/14d046a572664f94934f225e9a3f3b64` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.737185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a39d2a-36cb-4b79-9b24-12496c8ae8b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=254b5c1a59e94596bf942192b4a30ac0, role_id=14d046a572664f94934f225e9a3f3b64)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:48.738634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a39d2a-36cb-4b79-9b24-12496c8ae8b3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:48.768054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 324/648] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:10:48 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/254b5c1a59e94596bf942192b4a30ac0/roles/14d046a572664f94934f225e9a3f3b64 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:10:48.768054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a39d2a-36cb-4b79-9b24-12496c8ae8b3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:48.833802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75597fd8-2f3b-46a3-844c-ca89ff243a24 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:48.883263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfdb6f-ea20-4d4b-9d75-51b6a0a6d871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:48.884541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfdb6f-ea20-4d4b-9d75-51b6a0a6d871 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.884903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfdb6f-ea20-4d4b-9d75-51b6a0a6d871 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.885261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfdb6f-ea20-4d4b-9d75-51b6a0a6d871 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.886107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfdb6f-ea20-4d4b-9d75-51b6a0a6d871 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:48.886491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfdb6f-ea20-4d4b-9d75-51b6a0a6d871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:48.888330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfdb6f-ea20-4d4b-9d75-51b6a0a6d871 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:48.904197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 325/649] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:48.905468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfdb6f-ea20-4d4b-9d75-51b6a0a6d871 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:48.915693 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a39d2a-36cb-4b79-9b24-12496c8ae8b3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:48.961942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1f803-f235-4e3e-a040-f9cdd835613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:48.962628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1f803-f235-4e3e-a040-f9cdd835613f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:48.962916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1f803-f235-4e3e-a040-f9cdd835613f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:48.963197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1f803-f235-4e3e-a040-f9cdd835613f None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:48.963952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1f803-f235-4e3e-a040-f9cdd835613f None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:48.964292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1f803-f235-4e3e-a040-f9cdd835613f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:48.965669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1f803-f235-4e3e-a040-f9cdd835613f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:48.966626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:48.977970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 325/650] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:48.978855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1f803-f235-4e3e-a040-f9cdd835613f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:49.028931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:49.038323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfdb6f-ea20-4d4b-9d75-51b6a0a6d871 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:49.082182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5bdad-0cfc-47cf-a48e-af0c1375f875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:49.083722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5bdad-0cfc-47cf-a48e-af0c1375f875 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:49.084216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5bdad-0cfc-47cf-a48e-af0c1375f875 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:49.085212 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5bdad-0cfc-47cf-a48e-af0c1375f875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:49.092986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1f803-f235-4e3e-a040-f9cdd835613f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:49.143827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59db80-3553-4781-ad5d-a2229999b256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:49.145085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59db80-3553-4781-ad5d-a2229999b256 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:49.145994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59db80-3553-4781-ad5d-a2229999b256 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:49.146461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59db80-3553-4781-ad5d-a2229999b256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:49.162721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59db80-3553-4781-ad5d-a2229999b256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:49.165327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59db80-3553-4781-ad5d-a2229999b256 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:49.174707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5bdad-0cfc-47cf-a48e-af0c1375f875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:49.176229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5bdad-0cfc-47cf-a48e-af0c1375f875 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ea59db80-3553-4781-ad5d-a2229999b256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:49.188614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:49.189699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:49.190777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:49.190777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:49.190777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:49.190777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:49.193327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 326/651] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:49.195072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59db80-3553-4781-ad5d-a2229999b256 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:49.231684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:49.301486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 326/652] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:49.302254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5bdad-0cfc-47cf-a48e-af0c1375f875 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:49.324365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:49.332986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59db80-3553-4781-ad5d-a2229999b256 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:49.371911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf7f35-6c72-4fda-90cf-a418210f6906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:49.372760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf7f35-6c72-4fda-90cf-a418210f6906 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:49.373152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf7f35-6c72-4fda-90cf-a418210f6906 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:49.373440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf7f35-6c72-4fda-90cf-a418210f6906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:49.385883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf7f35-6c72-4fda-90cf-a418210f6906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:49.387391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf7f35-6c72-4fda-90cf-a418210f6906 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-bccf7f35-6c72-4fda-90cf-a418210f6906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:49.407605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:49.408564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:49.409463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:49.409463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:49.409463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:49.409463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:49.413594 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 327/653] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:49.414462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf7f35-6c72-4fda-90cf-a418210f6906 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:49.429811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5bdad-0cfc-47cf-a48e-af0c1375f875 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:49.473594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7d85-4ba4-4503-9183-06941bed5545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:49.474266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7d85-4ba4-4503-9183-06941bed5545 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:49.474834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7d85-4ba4-4503-9183-06941bed5545 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:49.475668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7d85-4ba4-4503-9183-06941bed5545 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:49.476438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef7d85-4ba4-4503-9183-06941bed5545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:49.476906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef7d85-4ba4-4503-9183-06941bed5545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:49.478993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef7d85-4ba4-4503-9183-06941bed5545 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:49.494836 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 327/654] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:49.495700 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7d85-4ba4-4503-9183-06941bed5545 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:49.512333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:49.535018 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf7f35-6c72-4fda-90cf-a418210f6906 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:49.570446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61543830-e86b-49be-a1cd-4571ce33042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:49.571246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61543830-e86b-49be-a1cd-4571ce33042c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:49.571532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61543830-e86b-49be-a1cd-4571ce33042c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:49.571806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61543830-e86b-49be-a1cd-4571ce33042c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:49.584856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61543830-e86b-49be-a1cd-4571ce33042c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:49.586510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61543830-e86b-49be-a1cd-4571ce33042c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:49.593193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-61543830-e86b-49be-a1cd-4571ce33042c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:49.606478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:49.607614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:49.608710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:49.608710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:49.608710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:49.608710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:49.610658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 328/655] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:49.611682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61543830-e86b-49be-a1cd-4571ce33042c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:49.630725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7d85-4ba4-4503-9183-06941bed5545 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:49.676587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03cfa3-1f94-475f-a554-1b133908dc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:49.677191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03cfa3-1f94-475f-a554-1b133908dc66 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:49.677485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03cfa3-1f94-475f-a554-1b133908dc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:49.678031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03cfa3-1f94-475f-a554-1b133908dc66 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:49.679318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03cfa3-1f94-475f-a554-1b133908dc66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:49.679632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03cfa3-1f94-475f-a554-1b133908dc66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:49.681918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03cfa3-1f94-475f-a554-1b133908dc66 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:49.701048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 328/656] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:49.701048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03cfa3-1f94-475f-a554-1b133908dc66 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:49.731170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61543830-e86b-49be-a1cd-4571ce33042c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:49.769536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b071b7-15f0-4940-b105-569cb9d56fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:49.770608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b071b7-15f0-4940-b105-569cb9d56fbe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:49.771056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b071b7-15f0-4940-b105-569cb9d56fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:49.771481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b071b7-15f0-4940-b105-569cb9d56fbe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:49.780446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b071b7-15f0-4940-b105-569cb9d56fbe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:49.780980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:49.782968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b071b7-15f0-4940-b105-569cb9d56fbe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-76b071b7-15f0-4940-b105-569cb9d56fbe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:49.799026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:49.800252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:49.801296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:49.801296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:49.801296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:49.801296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:49.801296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:49.801296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:49.801296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:49.801296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:49.801296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 12:10:49.801296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:49.808965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 329/657] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:49.810062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b071b7-15f0-4940-b105-569cb9d56fbe None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:49.821057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03cfa3-1f94-475f-a554-1b133908dc66 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:49.866455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37098543-47ae-4002-91ba-3be9fbe04d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:49.867526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37098543-47ae-4002-91ba-3be9fbe04d96 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:49.867820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37098543-47ae-4002-91ba-3be9fbe04d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:49.868136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37098543-47ae-4002-91ba-3be9fbe04d96 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:49.869162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37098543-47ae-4002-91ba-3be9fbe04d96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:49.869477 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37098543-47ae-4002-91ba-3be9fbe04d96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:49.871035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37098543-47ae-4002-91ba-3be9fbe04d96 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:49.880142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:49.886776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 329/658] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:49.888061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37098543-47ae-4002-91ba-3be9fbe04d96 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:49.934251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b071b7-15f0-4940-b105-569cb9d56fbe None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:49.977854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd652b-59eb-4318-ae80-f9c3596179e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:49.978690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd652b-59eb-4318-ae80-f9c3596179e6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:49.978974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd652b-59eb-4318-ae80-f9c3596179e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:49.979252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd652b-59eb-4318-ae80-f9c3596179e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:49.989601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd652b-59eb-4318-ae80-f9c3596179e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:49.991356 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd652b-59eb-4318-ae80-f9c3596179e6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-28fd652b-59eb-4318-ae80-f9c3596179e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:50.009025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:50.010209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:50.011151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:50.011151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:50.011151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:50.011151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:50.011151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:50.011151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:50.011151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:50.011151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:50.011151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 12:10:50.011151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:50.013497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37098543-47ae-4002-91ba-3be9fbe04d96 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:50.014973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 330/659] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:50.016152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd652b-59eb-4318-ae80-f9c3596179e6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:50.051543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:50.064127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd9d7b-52a4-483a-98ff-6620399c901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:50.065325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9d7b-52a4-483a-98ff-6620399c901e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:50.065761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9d7b-52a4-483a-98ff-6620399c901e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:50.066638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9d7b-52a4-483a-98ff-6620399c901e None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:50.067927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd9d7b-52a4-483a-98ff-6620399c901e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:50.068434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd9d7b-52a4-483a-98ff-6620399c901e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:50.071186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd9d7b-52a4-483a-98ff-6620399c901e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:50.099302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 330/660] 10.222.0.66 () {56 vars in 1139 bytes} [Wed Jun 22 12:10:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:50.099302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd9d7b-52a4-483a-98ff-6620399c901e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:50.152255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd652b-59eb-4318-ae80-f9c3596179e6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:50.170630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:50.190019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173f4bd-7eee-4ff7-9354-591dd90860cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:50.190743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173f4bd-7eee-4ff7-9354-591dd90860cb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:50.191029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173f4bd-7eee-4ff7-9354-591dd90860cb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:50.191314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173f4bd-7eee-4ff7-9354-591dd90860cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:50.199557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173f4bd-7eee-4ff7-9354-591dd90860cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:50.201072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173f4bd-7eee-4ff7-9354-591dd90860cb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d173f4bd-7eee-4ff7-9354-591dd90860cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:50.216251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:50.217196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:50.218162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:50.218162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:50.218162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:50.218162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:50.218162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:50.218162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:50.218162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:50.218162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:50.218162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 331/661] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:50.219093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173f4bd-7eee-4ff7-9354-591dd90860cb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:50.223652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd9d7b-52a4-483a-98ff-6620399c901e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:50.271711 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6f0e4-5229-445e-bc39-e0f65f5837e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:50.272455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f0e4-5229-445e-bc39-e0f65f5837e0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:50.272740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f0e4-5229-445e-bc39-e0f65f5837e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:50.273019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f0e4-5229-445e-bc39-e0f65f5837e0 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:50.273870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6f0e4-5229-445e-bc39-e0f65f5837e0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:50.274190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6f0e4-5229-445e-bc39-e0f65f5837e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:50.275640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6f0e4-5229-445e-bc39-e0f65f5837e0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:50.296066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 331/662] 10.222.0.66 () {56 vars in 1137 bytes} [Wed Jun 22 12:10:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:50.296066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6f0e4-5229-445e-bc39-e0f65f5837e0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:50.332898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173f4bd-7eee-4ff7-9354-591dd90860cb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:50.344816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:50.371154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80751683-e2b2-45a0-8173-49a1d6d695f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:50.372335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80751683-e2b2-45a0-8173-49a1d6d695f1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:50.372335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80751683-e2b2-45a0-8173-49a1d6d695f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:50.372922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80751683-e2b2-45a0-8173-49a1d6d695f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:50.403360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6f0e4-5229-445e-bc39-e0f65f5837e0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:50.423759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:50.442329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80bd10-09aa-4344-a792-a5750bd67133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:50.442969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80bd10-09aa-4344-a792-a5750bd67133 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:50.443201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80bd10-09aa-4344-a792-a5750bd67133 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:50.443479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80bd10-09aa-4344-a792-a5750bd67133 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:50.444553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80bd10-09aa-4344-a792-a5750bd67133 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:50.444766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80bd10-09aa-4344-a792-a5750bd67133 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:50.446408 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80bd10-09aa-4344-a792-a5750bd67133 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:50.448528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80751683-e2b2-45a0-8173-49a1d6d695f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:50.450349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80751683-e2b2-45a0-8173-49a1d6d695f1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:50.458245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 332/663] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:50.459325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fee5f-262e-4601-89f6-707c5ff250f8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:50.460192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fee5f-262e-4601-89f6-707c5ff250f8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:50.460475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fee5f-262e-4601-89f6-707c5ff250f8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:50.461859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 333/664] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:50.462417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fee5f-262e-4601-89f6-707c5ff250f8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:50.582442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fee5f-262e-4601-89f6-707c5ff250f8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:50.586520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:50.592493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 332/665] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:50.593714 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80751683-e2b2-45a0-8173-49a1d6d695f1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:50.630047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c683eb-2f28-4347-a79a-6b7e13b45e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:50.630708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c683eb-2f28-4347-a79a-6b7e13b45e4b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:50.630994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c683eb-2f28-4347-a79a-6b7e13b45e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:50.632533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c683eb-2f28-4347-a79a-6b7e13b45e4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:50.678860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:50.704445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80751683-e2b2-45a0-8173-49a1d6d695f1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:50.708139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c683eb-2f28-4347-a79a-6b7e13b45e4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:50.709649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c683eb-2f28-4347-a79a-6b7e13b45e4b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:50.741593 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a1b79-2161-4ce1-90c7-048652f97370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:50.742282 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a1b79-2161-4ce1-90c7-048652f97370 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:50.742563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a1b79-2161-4ce1-90c7-048652f97370 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:50.742838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a1b79-2161-4ce1-90c7-048652f97370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:50.743675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a1b79-2161-4ce1-90c7-048652f97370 None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=d82125a47ce044b389684b97c7097ebe) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:50.743984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a1b79-2161-4ce1-90c7-048652f97370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:50.745455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a1b79-2161-4ce1-90c7-048652f97370 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:50.752709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 333/666] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:50 2022] GET /identity/v3/role_assignments?user.id=d82125a47ce044b389684b97c7097ebe&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:50.759400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055aea62-2e62-4eb7-a952-bcef7bcbb186 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:50.760471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055aea62-2e62-4eb7-a952-bcef7bcbb186 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:50.760997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055aea62-2e62-4eb7-a952-bcef7bcbb186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:50.788577 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-055aea62-2e62-4eb7-a952-bcef7bcbb186 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:50.789750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-055aea62-2e62-4eb7-a952-bcef7bcbb186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:50.840622 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 334/667] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:50.841583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c683eb-2f28-4347-a79a-6b7e13b45e4b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:50.845125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:50.896121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 334/668] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:50.896121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055aea62-2e62-4eb7-a952-bcef7bcbb186 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:50.990684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c683eb-2f28-4347-a79a-6b7e13b45e4b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:50.994329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:51.037076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055aea62-2e62-4eb7-a952-bcef7bcbb186 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:51.037274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a795a-9da7-42c1-a5ac-3dbe74a732eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:51.038414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a795a-9da7-42c1-a5ac-3dbe74a732eb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.038917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a795a-9da7-42c1-a5ac-3dbe74a732eb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.039429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a795a-9da7-42c1-a5ac-3dbe74a732eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.056456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a795a-9da7-42c1-a5ac-3dbe74a732eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:51.058044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a795a-9da7-42c1-a5ac-3dbe74a732eb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:51.075562 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e300f-7936-46ec-bf09-a6c4adcb64ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:51.076400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e300f-7936-46ec-bf09-a6c4adcb64ee None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.076685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e300f-7936-46ec-bf09-a6c4adcb64ee None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.076959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e300f-7936-46ec-bf09-a6c4adcb64ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-754a795a-9da7-42c1-a5ac-3dbe74a732eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:51.077057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:51.077881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:51.078756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:51.078756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:51.078756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:51.078756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:51.078756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 335/669] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:51.079544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a795a-9da7-42c1-a5ac-3dbe74a732eb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:51.092221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e300f-7936-46ec-bf09-a6c4adcb64ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:51.093744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e300f-7936-46ec-bf09-a6c4adcb64ee None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-796e300f-7936-46ec-bf09-a6c4adcb64ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:51.113406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:51.114387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:51.115281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:51.115281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:51.115281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:51.115281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:51.115281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 335/670] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:51.117213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762bc9-2ea8-4bb6-ac65-330f357f9bf6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.117213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762bc9-2ea8-4bb6-ac65-330f357f9bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.117213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762bc9-2ea8-4bb6-ac65-330f357f9bf6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.118894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 336/671] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:51.123672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2762bc9-2ea8-4bb6-ac65-330f357f9bf6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:51.156495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:51.208050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a795a-9da7-42c1-a5ac-3dbe74a732eb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:51.245980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2762bc9-2ea8-4bb6-ac65-330f357f9bf6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:51.249562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf8db0-e788-4efa-aa86-88c343f8132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:51.250363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8db0-e788-4efa-aa86-88c343f8132a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.250648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8db0-e788-4efa-aa86-88c343f8132a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.250926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8db0-e788-4efa-aa86-88c343f8132a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.262210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf8db0-e788-4efa-aa86-88c343f8132a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-74cf8db0-e788-4efa-aa86-88c343f8132a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:51.270209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:51.271155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 336/672] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:10:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:51.273107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf8db0-e788-4efa-aa86-88c343f8132a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:51.279091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:51.290865 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d18ac9-8327-443a-8d87-a3eeba8876a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:51.291539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d18ac9-8327-443a-8d87-a3eeba8876a3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.291834 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d18ac9-8327-443a-8d87-a3eeba8876a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.292152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d18ac9-8327-443a-8d87-a3eeba8876a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.292897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d18ac9-8327-443a-8d87-a3eeba8876a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:51.293209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d18ac9-8327-443a-8d87-a3eeba8876a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:51.294611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d18ac9-8327-443a-8d87-a3eeba8876a3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:51.308063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 337/673] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:51.309199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a5f91-737b-46d2-ae4d-a7a10f399794 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.309494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a5f91-737b-46d2-ae4d-a7a10f399794 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.309778 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a5f91-737b-46d2-ae4d-a7a10f399794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.327688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e94a5f91-737b-46d2-ae4d-a7a10f399794 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:51.328949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e94a5f91-737b-46d2-ae4d-a7a10f399794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:51.394597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf8db0-e788-4efa-aa86-88c343f8132a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:51.405849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 338/674] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:51.406705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a5f91-737b-46d2-ae4d-a7a10f399794 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:51.422797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:51.444676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec5fc6-6458-4286-a2e5-f5a49d08024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:51.446287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec5fc6-6458-4286-a2e5-f5a49d08024f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.446576 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec5fc6-6458-4286-a2e5-f5a49d08024f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.446854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec5fc6-6458-4286-a2e5-f5a49d08024f None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.447583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec5fc6-6458-4286-a2e5-f5a49d08024f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:51.447892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec5fc6-6458-4286-a2e5-f5a49d08024f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:51.449441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec5fc6-6458-4286-a2e5-f5a49d08024f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:51.470457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 337/675] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:51.471415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec5fc6-6458-4286-a2e5-f5a49d08024f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:51.522492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a5f91-737b-46d2-ae4d-a7a10f399794 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:51.536703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:51.559106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75196747-1315-4df2-9771-863ad8f3d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:51.559775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196747-1315-4df2-9771-863ad8f3d9bb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.560089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196747-1315-4df2-9771-863ad8f3d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.560373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196747-1315-4df2-9771-863ad8f3d9bb None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.561126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75196747-1315-4df2-9771-863ad8f3d9bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:51.561435 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75196747-1315-4df2-9771-863ad8f3d9bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:51.562832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75196747-1315-4df2-9771-863ad8f3d9bb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:51.571773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 339/676] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:51.573079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75196747-1315-4df2-9771-863ad8f3d9bb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:51.585575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec5fc6-6458-4286-a2e5-f5a49d08024f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:51.622534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dde89d-e804-4f11-99c8-095f1b9caf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:51.623410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dde89d-e804-4f11-99c8-095f1b9caf96 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.623699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dde89d-e804-4f11-99c8-095f1b9caf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.623976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dde89d-e804-4f11-99c8-095f1b9caf96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.632148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dde89d-e804-4f11-99c8-095f1b9caf96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:51.633609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dde89d-e804-4f11-99c8-095f1b9caf96 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f0dde89d-e804-4f11-99c8-095f1b9caf96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:51.648683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:51.649575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:51.650440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:51.650440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:51.650440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:51.650440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:51.650440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:51.650440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:51.650440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:51.650440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:51.650440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 338/677] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:51.651627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dde89d-e804-4f11-99c8-095f1b9caf96 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:51.689139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:51.692794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75196747-1315-4df2-9771-863ad8f3d9bb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:51.732881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f462b-d8b2-4b4c-bb2b-f2fabbad8b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:51.733706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f462b-d8b2-4b4c-bb2b-f2fabbad8b60 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.733992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f462b-d8b2-4b4c-bb2b-f2fabbad8b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.734270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f462b-d8b2-4b4c-bb2b-f2fabbad8b60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.746992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f462b-d8b2-4b4c-bb2b-f2fabbad8b60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e68f462b-d8b2-4b4c-bb2b-f2fabbad8b60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:51.755533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:51.757244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:51.758107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 340/678] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:51.759442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f462b-d8b2-4b4c-bb2b-f2fabbad8b60 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:51.767216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dde89d-e804-4f11-99c8-095f1b9caf96 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:51.798225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:51.811978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b80ba4-cefb-483a-9a15-d3afd698f4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:51.812818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b80ba4-cefb-483a-9a15-d3afd698f4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.813088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b80ba4-cefb-483a-9a15-d3afd698f4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.813364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b80ba4-cefb-483a-9a15-d3afd698f4b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.820910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b80ba4-cefb-483a-9a15-d3afd698f4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:51.822565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b80ba4-cefb-483a-9a15-d3afd698f4b1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-e0b80ba4-cefb-483a-9a15-d3afd698f4b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:51.842557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:51.843657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:51.844790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:51.844790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:51.844790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:51.844790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:51.844790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:51.844790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:51.844790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:51.844790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:51.845907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 339/679] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:51.846720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b80ba4-cefb-483a-9a15-d3afd698f4b1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:51.883063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f462b-d8b2-4b4c-bb2b-f2fabbad8b60 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:51.920678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa8d09-516c-49f8-924e-b5c044bd4186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:51.921472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa8d09-516c-49f8-924e-b5c044bd4186 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:51.921753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa8d09-516c-49f8-924e-b5c044bd4186 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:51.922019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa8d09-516c-49f8-924e-b5c044bd4186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:51.934102 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa8d09-516c-49f8-924e-b5c044bd4186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:51.935739 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa8d09-516c-49f8-924e-b5c044bd4186 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:51.944050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:51.950821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b80ba4-cefb-483a-9a15-d3afd698f4b1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ebfa8d09-516c-49f8-924e-b5c044bd4186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:51.955632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:51.956736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:51.958140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:51.958140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:51.958140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:51.958140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:51.958140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 341/680] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:51.958140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa8d09-516c-49f8-924e-b5c044bd4186 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:52.002881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0841d8-ac1c-46dd-873f-8c09cde80eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:52.004627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0841d8-ac1c-46dd-873f-8c09cde80eba None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.004915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0841d8-ac1c-46dd-873f-8c09cde80eba None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.005185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0841d8-ac1c-46dd-873f-8c09cde80eba None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.006061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0841d8-ac1c-46dd-873f-8c09cde80eba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:52.007031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0841d8-ac1c-46dd-873f-8c09cde80eba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:52.008520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0841d8-ac1c-46dd-873f-8c09cde80eba None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:52.025783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 340/681] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:52.025783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0841d8-ac1c-46dd-873f-8c09cde80eba None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:52.075335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:52.089768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa8d09-516c-49f8-924e-b5c044bd4186 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:52.126797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15301e83-a306-435e-b650-05bed494074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:52.127474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15301e83-a306-435e-b650-05bed494074e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.127768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15301e83-a306-435e-b650-05bed494074e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.128070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15301e83-a306-435e-b650-05bed494074e None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.128833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15301e83-a306-435e-b650-05bed494074e None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:52.129155 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15301e83-a306-435e-b650-05bed494074e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:52.130537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15301e83-a306-435e-b650-05bed494074e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:52.138788 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0841d8-ac1c-46dd-873f-8c09cde80eba None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:52.145178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 342/682] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:52.145178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15301e83-a306-435e-b650-05bed494074e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:52.181072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3fa53-3bae-4426-beb7-2b654651d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:52.181732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3fa53-3bae-4426-beb7-2b654651d784 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.182012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3fa53-3bae-4426-beb7-2b654651d784 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.182286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3fa53-3bae-4426-beb7-2b654651d784 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.183066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3fa53-3bae-4426-beb7-2b654651d784 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:52.183375 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3fa53-3bae-4426-beb7-2b654651d784 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:52.184832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3fa53-3bae-4426-beb7-2b654651d784 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:52.201578 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 341/683] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:52.201578 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3fa53-3bae-4426-beb7-2b654651d784 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:52.220386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:52.254748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15301e83-a306-435e-b650-05bed494074e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:52.289683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b8b1a-ff46-4ca4-bb26-1b2b1562e7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:52.290341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b8b1a-ff46-4ca4-bb26-1b2b1562e7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.290625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b8b1a-ff46-4ca4-bb26-1b2b1562e7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.290903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b8b1a-ff46-4ca4-bb26-1b2b1562e7f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.291614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b8b1a-ff46-4ca4-bb26-1b2b1562e7f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:52.291925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b8b1a-ff46-4ca4-bb26-1b2b1562e7f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:52.293328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b8b1a-ff46-4ca4-bb26-1b2b1562e7f0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:52.305630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 343/684] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:52.306441 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b8b1a-ff46-4ca4-bb26-1b2b1562e7f0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:52.317846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3fa53-3bae-4426-beb7-2b654651d784 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:52.319606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:52.355380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3cad6-8f2a-4d82-a108-4292406c8ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:52.355978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3cad6-8f2a-4d82-a108-4292406c8ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.356250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3cad6-8f2a-4d82-a108-4292406c8ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.356528 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3cad6-8f2a-4d82-a108-4292406c8ac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.357360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3cad6-8f2a-4d82-a108-4292406c8ac9 None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=b37002ecc6384dc08fca3ddf6ca2f9e2) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:52.357669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3cad6-8f2a-4d82-a108-4292406c8ac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:52.359106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3cad6-8f2a-4d82-a108-4292406c8ac9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:52.376046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 342/685] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:52 2022] GET /identity/v3/role_assignments?user.id=b37002ecc6384dc08fca3ddf6ca2f9e2&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:52.376046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3cad6-8f2a-4d82-a108-4292406c8ac9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:52.418820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b8b1a-ff46-4ca4-bb26-1b2b1562e7f0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:52.470225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add88d3-10ca-4132-8c94-ed4cbd580a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:52.471476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add88d3-10ca-4132-8c94-ed4cbd580a3d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.471924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add88d3-10ca-4132-8c94-ed4cbd580a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.472361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add88d3-10ca-4132-8c94-ed4cbd580a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.481143 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:52.488721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add88d3-10ca-4132-8c94-ed4cbd580a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:52.490684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add88d3-10ca-4132-8c94-ed4cbd580a3d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:52.513608 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3cad6-8f2a-4d82-a108-4292406c8ac9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5add88d3-10ca-4132-8c94-ed4cbd580a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:52.516107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:52.516977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:52.517855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:52.517855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:52.517855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:52.517855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:52.522692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 344/686] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:52.523674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add88d3-10ca-4132-8c94-ed4cbd580a3d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:52.555371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a188c43-3beb-45de-8963-5927aa44ca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:52.556059 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a188c43-3beb-45de-8963-5927aa44ca72 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.556355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a188c43-3beb-45de-8963-5927aa44ca72 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.556636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a188c43-3beb-45de-8963-5927aa44ca72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.557494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a188c43-3beb-45de-8963-5927aa44ca72 None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=eeb4a8bcbc374f139db9e6e134b6d681) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:52.557811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a188c43-3beb-45de-8963-5927aa44ca72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:52.559259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a188c43-3beb-45de-8963-5927aa44ca72 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:52.568078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 343/687] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:52 2022] GET /identity/v3/role_assignments?user.id=eeb4a8bcbc374f139db9e6e134b6d681&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:52.569831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a188c43-3beb-45de-8963-5927aa44ca72 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:52.612773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:52.669886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add88d3-10ca-4132-8c94-ed4cbd580a3d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:52.715223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a188c43-3beb-45de-8963-5927aa44ca72 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:52.727689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457afc57-8ce0-4c1f-893c-26c1a0d982a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:52.728550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457afc57-8ce0-4c1f-893c-26c1a0d982a0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.728833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457afc57-8ce0-4c1f-893c-26c1a0d982a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.729110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457afc57-8ce0-4c1f-893c-26c1a0d982a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.742792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457afc57-8ce0-4c1f-893c-26c1a0d982a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:52.744313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457afc57-8ce0-4c1f-893c-26c1a0d982a0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:52.762959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54daed9-3e29-4ac7-a478-825676b91b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-457afc57-8ce0-4c1f-893c-26c1a0d982a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:52.763553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:52.764844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:52.766462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:52.766462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:52.766462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:52.766462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:52.766462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:52.766462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:52.766462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:52.766462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:52.766462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:10:52.766462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:52.766462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 345/688] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 12:10:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:52.772316 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54daed9-3e29-4ac7-a478-825676b91b2e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.772870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54daed9-3e29-4ac7-a478-825676b91b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.773169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54daed9-3e29-4ac7-a478-825676b91b2e None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.773949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54daed9-3e29-4ac7-a478-825676b91b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:52.775104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54daed9-3e29-4ac7-a478-825676b91b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:52.775692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54daed9-3e29-4ac7-a478-825676b91b2e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:52.779553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457afc57-8ce0-4c1f-893c-26c1a0d982a0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:52.789501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 344/689] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:52.795096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54daed9-3e29-4ac7-a478-825676b91b2e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:52.800256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:52.908047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457afc57-8ce0-4c1f-893c-26c1a0d982a0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:52.937441 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:52.942405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54daed9-3e29-4ac7-a478-825676b91b2e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:52.954070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97fb7d-fee7-40da-b7a0-108f556d54d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:52.954758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97fb7d-fee7-40da-b7a0-108f556d54d4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.955048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97fb7d-fee7-40da-b7a0-108f556d54d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.955331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97fb7d-fee7-40da-b7a0-108f556d54d4 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.956215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97fb7d-fee7-40da-b7a0-108f556d54d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:52.956532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97fb7d-fee7-40da-b7a0-108f556d54d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:52.957980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97fb7d-fee7-40da-b7a0-108f556d54d4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:52.982865 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 346/690] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 12:10:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:52.984345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbf529-17a1-4ca4-9a3d-a5270d5b4000 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.984638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbf529-17a1-4ca4-9a3d-a5270d5b4000 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.984931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbf529-17a1-4ca4-9a3d-a5270d5b4000 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.986476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 347/691] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:52.988920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbe80d-054d-46b6-9458-82a0a9e228a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:52.990007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbe80d-054d-46b6-9458-82a0a9e228a0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:52.990500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbe80d-054d-46b6-9458-82a0a9e228a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:52.991000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbe80d-054d-46b6-9458-82a0a9e228a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:52.991365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbf529-17a1-4ca4-9a3d-a5270d5b4000 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:53.001501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbe80d-054d-46b6-9458-82a0a9e228a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:53.003793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbe80d-054d-46b6-9458-82a0a9e228a0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-1acbe80d-054d-46b6-9458-82a0a9e228a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:53.024508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:53.025491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:53.026485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:53.026485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:53.026485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:53.026485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:53.026485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:53.026485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:53.026485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:53.026485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:53.026485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:10:53.026485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:53.029326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 345/692] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:10:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:53.030568 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64108e9e-89d1-4435-b896-739fb8c270a2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:53.030846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64108e9e-89d1-4435-b896-739fb8c270a2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:53.031125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64108e9e-89d1-4435-b896-739fb8c270a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:53.053986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-64108e9e-89d1-4435-b896-739fb8c270a2 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:53.055470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-64108e9e-89d1-4435-b896-739fb8c270a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:53.118447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:53.119339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbf529-17a1-4ca4-9a3d-a5270d5b4000 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:53.132735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 346/693] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:53.133612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64108e9e-89d1-4435-b896-739fb8c270a2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:53.180285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e2c59-d6df-41dc-b147-b302e30bdf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:53.181272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e2c59-d6df-41dc-b147-b302e30bdf6b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:53.181760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e2c59-d6df-41dc-b147-b302e30bdf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:53.182258 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e2c59-d6df-41dc-b147-b302e30bdf6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:53.232926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:53.253517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e2c59-d6df-41dc-b147-b302e30bdf6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:53.255328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e2c59-d6df-41dc-b147-b302e30bdf6b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:53.263114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64108e9e-89d1-4435-b896-739fb8c270a2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:53.300575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf064d-bf83-4863-ad8b-ffc2f7c58151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:53.301279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf064d-bf83-4863-ad8b-ffc2f7c58151 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:53.301531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf064d-bf83-4863-ad8b-ffc2f7c58151 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:53.301806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf064d-bf83-4863-ad8b-ffc2f7c58151 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:53.302647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf064d-bf83-4863-ad8b-ffc2f7c58151 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:53.302956 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf064d-bf83-4863-ad8b-ffc2f7c58151 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:53.304454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf064d-bf83-4863-ad8b-ffc2f7c58151 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:53.323295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 347/694] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 12:10:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:53.324179 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf064d-bf83-4863-ad8b-ffc2f7c58151 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:53.358664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 348/695] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:53.359535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e2c59-d6df-41dc-b147-b302e30bdf6b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:53.379063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:53.427362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf064d-bf83-4863-ad8b-ffc2f7c58151 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:53.454320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:53.462613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35557c-a9ca-40c0-9861-db7994033630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:53.463408 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35557c-a9ca-40c0-9861-db7994033630 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:53.463689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35557c-a9ca-40c0-9861-db7994033630 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:53.463967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35557c-a9ca-40c0-9861-db7994033630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:53.466714 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e2c59-d6df-41dc-b147-b302e30bdf6b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:53.475518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35557c-a9ca-40c0-9861-db7994033630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:53.477000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35557c-a9ca-40c0-9861-db7994033630 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ec35557c-a9ca-40c0-9861-db7994033630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:53.497115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:53.498444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:53.499371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:53.499371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:53.499371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:53.499371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:53.499371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 348/696] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:53.499639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35557c-a9ca-40c0-9861-db7994033630 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:53.509471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f9191-dffc-4d80-a340-1016761e0c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:53.510134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f9191-dffc-4d80-a340-1016761e0c89 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:53.510421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f9191-dffc-4d80-a340-1016761e0c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:53.510696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f9191-dffc-4d80-a340-1016761e0c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:53.586176 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f9191-dffc-4d80-a340-1016761e0c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:53.587781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f9191-dffc-4d80-a340-1016761e0c89 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:53.607943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35557c-a9ca-40c0-9861-db7994033630 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:53.610329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:53.648995 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf4d70-8cdd-4234-818e-9df49758ca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:53.649814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf4d70-8cdd-4234-818e-9df49758ca5b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:53.650426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf4d70-8cdd-4234-818e-9df49758ca5b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:53.650714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf4d70-8cdd-4234-818e-9df49758ca5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:53.663090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf4d70-8cdd-4234-818e-9df49758ca5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:53.664843 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf4d70-8cdd-4234-818e-9df49758ca5b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:53.679100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-18cf4d70-8cdd-4234-818e-9df49758ca5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:53.685949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:53.687038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:53.688094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:53.688094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:53.688094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:53.688094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:53.690067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 349/697] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:53.691238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf4d70-8cdd-4234-818e-9df49758ca5b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:53.700889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 349/698] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:53.701803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f9191-dffc-4d80-a340-1016761e0c89 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:53.814698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f9191-dffc-4d80-a340-1016761e0c89 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:53.834216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf4d70-8cdd-4234-818e-9df49758ca5b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:53.859385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966968fd-5bb7-41a1-bbfa-b7b5cfe310ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:53.860081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966968fd-5bb7-41a1-bbfa-b7b5cfe310ff None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:53.860372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966968fd-5bb7-41a1-bbfa-b7b5cfe310ff None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:53.860652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966968fd-5bb7-41a1-bbfa-b7b5cfe310ff None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:53.861378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966968fd-5bb7-41a1-bbfa-b7b5cfe310ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:53.861685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966968fd-5bb7-41a1-bbfa-b7b5cfe310ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:53.863059 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966968fd-5bb7-41a1-bbfa-b7b5cfe310ff None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:53.876217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 350/699] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:53.877142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966968fd-5bb7-41a1-bbfa-b7b5cfe310ff None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:53.885905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eea1e6-13d1-4ac9-9b25-9f2ea3232f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:53.887433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eea1e6-13d1-4ac9-9b25-9f2ea3232f83 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:53.887955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eea1e6-13d1-4ac9-9b25-9f2ea3232f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:53.888471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eea1e6-13d1-4ac9-9b25-9f2ea3232f83 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:53.889936 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eea1e6-13d1-4ac9-9b25-9f2ea3232f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:53.891201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eea1e6-13d1-4ac9-9b25-9f2ea3232f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:53.893128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eea1e6-13d1-4ac9-9b25-9f2ea3232f83 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:53.915064 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 350/700] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:53.915064 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eea1e6-13d1-4ac9-9b25-9f2ea3232f83 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:53.931272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:53.941686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:54.003417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966968fd-5bb7-41a1-bbfa-b7b5cfe310ff None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:54.034723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eea1e6-13d1-4ac9-9b25-9f2ea3232f83 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:54.041122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8512a-d4e2-48d4-9bcf-3994b651097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:54.042119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8512a-d4e2-48d4-9bcf-3994b651097a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:54.042578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8512a-d4e2-48d4-9bcf-3994b651097a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:54.043008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8512a-d4e2-48d4-9bcf-3994b651097a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:54.055433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8512a-d4e2-48d4-9bcf-3994b651097a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:54.057287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8512a-d4e2-48d4-9bcf-3994b651097a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:54.074400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6705e22-5b93-4e4d-b450-934111bbf225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:54.075252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705e22-5b93-4e4d-b450-934111bbf225 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:54.075635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705e22-5b93-4e4d-b450-934111bbf225 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:54.076007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705e22-5b93-4e4d-b450-934111bbf225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-a8d8512a-d4e2-48d4-9bcf-3994b651097a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:54.076917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:54.077833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:54.078730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:54.078730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:54.078730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:54.078730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:54.082752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 351/701] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:54.083576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8512a-d4e2-48d4-9bcf-3994b651097a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:54.086988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6705e22-5b93-4e4d-b450-934111bbf225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:54.088789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6705e22-5b93-4e4d-b450-934111bbf225 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-d6705e22-5b93-4e4d-b450-934111bbf225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:54.105207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:54.106157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:54.107020 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:54.107020 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:54.107020 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:54.107020 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:54.107020 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:54.107020 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:54.107020 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:54.107020 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:54.109757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 351/702] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:54.110816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6705e22-5b93-4e4d-b450-934111bbf225 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:54.189724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:54.198985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8512a-d4e2-48d4-9bcf-3994b651097a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:54.210451 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:54.236360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fc75f-195a-4b96-b004-af97ebcf9ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:54.237040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fc75f-195a-4b96-b004-af97ebcf9ca1 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:54.237340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fc75f-195a-4b96-b004-af97ebcf9ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:54.237615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fc75f-195a-4b96-b004-af97ebcf9ca1 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:54.238326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fc75f-195a-4b96-b004-af97ebcf9ca1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:54.238698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6705e22-5b93-4e4d-b450-934111bbf225 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:54.239792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fc75f-195a-4b96-b004-af97ebcf9ca1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:54.264364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 352/703] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:10:54 2022] POST /identity/v3/users => generated 254 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:10:54.265834 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fc75f-195a-4b96-b004-af97ebcf9ca1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:54.283554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5d6ce-3f38-4eac-bd05-57dcca6df2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:54.284819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d6ce-3f38-4eac-bd05-57dcca6df2fd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:54.285112 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d6ce-3f38-4eac-bd05-57dcca6df2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:54.285399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d6ce-3f38-4eac-bd05-57dcca6df2fd None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:54.286168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5d6ce-3f38-4eac-bd05-57dcca6df2fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:54.286483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5d6ce-3f38-4eac-bd05-57dcca6df2fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:54.288054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5d6ce-3f38-4eac-bd05-57dcca6df2fd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:54.311431 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 352/704] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:54.317078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5d6ce-3f38-4eac-bd05-57dcca6df2fd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:54.475538 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fc75f-195a-4b96-b004-af97ebcf9ca1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:54.493382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5d6ce-3f38-4eac-bd05-57dcca6df2fd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:54.517787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f0a12-e94b-4f38-b06c-2f595d3a5c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:54.518451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0a12-e94b-4f38-b06c-2f595d3a5c0c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:54.518733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0a12-e94b-4f38-b06c-2f595d3a5c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:54.519146 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0a12-e94b-4f38-b06c-2f595d3a5c0c None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:54.519902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f0a12-e94b-4f38-b06c-2f595d3a5c0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:54.520565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f0a12-e94b-4f38-b06c-2f595d3a5c0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:54.521840 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f0a12-e94b-4f38-b06c-2f595d3a5c0c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:54.535457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 353/705] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:54.540789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c265df-2280-49bd-b306-a8416dcd9f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:54.541882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c265df-2280-49bd-b306-a8416dcd9f6c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:54.542000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c265df-2280-49bd-b306-a8416dcd9f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:54.542200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c265df-2280-49bd-b306-a8416dcd9f6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:54.543642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f0a12-e94b-4f38-b06c-2f595d3a5c0c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:54.547023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:54.554317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c265df-2280-49bd-b306-a8416dcd9f6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:54.555772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c265df-2280-49bd-b306-a8416dcd9f6c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:54.557389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-a9c265df-2280-49bd-b306-a8416dcd9f6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:10:54.577044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:54.578000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:54.578878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:10:54.578878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:10:54.578878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:10:54.578878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:10:54.578878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:10:54.578878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:10:54.578878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:10:54.578878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:54.583063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 353/706] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:54.585681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c265df-2280-49bd-b306-a8416dcd9f6c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:54.663280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f0a12-e94b-4f38-b06c-2f595d3a5c0c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:54.700488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d23c1-3d73-47d8-b720-ccc3800dc918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:54.701535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d23c1-3d73-47d8-b720-ccc3800dc918 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:54.701967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c265df-2280-49bd-b306-a8416dcd9f6c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:54.702262 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d23c1-3d73-47d8-b720-ccc3800dc918 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:54.702760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d23c1-3d73-47d8-b720-ccc3800dc918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:54.703800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d23c1-3d73-47d8-b720-ccc3800dc918 None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=1df703568a334eea9550ac643d87b5fe) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:54.704343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d23c1-3d73-47d8-b720-ccc3800dc918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:54.706023 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d23c1-3d73-47d8-b720-ccc3800dc918 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:54.712815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 354/707] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:54 2022] GET /identity/v3/role_assignments?user.id=1df703568a334eea9550ac643d87b5fe&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:54.743153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56507-f652-4657-b831-38b2d8816470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:54.743754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56507-f652-4657-b831-38b2d8816470 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:54.744061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56507-f652-4657-b831-38b2d8816470 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:54.744345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56507-f652-4657-b831-38b2d8816470 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:54.745153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d56507-f652-4657-b831-38b2d8816470 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:54.745463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d56507-f652-4657-b831-38b2d8816470 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:54.747027 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d56507-f652-4657-b831-38b2d8816470 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:54.759709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda76d-2a81-4bf3-9c7b-7e80d9432e62 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:54.760048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda76d-2a81-4bf3-9c7b-7e80d9432e62 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:54.760299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda76d-2a81-4bf3-9c7b-7e80d9432e62 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:54.761231 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 354/708] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:10:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:54.761777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 355/709] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:10:54.768066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56507-f652-4657-b831-38b2d8816470 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:54.774062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e21c1c-406a-4fa1-9439-2c42d91450da None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:54.774392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e21c1c-406a-4fa1-9439-2c42d91450da None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:54.774628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e21c1c-406a-4fa1-9439-2c42d91450da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:54.802574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-98e21c1c-406a-4fa1-9439-2c42d91450da None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:54.803920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-98e21c1c-406a-4fa1-9439-2c42d91450da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:54.883305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:54.938925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 356/710] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:54.950365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56507-f652-4657-b831-38b2d8816470 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:54.967486 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e21c1c-406a-4fa1-9439-2c42d91450da None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:54.969925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:54.994401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66a8bd-35fc-483b-a4ac-56c25ba0a51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:54.995019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66a8bd-35fc-483b-a4ac-56c25ba0a51f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:54.995304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66a8bd-35fc-483b-a4ac-56c25ba0a51f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:54.995584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66a8bd-35fc-483b-a4ac-56c25ba0a51f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:54.996473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66a8bd-35fc-483b-a4ac-56c25ba0a51f None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=254b5c1a59e94596bf942192b4a30ac0) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:54.996794 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66a8bd-35fc-483b-a4ac-56c25ba0a51f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:54.998611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66a8bd-35fc-483b-a4ac-56c25ba0a51f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:55.006257 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 355/711] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:10:54 2022] GET /identity/v3/role_assignments?user.id=254b5c1a59e94596bf942192b4a30ac0&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:55.152944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc8161-c8bc-4067-8420-57a2fab2e9d2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:55.153237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc8161-c8bc-4067-8420-57a2fab2e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:55.153544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc8161-c8bc-4067-8420-57a2fab2e9d2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:55.155061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 356/712] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:10:55.167560 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883b810-3036-404a-936f-00ce86f9742c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:55.167852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883b810-3036-404a-936f-00ce86f9742c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:55.168184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883b810-3036-404a-936f-00ce86f9742c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:55.183792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e21c1c-406a-4fa1-9439-2c42d91450da None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:55.204894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6883b810-3036-404a-936f-00ce86f9742c None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:55.206184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6883b810-3036-404a-936f-00ce86f9742c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:55.234096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef34a-2dcc-4b29-8e06-dbd9b0c41f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:55.234912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef34a-2dcc-4b29-8e06-dbd9b0c41f8c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:55.235197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef34a-2dcc-4b29-8e06-dbd9b0c41f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:55.235476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef34a-2dcc-4b29-8e06-dbd9b0c41f8c None admin] PATH_INFO: `/v3/services/network` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:55.236186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ef34a-2dcc-4b29-8e06-dbd9b0c41f8c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:55.237579 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ef34a-2dcc-4b29-8e06-dbd9b0c41f8c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7c6ef34a-2dcc-4b29-8e06-dbd9b0c41f8c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:55.251928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:55.253051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:55.254001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 357/713] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:54 2022] GET /identity/v3/services/network => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:55.259640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef34a-2dcc-4b29-8e06-dbd9b0c41f8c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:55.295659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 357/714] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 12:10:55.333589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:55.343222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883b810-3036-404a-936f-00ce86f9742c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:55.372753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef34a-2dcc-4b29-8e06-dbd9b0c41f8c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:55.405710 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:55.409775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dd18d-27b6-4eb5-a1d1-1fdf6d747e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:55.410491 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd18d-27b6-4eb5-a1d1-1fdf6d747e2f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:55.410786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd18d-27b6-4eb5-a1d1-1fdf6d747e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:55.411121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd18d-27b6-4eb5-a1d1-1fdf6d747e2f None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:55.411891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dd18d-27b6-4eb5-a1d1-1fdf6d747e2f None admin] RBAC: Adding query filter params (name=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:55.412226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dd18d-27b6-4eb5-a1d1-1fdf6d747e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:55.414179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dd18d-27b6-4eb5-a1d1-1fdf6d747e2f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:55.419769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 358/715] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:10:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:55.425138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dd18d-27b6-4eb5-a1d1-1fdf6d747e2f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:55.463054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883b810-3036-404a-936f-00ce86f9742c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:55.502299 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ed33-ee70-48e2-b816-04975a85fc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:55.503042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ed33-ee70-48e2-b816-04975a85fc53 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:55.503331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ed33-ee70-48e2-b816-04975a85fc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:55.503612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ed33-ee70-48e2-b816-04975a85fc53 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:55.504328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7ed33-ee70-48e2-b816-04975a85fc53 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:55.505715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7ed33-ee70-48e2-b816-04975a85fc53 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-59d7ed33-ee70-48e2-b816-04975a85fc53 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:55.521420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:55.523722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:55.525760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 358/716] 10.222.0.66 () {56 vars in 1129 bytes} [Wed Jun 22 12:10:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:55.536105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ed33-ee70-48e2-b816-04975a85fc53 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:55.536371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dd18d-27b6-4eb5-a1d1-1fdf6d747e2f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:55.567932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:55.574434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a53a26-daf8-4501-9ac1-5c3233222e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:55.575125 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53a26-daf8-4501-9ac1-5c3233222e70 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:55.575415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53a26-daf8-4501-9ac1-5c3233222e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:55.575696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53a26-daf8-4501-9ac1-5c3233222e70 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:55.576444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a53a26-daf8-4501-9ac1-5c3233222e70 None admin] RBAC: Adding query filter params (type=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:55.576756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a53a26-daf8-4501-9ac1-5c3233222e70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:55.578139 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a53a26-daf8-4501-9ac1-5c3233222e70 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:55.584476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 359/717] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:10:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:55.649482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ed33-ee70-48e2-b816-04975a85fc53 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:55.666105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:55.689974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7b992-669a-4f66-b6ff-3819a0fc9dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:55.690659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7b992-669a-4f66-b6ff-3819a0fc9dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:55.690950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7b992-669a-4f66-b6ff-3819a0fc9dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:55.691239 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7b992-669a-4f66-b6ff-3819a0fc9dd2 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:55.691976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7b992-669a-4f66-b6ff-3819a0fc9dd2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:55.692407 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7b992-669a-4f66-b6ff-3819a0fc9dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:55.694847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7b992-669a-4f66-b6ff-3819a0fc9dd2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:55.700696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 359/718] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 12:10:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:55.706430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a53a26-daf8-4501-9ac1-5c3233222e70 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:55.819638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a53a26-daf8-4501-9ac1-5c3233222e70 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:55.857074 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24e4bd-1b66-4d7e-81fb-76342d5834a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:55.858226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e4bd-1b66-4d7e-81fb-76342d5834a8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:55.858763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e4bd-1b66-4d7e-81fb-76342d5834a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:55.859247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e4bd-1b66-4d7e-81fb-76342d5834a8 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:55.860215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24e4bd-1b66-4d7e-81fb-76342d5834a8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:55.860730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24e4bd-1b66-4d7e-81fb-76342d5834a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:55.862364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24e4bd-1b66-4d7e-81fb-76342d5834a8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:55.868662 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 360/719] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 12:10:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:56.910147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b84657-09d7-4a9d-8d00-7bd9b0e0f53a None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:56.910652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b84657-09d7-4a9d-8d00-7bd9b0e0f53a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:56.910766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b84657-09d7-4a9d-8d00-7bd9b0e0f53a None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:56.912876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 360/720] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:56.918144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0de211-f10f-4193-981e-7780ae6ddc41 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:56.918545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0de211-f10f-4193-981e-7780ae6ddc41 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:56.918715 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0de211-f10f-4193-981e-7780ae6ddc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:56.945031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ed0de211-f10f-4193-981e-7780ae6ddc41 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:56.946245 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ed0de211-f10f-4193-981e-7780ae6ddc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:57.015728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:57.037451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 361/721] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:57.075523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b84657-09d7-4a9d-8d00-7bd9b0e0f53a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:57.221656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b84657-09d7-4a9d-8d00-7bd9b0e0f53a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:57.262590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d68e89-f40d-4511-8ee4-501a59cf225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:57.263388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68e89-f40d-4511-8ee4-501a59cf225d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:57.263673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68e89-f40d-4511-8ee4-501a59cf225d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:57.263948 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68e89-f40d-4511-8ee4-501a59cf225d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:57.274944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d68e89-f40d-4511-8ee4-501a59cf225d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c5d68e89-f40d-4511-8ee4-501a59cf225d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:57.282785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:57.283716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:10:57.284597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:57.288484 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 361/722] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:10:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:57.290239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0de211-f10f-4193-981e-7780ae6ddc41 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:57.293594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e497bc8-10fa-4dc0-81a2-2bfd677b49ab None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:57.293894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e497bc8-10fa-4dc0-81a2-2bfd677b49ab None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:57.294176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e497bc8-10fa-4dc0-81a2-2bfd677b49ab None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:57.295664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 362/723] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:57.302010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57b4fe-8313-4661-9c58-16539709e282 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:57.302336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57b4fe-8313-4661-9c58-16539709e282 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:57.302741 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57b4fe-8313-4661-9c58-16539709e282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:57.321250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bd57b4fe-8313-4661-9c58-16539709e282 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:57.322467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bd57b4fe-8313-4661-9c58-16539709e282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:57.356008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:57.412630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 363/724] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:57.432244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57b4fe-8313-4661-9c58-16539709e282 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:57.451584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0de211-f10f-4193-981e-7780ae6ddc41 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:57.553260 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57b4fe-8313-4661-9c58-16539709e282 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:57.557398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185542ea-1be6-4036-bad7-56d906fb7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:57.558101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185542ea-1be6-4036-bad7-56d906fb7f80 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:57.558389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185542ea-1be6-4036-bad7-56d906fb7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:57.558667 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185542ea-1be6-4036-bad7-56d906fb7f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:57.559440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185542ea-1be6-4036-bad7-56d906fb7f80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:57.559750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185542ea-1be6-4036-bad7-56d906fb7f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:57.561165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185542ea-1be6-4036-bad7-56d906fb7f80 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:57.579450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 362/725] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:10:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:57.584496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185542ea-1be6-4036-bad7-56d906fb7f80 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:57.599153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93db32-bc9c-46e6-b5fd-864b0c7a9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:57.601546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93db32-bc9c-46e6-b5fd-864b0c7a9c19 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:57.602038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93db32-bc9c-46e6-b5fd-864b0c7a9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:57.602558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93db32-bc9c-46e6-b5fd-864b0c7a9c19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:57.615123 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93db32-bc9c-46e6-b5fd-864b0c7a9c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-8c93db32-bc9c-46e6-b5fd-864b0c7a9c19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:57.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:57.625169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:57.626024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:57.633795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 364/726] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:10:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:57.635779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93db32-bc9c-46e6-b5fd-864b0c7a9c19 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:57.668267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:57.680083 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:57.764631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185542ea-1be6-4036-bad7-56d906fb7f80 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:57.825862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93db32-bc9c-46e6-b5fd-864b0c7a9c19 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:57.837920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb3a77-eead-4a6e-9a31-bf9e63ca0d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:57.838731 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb3a77-eead-4a6e-9a31-bf9e63ca0d3f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:57.839013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb3a77-eead-4a6e-9a31-bf9e63ca0d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:57.839293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb3a77-eead-4a6e-9a31-bf9e63ca0d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:57.858230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb3a77-eead-4a6e-9a31-bf9e63ca0d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:57.859689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb3a77-eead-4a6e-9a31-bf9e63ca0d3f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2cbb3a77-eead-4a6e-9a31-bf9e63ca0d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:57.890993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:57.892042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:57.892962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:57.892962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:57.892962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:57.892962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:57.894233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 363/727] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:57.900216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb3a77-eead-4a6e-9a31-bf9e63ca0d3f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:57.902902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff3daf-57bf-450b-9abd-4bca2183c63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:57.903824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff3daf-57bf-450b-9abd-4bca2183c63b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:57.904354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff3daf-57bf-450b-9abd-4bca2183c63b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:57.904859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff3daf-57bf-450b-9abd-4bca2183c63b None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:57.905957 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff3daf-57bf-450b-9abd-4bca2183c63b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:57.906725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff3daf-57bf-450b-9abd-4bca2183c63b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:57.908850 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff3daf-57bf-450b-9abd-4bca2183c63b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:57.918318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 365/728] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:10:57.929342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff3daf-57bf-450b-9abd-4bca2183c63b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:58.019588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb3a77-eead-4a6e-9a31-bf9e63ca0d3f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:58.023745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:58.090607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec7fd5-34e1-45f4-8182-d969b4c0a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:58.091227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec7fd5-34e1-45f4-8182-d969b4c0a22e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.091553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec7fd5-34e1-45f4-8182-d969b4c0a22e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.091830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec7fd5-34e1-45f4-8182-d969b4c0a22e None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.092622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec7fd5-34e1-45f4-8182-d969b4c0a22e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:58.092979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec7fd5-34e1-45f4-8182-d969b4c0a22e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:58.094381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec7fd5-34e1-45f4-8182-d969b4c0a22e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:58.107238 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 364/729] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:58.108739 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10c4c2-178c-44f2-a7cb-966fc98e1e0c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.109032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10c4c2-178c-44f2-a7cb-966fc98e1e0c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.109309 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10c4c2-178c-44f2-a7cb-966fc98e1e0c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.110539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:58.110891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 365/730] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:58.113425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10c4c2-178c-44f2-a7cb-966fc98e1e0c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:58.124941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff3daf-57bf-450b-9abd-4bca2183c63b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:58.164280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a54564-4b0c-41be-981e-5f6cca653f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:58.165079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54564-4b0c-41be-981e-5f6cca653f19 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.165368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54564-4b0c-41be-981e-5f6cca653f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.165648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a54564-4b0c-41be-981e-5f6cca653f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.176717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a54564-4b0c-41be-981e-5f6cca653f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:58.178777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a54564-4b0c-41be-981e-5f6cca653f19 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-42a54564-4b0c-41be-981e-5f6cca653f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:58.196391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:58.205184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:58.206450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:58.206450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:58.206450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:58.206450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:58.206450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 366/731] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:58.206450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92063968-34cf-4387-9973-0fcf9ca8b927 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.206450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92063968-34cf-4387-9973-0fcf9ca8b927 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.206450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92063968-34cf-4387-9973-0fcf9ca8b927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.222342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-92063968-34cf-4387-9973-0fcf9ca8b927 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:58.223558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-92063968-34cf-4387-9973-0fcf9ca8b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:58.231461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10c4c2-178c-44f2-a7cb-966fc98e1e0c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:58.268454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8c7e-7fbf-4333-8f9e-8c06fdf21d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:58.269297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8c7e-7fbf-4333-8f9e-8c06fdf21d7f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.269576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8c7e-7fbf-4333-8f9e-8c06fdf21d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.269848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8c7e-7fbf-4333-8f9e-8c06fdf21d7f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.278241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a8c7e-7fbf-4333-8f9e-8c06fdf21d7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:58.279698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a8c7e-7fbf-4333-8f9e-8c06fdf21d7f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-052a8c7e-7fbf-4333-8f9e-8c06fdf21d7f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:58.295156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:58.296421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:58.297351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:58.297351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:58.297351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:58.297351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:58.297351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:58.297351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:58.297351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:58.297351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:58.297351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:10:58.297351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:58.297351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 366/732] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 12:10:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:10:58.297957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d313f-63e1-45f0-ba1e-94193976e29c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.297957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d313f-63e1-45f0-ba1e-94193976e29c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.298203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d313f-63e1-45f0-ba1e-94193976e29c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.303639 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 367/733] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:58.303639 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d313f-63e1-45f0-ba1e-94193976e29c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:58.307541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 367/734] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:58.312075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92063968-34cf-4387-9973-0fcf9ca8b927 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:58.329886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:58.395889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:58.413122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d313f-63e1-45f0-ba1e-94193976e29c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:58.429365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92063968-34cf-4387-9973-0fcf9ca8b927 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:58.452686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d03991-8a38-4762-8077-bd2e2560e50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:58.453781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d03991-8a38-4762-8077-bd2e2560e50b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.453781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d03991-8a38-4762-8077-bd2e2560e50b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.453946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d03991-8a38-4762-8077-bd2e2560e50b None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.455202 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d03991-8a38-4762-8077-bd2e2560e50b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:58.455523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d03991-8a38-4762-8077-bd2e2560e50b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:58.457502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d03991-8a38-4762-8077-bd2e2560e50b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:58.471569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 368/735] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:58.472317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69e23d-b034-42e2-b920-1b7980dd9fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:58.473030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a281-c97b-44c8-b31e-e3ea654b6a8f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.473308 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a281-c97b-44c8-b31e-e3ea654b6a8f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.473598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797a281-c97b-44c8-b31e-e3ea654b6a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.473937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69e23d-b034-42e2-b920-1b7980dd9fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.474421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69e23d-b034-42e2-b920-1b7980dd9fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.474993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69e23d-b034-42e2-b920-1b7980dd9fc9 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.475960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69e23d-b034-42e2-b920-1b7980dd9fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:58.476372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69e23d-b034-42e2-b920-1b7980dd9fc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:58.477836 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69e23d-b034-42e2-b920-1b7980dd9fc9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:58.492832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d797a281-c97b-44c8-b31e-e3ea654b6a8f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:58.494343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d797a281-c97b-44c8-b31e-e3ea654b6a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:58.497733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 368/736] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 12:10:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:58.501002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69e23d-b034-42e2-b920-1b7980dd9fc9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:58.565328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 369/737] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:58.566180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797a281-c97b-44c8-b31e-e3ea654b6a8f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:58.581816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:58.610048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69e23d-b034-42e2-b920-1b7980dd9fc9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:58.639934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:58.646407 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615a41e-3769-4fab-8328-29644a916f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:58.647421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615a41e-3769-4fab-8328-29644a916f25 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.647699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615a41e-3769-4fab-8328-29644a916f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.647983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615a41e-3769-4fab-8328-29644a916f25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.658049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615a41e-3769-4fab-8328-29644a916f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f615a41e-3769-4fab-8328-29644a916f25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:10:58.665651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:58.666749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 369/738] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:58.667728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615a41e-3769-4fab-8328-29644a916f25 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:58.671804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797a281-c97b-44c8-b31e-e3ea654b6a8f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:58.707281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175802c5-3ef5-49f1-a7db-bea8c3d677e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:58.708100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175802c5-3ef5-49f1-a7db-bea8c3d677e3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.708390 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175802c5-3ef5-49f1-a7db-bea8c3d677e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.708671 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175802c5-3ef5-49f1-a7db-bea8c3d677e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.716271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175802c5-3ef5-49f1-a7db-bea8c3d677e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:58.717724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175802c5-3ef5-49f1-a7db-bea8c3d677e3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-175802c5-3ef5-49f1-a7db-bea8c3d677e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:58.732531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:58.733495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:58.734431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:58.734431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:58.734431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:58.734431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:58.734431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:58.734431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:58.734431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:58.734431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:58.734431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:10:58.734431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:58.734431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 370/739] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 12:10:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:58.735025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198505f-2d4a-41a5-9d9f-7d3ae85f3648 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.735099 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198505f-2d4a-41a5-9d9f-7d3ae85f3648 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.735378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198505f-2d4a-41a5-9d9f-7d3ae85f3648 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.736653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 371/740] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:10:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:10:58.737334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198505f-2d4a-41a5-9d9f-7d3ae85f3648 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:58.776027 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615a41e-3769-4fab-8328-29644a916f25 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:58.808389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:58.811631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502b90d-89bf-477a-b0ec-78ff489d0c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:58.812229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502b90d-89bf-477a-b0ec-78ff489d0c77 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.812515 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502b90d-89bf-477a-b0ec-78ff489d0c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.812791 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502b90d-89bf-477a-b0ec-78ff489d0c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.839980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198505f-2d4a-41a5-9d9f-7d3ae85f3648 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:58.871808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:58.874226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb14cc-fa02-4462-a2f7-6782931f54ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:58.874966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb14cc-fa02-4462-a2f7-6782931f54ac None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:58.875295 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb14cc-fa02-4462-a2f7-6782931f54ac None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:58.875599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb14cc-fa02-4462-a2f7-6782931f54ac None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:58.876553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb14cc-fa02-4462-a2f7-6782931f54ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:58.877726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb14cc-fa02-4462-a2f7-6782931f54ac None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:58.883265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502b90d-89bf-477a-b0ec-78ff489d0c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:58.884858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502b90d-89bf-477a-b0ec-78ff489d0c77 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:58.893266 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 372/741] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:10:58 2022] POST /identity/v3/services => generated 240 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:10:58.894151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb14cc-fa02-4462-a2f7-6782931f54ac None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:59.006041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 370/742] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 12:10:59.006041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502b90d-89bf-477a-b0ec-78ff489d0c77 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:59.022254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb14cc-fa02-4462-a2f7-6782931f54ac None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:59.053586 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:59.064535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe3032-9199-428b-8f07-5fc5ac879317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:59.065333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe3032-9199-428b-8f07-5fc5ac879317 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:59.065509 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe3032-9199-428b-8f07-5fc5ac879317 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:59.065785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe3032-9199-428b-8f07-5fc5ac879317 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:59.066543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe3032-9199-428b-8f07-5fc5ac879317 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:59.066856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe3032-9199-428b-8f07-5fc5ac879317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:59.068255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe3032-9199-428b-8f07-5fc5ac879317 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:59.078003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 373/743] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:59.079267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63729e-fe6c-4192-a3de-b17978ac2d1e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:59.079866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63729e-fe6c-4192-a3de-b17978ac2d1e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:59.079866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63729e-fe6c-4192-a3de-b17978ac2d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:59.096863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cd63729e-fe6c-4192-a3de-b17978ac2d1e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:10:59.098061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cd63729e-fe6c-4192-a3de-b17978ac2d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:10:59.113343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:59.126331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502b90d-89bf-477a-b0ec-78ff489d0c77 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:59.164414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5d0be-ade5-469e-9f4d-9cfd8152cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:59.165092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5d0be-ade5-469e-9f4d-9cfd8152cd5c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:59.165363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5d0be-ade5-469e-9f4d-9cfd8152cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:59.165638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5d0be-ade5-469e-9f4d-9cfd8152cd5c None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:59.166476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5d0be-ade5-469e-9f4d-9cfd8152cd5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:59.166891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5d0be-ade5-469e-9f4d-9cfd8152cd5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:59.168304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5d0be-ade5-469e-9f4d-9cfd8152cd5c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:59.180051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 374/744] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:10:59 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 12:10:59.180051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63729e-fe6c-4192-a3de-b17978ac2d1e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:59.192351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 371/745] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 12:10:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:59.193317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5d0be-ade5-469e-9f4d-9cfd8152cd5c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:59.285838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63729e-fe6c-4192-a3de-b17978ac2d1e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:59.297196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5d0be-ade5-469e-9f4d-9cfd8152cd5c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:59.307291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:59.324228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b50e5-6d0b-4c36-9f2f-163ce526838a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:59.325044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b50e5-6d0b-4c36-9f2f-163ce526838a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:59.325329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b50e5-6d0b-4c36-9f2f-163ce526838a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:59.325614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b50e5-6d0b-4c36-9f2f-163ce526838a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:59.332364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5180c2-9f6b-48b4-876e-4909faa2a55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:59.333150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5180c2-9f6b-48b4-876e-4909faa2a55d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:59.333434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5180c2-9f6b-48b4-876e-4909faa2a55d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:59.333712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5180c2-9f6b-48b4-876e-4909faa2a55d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:59.337147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b50e5-6d0b-4c36-9f2f-163ce526838a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:59.338611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b50e5-6d0b-4c36-9f2f-163ce526838a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:59.344560 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5180c2-9f6b-48b4-876e-4909faa2a55d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:59.345988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5180c2-9f6b-48b4-876e-4909faa2a55d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:59.354463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-820b50e5-6d0b-4c36-9f2f-163ce526838a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:59.357589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:59.358496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:59.359371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:59.359371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:59.359371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:59.359371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:59.363375 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 375/746] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:59.364161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b50e5-6d0b-4c36-9f2f-163ce526838a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-bd5180c2-9f6b-48b4-876e-4909faa2a55d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:59.364945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:59.366280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:59.367181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:59.367181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:59.367181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:59.367181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:59.371306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 372/747] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:59.372191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5180c2-9f6b-48b4-876e-4909faa2a55d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:59.472878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b50e5-6d0b-4c36-9f2f-163ce526838a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:59.477001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5180c2-9f6b-48b4-876e-4909faa2a55d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:59.508949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7019a5b-4831-4253-8c8e-9be29d28fc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:59.509740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019a5b-4831-4253-8c8e-9be29d28fc75 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:59.510024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019a5b-4831-4253-8c8e-9be29d28fc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:59.510298 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019a5b-4831-4253-8c8e-9be29d28fc75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:59.512462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79f1b-5177-4bc0-8537-bd23ba2e3205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:59.513035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79f1b-5177-4bc0-8537-bd23ba2e3205 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:59.513321 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79f1b-5177-4bc0-8537-bd23ba2e3205 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:59.513601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79f1b-5177-4bc0-8537-bd23ba2e3205 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:59.514493 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed79f1b-5177-4bc0-8537-bd23ba2e3205 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:59.515966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed79f1b-5177-4bc0-8537-bd23ba2e3205 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:59.520995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7019a5b-4831-4253-8c8e-9be29d28fc75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:59.523217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7019a5b-4831-4253-8c8e-9be29d28fc75 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:59.532600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 373/748] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:10:59 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:10:59.534302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79f1b-5177-4bc0-8537-bd23ba2e3205 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e7019a5b-4831-4253-8c8e-9be29d28fc75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:10:59.542765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:59.543727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:59.544681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:10:59.544681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:10:59.544681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:10:59.544681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:10:59.544681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 376/749] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:59.545642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7019a5b-4831-4253-8c8e-9be29d28fc75 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:59.575977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:59.640988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:59.685415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7019a5b-4831-4253-8c8e-9be29d28fc75 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:59.709537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79f1b-5177-4bc0-8537-bd23ba2e3205 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:59.735644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f3d15-3ea5-44b8-92a3-8ea5d456b5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:59.736640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f3d15-3ea5-44b8-92a3-8ea5d456b5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:59.736929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f3d15-3ea5-44b8-92a3-8ea5d456b5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:59.737317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f3d15-3ea5-44b8-92a3-8ea5d456b5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:59.738054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f3d15-3ea5-44b8-92a3-8ea5d456b5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:59.738362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f3d15-3ea5-44b8-92a3-8ea5d456b5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:59.739747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f3d15-3ea5-44b8-92a3-8ea5d456b5a2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:59.752974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 377/750] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:59.756162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f3d15-3ea5-44b8-92a3-8ea5d456b5a2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:59.757361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d6a58-c1f6-4d3a-9ee3-7c8249912eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:59.758130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d6a58-c1f6-4d3a-9ee3-7c8249912eaa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:59.758421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d6a58-c1f6-4d3a-9ee3-7c8249912eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:59.758703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d6a58-c1f6-4d3a-9ee3-7c8249912eaa None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:59.759444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d6a58-c1f6-4d3a-9ee3-7c8249912eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:59.759756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d6a58-c1f6-4d3a-9ee3-7c8249912eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:59.761166 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d6a58-c1f6-4d3a-9ee3-7c8249912eaa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:59.776498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 374/751] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:59.777823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d6a58-c1f6-4d3a-9ee3-7c8249912eaa None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:59.859201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:59.882031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f3d15-3ea5-44b8-92a3-8ea5d456b5a2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:59.917607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d6a58-c1f6-4d3a-9ee3-7c8249912eaa None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:10:59.926070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83bd54-19cd-4936-8f06-ac0669139cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:59.927453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83bd54-19cd-4936-8f06-ac0669139cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:59.928509 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83bd54-19cd-4936-8f06-ac0669139cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:59.928891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83bd54-19cd-4936-8f06-ac0669139cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:59.929720 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83bd54-19cd-4936-8f06-ac0669139cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:10:59.930124 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83bd54-19cd-4936-8f06-ac0669139cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:59.932347 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83bd54-19cd-4936-8f06-ac0669139cf5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:59.941284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:10:59.947156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 378/752] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:10:59.947711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83bd54-19cd-4936-8f06-ac0669139cf5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:10:59.962963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee988e-1e2e-4bb3-8d07-05f81def03c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:10:59.964231 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee988e-1e2e-4bb3-8d07-05f81def03c6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:10:59.964769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee988e-1e2e-4bb3-8d07-05f81def03c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:10:59.965283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee988e-1e2e-4bb3-8d07-05f81def03c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:10:59.973934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee988e-1e2e-4bb3-8d07-05f81def03c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:10:59.976445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee988e-1e2e-4bb3-8d07-05f81def03c6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-6fee988e-1e2e-4bb3-8d07-05f81def03c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:10:59.993245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:10:59.994236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:10:59.995182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:10:59.995182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:10:59.995182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:10:59.995182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:10:59.995182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:10:59.995182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:10:59.995182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:10:59.995182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:10:59.995182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:10:59.995182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:10:59.998107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 375/753] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:10:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:10:59.999188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee988e-1e2e-4bb3-8d07-05f81def03c6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:00.059768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83bd54-19cd-4936-8f06-ac0669139cf5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:00.104831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caf3af-01c6-46a2-bd6f-71baa1cf89dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:00.105561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf3af-01c6-46a2-bd6f-71baa1cf89dc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:00.105846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf3af-01c6-46a2-bd6f-71baa1cf89dc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:00.106123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf3af-01c6-46a2-bd6f-71baa1cf89dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:00.111661 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee988e-1e2e-4bb3-8d07-05f81def03c6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:00.117122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caf3af-01c6-46a2-bd6f-71baa1cf89dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:00.119453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caf3af-01c6-46a2-bd6f-71baa1cf89dc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b3caf3af-01c6-46a2-bd6f-71baa1cf89dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:00.140112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:00.141845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:00.142988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:00.142988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:00.142988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:00.142988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:00.142988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:00.142988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:00.142988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:00.142988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:00.147143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 379/754] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:00.148618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caf3af-01c6-46a2-bd6f-71baa1cf89dc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:00.152249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb9400-1134-4733-bb70-5d6079469f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:00.153173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9400-1134-4733-bb70-5d6079469f0f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:00.153745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9400-1134-4733-bb70-5d6079469f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:00.154166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:00.155232 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9400-1134-4733-bb70-5d6079469f0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:00.165112 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb9400-1134-4733-bb70-5d6079469f0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:00.166976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb9400-1134-4733-bb70-5d6079469f0f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-3dbb9400-1134-4733-bb70-5d6079469f0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:00.182774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:00.183775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:00.184677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:00.184677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:00.184677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:00.184677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:00.184677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:00.184677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:00.184677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:00.184677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:00.187213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 376/755] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:00.188287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb9400-1134-4733-bb70-5d6079469f0f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:00.232728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:00.276418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caf3af-01c6-46a2-bd6f-71baa1cf89dc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:00.312743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b2a09-c9c2-40f7-8d5a-d32fdd13f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:00.313417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b2a09-c9c2-40f7-8d5a-d32fdd13f11e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:00.313699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b2a09-c9c2-40f7-8d5a-d32fdd13f11e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:00.313974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b2a09-c9c2-40f7-8d5a-d32fdd13f11e None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:00.314815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b2a09-c9c2-40f7-8d5a-d32fdd13f11e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:00.315123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b2a09-c9c2-40f7-8d5a-d32fdd13f11e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:00.316622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b2a09-c9c2-40f7-8d5a-d32fdd13f11e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:00.324779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb9400-1134-4733-bb70-5d6079469f0f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:00.340168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 380/756] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 12:11:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:00.340168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b2a09-c9c2-40f7-8d5a-d32fdd13f11e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:00.370324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d61a7-39a0-4111-83d6-39e7219c87b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:00.371287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d61a7-39a0-4111-83d6-39e7219c87b2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:00.371287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d61a7-39a0-4111-83d6-39e7219c87b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:00.371482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d61a7-39a0-4111-83d6-39e7219c87b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:00.372325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d61a7-39a0-4111-83d6-39e7219c87b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:00.372636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d61a7-39a0-4111-83d6-39e7219c87b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:00.374068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d61a7-39a0-4111-83d6-39e7219c87b2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:00.386731 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 377/757] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:00.387696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d61a7-39a0-4111-83d6-39e7219c87b2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:00.427159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:00.472895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b2a09-c9c2-40f7-8d5a-d32fdd13f11e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:00.510574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:00.510890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef19835-c90f-4f5c-8bc2-ee6da4bf73cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:00.511697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef19835-c90f-4f5c-8bc2-ee6da4bf73cb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:00.511964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef19835-c90f-4f5c-8bc2-ee6da4bf73cb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:00.512468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef19835-c90f-4f5c-8bc2-ee6da4bf73cb None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:00.513585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef19835-c90f-4f5c-8bc2-ee6da4bf73cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:00.514273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef19835-c90f-4f5c-8bc2-ee6da4bf73cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:00.516294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef19835-c90f-4f5c-8bc2-ee6da4bf73cb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:00.520459 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d61a7-39a0-4111-83d6-39e7219c87b2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:00.532860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 381/758] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:00.534225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef19835-c90f-4f5c-8bc2-ee6da4bf73cb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:00.561007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce68a-a034-4937-87a9-fd9bd062b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:00.561950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce68a-a034-4937-87a9-fd9bd062b813 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:00.562387 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce68a-a034-4937-87a9-fd9bd062b813 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:00.562906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce68a-a034-4937-87a9-fd9bd062b813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:00.639265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ce68a-a034-4937-87a9-fd9bd062b813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:00.641422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ce68a-a034-4937-87a9-fd9bd062b813 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:00.647428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef19835-c90f-4f5c-8bc2-ee6da4bf73cb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:00.672639 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:00.691851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9de287-615e-4264-9f99-a15654d02b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:00.693106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9de287-615e-4264-9f99-a15654d02b48 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:00.694395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9de287-615e-4264-9f99-a15654d02b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:00.694856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9de287-615e-4264-9f99-a15654d02b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:00.696013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9de287-615e-4264-9f99-a15654d02b48 None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=d8a79dc2ab494cb6aaf3b1f4001b7524) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:00.696502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9de287-615e-4264-9f99-a15654d02b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:00.698839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9de287-615e-4264-9f99-a15654d02b48 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:00.706642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 382/759] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:00 2022] GET /identity/v3/role_assignments?user.id=d8a79dc2ab494cb6aaf3b1f4001b7524&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:00.708220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9de287-615e-4264-9f99-a15654d02b48 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:00.766399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:00.774738 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 378/760] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:11:00.781508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce68a-a034-4937-87a9-fd9bd062b813 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:00.948110 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce68a-a034-4937-87a9-fd9bd062b813 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:00.949617 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9de287-615e-4264-9f99-a15654d02b48 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:01.017320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0e6c9-5d21-4c65-b1fa-4008732ce016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:01.018779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0e6c9-5d21-4c65-b1fa-4008732ce016 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:01.020010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0e6c9-5d21-4c65-b1fa-4008732ce016 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:01.020966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0e6c9-5d21-4c65-b1fa-4008732ce016 None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/1df703568a334eea9550ac643d87b5fe/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:01.024933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0e6c9-5d21-4c65-b1fa-4008732ce016 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=1df703568a334eea9550ac643d87b5fe, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:01.027395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0e6c9-5d21-4c65-b1fa-4008732ce016 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:01.030794 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6e8b-6a60-4fd5-8269-76b31af2a4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:01.031849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6e8b-6a60-4fd5-8269-76b31af2a4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:01.032373 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6e8b-6a60-4fd5-8269-76b31af2a4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:01.032845 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6e8b-6a60-4fd5-8269-76b31af2a4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:01.047253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc6e8b-6a60-4fd5-8269-76b31af2a4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:01.049494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc6e8b-6a60-4fd5-8269-76b31af2a4e2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:01.052842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 383/761] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:11:00 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/1df703568a334eea9550ac643d87b5fe/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:11:01.060046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088859-232d-4d43-982a-b1aeea2fb523 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:01.060046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088859-232d-4d43-982a-b1aeea2fb523 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:01.060046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088859-232d-4d43-982a-b1aeea2fb523 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:01.060795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 384/762] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:01.062382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4066-333f-45e4-86f6-a0f54af79a03 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:01.062679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4066-333f-45e4-86f6-a0f54af79a03 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:01.062957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4066-333f-45e4-86f6-a0f54af79a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:01.081005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-544f4066-333f-45e4-86f6-a0f54af79a03 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c0dc6e8b-6a60-4fd5-8269-76b31af2a4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:01.081581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:01.082454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:01.083377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:01.083377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:01.083377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:01.083377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:01.083607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-544f4066-333f-45e4-86f6-a0f54af79a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:01.094572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 379/763] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:01.100761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6e8b-6a60-4fd5-8269-76b31af2a4e2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:01.133854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:01.172499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 385/764] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:01.189162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4066-333f-45e4-86f6-a0f54af79a03 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:01.230536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:01.308752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4066-333f-45e4-86f6-a0f54af79a03 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:01.327753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6e8b-6a60-4fd5-8269-76b31af2a4e2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:01.364464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95fd78-a31a-4b30-a3ec-69ee470aced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:01.366296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95fd78-a31a-4b30-a3ec-69ee470aced0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:01.366910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95fd78-a31a-4b30-a3ec-69ee470aced0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:01.367710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95fd78-a31a-4b30-a3ec-69ee470aced0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:01.368888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95fd78-a31a-4b30-a3ec-69ee470aced0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:01.370854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95fd78-a31a-4b30-a3ec-69ee470aced0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:01.372623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d526ba-d9d6-4e52-88a1-477b5c040830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:01.373363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d526ba-d9d6-4e52-88a1-477b5c040830 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:01.373743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d526ba-d9d6-4e52-88a1-477b5c040830 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:01.374080 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d526ba-d9d6-4e52-88a1-477b5c040830 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:01.374887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d526ba-d9d6-4e52-88a1-477b5c040830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:01.375360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d526ba-d9d6-4e52-88a1-477b5c040830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:01.376760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d526ba-d9d6-4e52-88a1-477b5c040830 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-aa95fd78-a31a-4b30-a3ec-69ee470aced0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:01.387443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:01.388499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 12:11:01.389318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:01.392317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 386/766] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:01 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:01.396051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 380/766] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:01.397323 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95fd78-a31a-4b30-a3ec-69ee470aced0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:01.398571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d526ba-d9d6-4e52-88a1-477b5c040830 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:01.474652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:01.567254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95fd78-a31a-4b30-a3ec-69ee470aced0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:01.608287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df478-be4c-4ae8-9f73-787705a1ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:01.609529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df478-be4c-4ae8-9f73-787705a1ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:01.609962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df478-be4c-4ae8-9f73-787705a1ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:01.610422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df478-be4c-4ae8-9f73-787705a1ecb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:01.619229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866df478-be4c-4ae8-9f73-787705a1ecb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:01.621232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866df478-be4c-4ae8-9f73-787705a1ecb7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-866df478-be4c-4ae8-9f73-787705a1ecb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:01.637234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:01.638320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:01.639403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:01.639403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:01.639403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:01.639403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:01.639403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:01.639403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:01.639403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:01.639403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:01.639888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d526ba-d9d6-4e52-88a1-477b5c040830 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:01.647923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 387/767] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:01.649397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df478-be4c-4ae8-9f73-787705a1ecb7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:01.660423 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:01.712557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d78a0-d5a3-4c3b-91a3-df3435fcb5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:01.713254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d78a0-d5a3-4c3b-91a3-df3435fcb5db None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:01.713544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d78a0-d5a3-4c3b-91a3-df3435fcb5db None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:01.713826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d78a0-d5a3-4c3b-91a3-df3435fcb5db None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:01.714556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d78a0-d5a3-4c3b-91a3-df3435fcb5db None admin] RBAC: Adding query filter params (name=network) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:01.714867 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d78a0-d5a3-4c3b-91a3-df3435fcb5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:01.728530 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d78a0-d5a3-4c3b-91a3-df3435fcb5db None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:01.742805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 381/768] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:11:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:01.747905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d78a0-d5a3-4c3b-91a3-df3435fcb5db None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:01.768650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df478-be4c-4ae8-9f73-787705a1ecb7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:01.770812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:01.816261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc1ab8-8d09-4ba0-8492-ec5a87198cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:01.817454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc1ab8-8d09-4ba0-8492-ec5a87198cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:01.817896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc1ab8-8d09-4ba0-8492-ec5a87198cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:01.818376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc1ab8-8d09-4ba0-8492-ec5a87198cd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:01.819340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc1ab8-8d09-4ba0-8492-ec5a87198cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:01.819801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc1ab8-8d09-4ba0-8492-ec5a87198cd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:01.821858 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc1ab8-8d09-4ba0-8492-ec5a87198cd1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:01.846919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 388/769] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:01.848579 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc1ab8-8d09-4ba0-8492-ec5a87198cd1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:01.938688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d78a0-d5a3-4c3b-91a3-df3435fcb5db None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:01.976533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc1ab8-8d09-4ba0-8492-ec5a87198cd1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:01.982180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890c23f-dbc3-4666-9c0d-01d8a4ae3595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:01.982858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c23f-dbc3-4666-9c0d-01d8a4ae3595 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:01.983146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c23f-dbc3-4666-9c0d-01d8a4ae3595 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:01.983429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c23f-dbc3-4666-9c0d-01d8a4ae3595 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:01.984204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890c23f-dbc3-4666-9c0d-01d8a4ae3595 None admin] RBAC: Adding query filter params (type=network) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:01.984625 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890c23f-dbc3-4666-9c0d-01d8a4ae3595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:01.986031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890c23f-dbc3-4666-9c0d-01d8a4ae3595 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:01.995047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 382/770] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:11:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:01.996842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55123559-47ea-422a-86e5-190762ed7d9d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:01.997472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55123559-47ea-422a-86e5-190762ed7d9d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:01.997823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55123559-47ea-422a-86e5-190762ed7d9d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:01.999605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 383/771] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:02.000514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55123559-47ea-422a-86e5-190762ed7d9d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:02.021219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2eff5f-2119-4d3c-a57c-d7cfafbbbfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:02.022222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eff5f-2119-4d3c-a57c-d7cfafbbbfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:02.022507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eff5f-2119-4d3c-a57c-d7cfafbbbfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:02.022783 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eff5f-2119-4d3c-a57c-d7cfafbbbfe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:02.024365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eff5f-2119-4d3c-a57c-d7cfafbbbfe8 None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=254b5c1a59e94596bf942192b4a30ac0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:02.024706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eff5f-2119-4d3c-a57c-d7cfafbbbfe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:02.026192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eff5f-2119-4d3c-a57c-d7cfafbbbfe8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:02.035062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 389/772] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:01 2022] GET /identity/v3/role_assignments?user.id=254b5c1a59e94596bf942192b4a30ac0&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:02.036642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e397ad-4667-4ff7-8dbb-f0608527bc8e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:02.037763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e397ad-4667-4ff7-8dbb-f0608527bc8e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:02.038053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e397ad-4667-4ff7-8dbb-f0608527bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:02.044567 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:02.063003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-12e397ad-4667-4ff7-8dbb-f0608527bc8e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:02.064424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-12e397ad-4667-4ff7-8dbb-f0608527bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:02.085910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:02.136978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55123559-47ea-422a-86e5-190762ed7d9d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:02.150386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 390/773] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:02.185507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4feaa-401e-43d0-8016-43d0e3cb00ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:02.186228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4feaa-401e-43d0-8016-43d0e3cb00ea None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:02.186512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4feaa-401e-43d0-8016-43d0e3cb00ea None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:02.186790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4feaa-401e-43d0-8016-43d0e3cb00ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:02.187666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4feaa-401e-43d0-8016-43d0e3cb00ea None admin] RBAC: Adding query filter params (interface=public, service_id=339d2ba3c016495594cc81440723cff8, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:02.187977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4feaa-401e-43d0-8016-43d0e3cb00ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:02.189522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4feaa-401e-43d0-8016-43d0e3cb00ea None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:02.197247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e397ad-4667-4ff7-8dbb-f0608527bc8e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:02.201597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 384/774] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 12:11:01 2022] GET /identity/v3/endpoints?service_id=339d2ba3c016495594cc81440723cff8&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:02.209276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4feaa-401e-43d0-8016-43d0e3cb00ea None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:02.343355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e397ad-4667-4ff7-8dbb-f0608527bc8e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:02.381488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd63004-9d53-48fe-bb61-9e10570b97e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:02.382692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63004-9d53-48fe-bb61-9e10570b97e4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:02.383252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63004-9d53-48fe-bb61-9e10570b97e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:02.383735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63004-9d53-48fe-bb61-9e10570b97e4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:02.384620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd63004-9d53-48fe-bb61-9e10570b97e4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:02.386207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd63004-9d53-48fe-bb61-9e10570b97e4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7dd63004-9d53-48fe-bb61-9e10570b97e4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:02.400507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:02.401484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 12:11:02.402391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:02.405198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 391/775] 10.222.0.66 () {56 vars in 1129 bytes} [Wed Jun 22 12:11:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:02.418833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd63004-9d53-48fe-bb61-9e10570b97e4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:02.421882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:02.427569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4feaa-401e-43d0-8016-43d0e3cb00ea None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:02.451319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:02.504560 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e84f7e-54c9-4308-a076-809acdc53986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:02.505266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84f7e-54c9-4308-a076-809acdc53986 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:02.505539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84f7e-54c9-4308-a076-809acdc53986 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:02.505941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84f7e-54c9-4308-a076-809acdc53986 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:02.506640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e84f7e-54c9-4308-a076-809acdc53986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:02.508010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e84f7e-54c9-4308-a076-809acdc53986 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:02.521038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 385/776] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 12:11:02 2022] GET /identity/v3/services => generated 772 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:02.549837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd63004-9d53-48fe-bb61-9e10570b97e4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:02.626547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6edb5-0c28-42d8-86ab-ee12a6480556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:02.627571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6edb5-0c28-42d8-86ab-ee12a6480556 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:02.628001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6edb5-0c28-42d8-86ab-ee12a6480556 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:02.628444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6edb5-0c28-42d8-86ab-ee12a6480556 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:02.629306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6edb5-0c28-42d8-86ab-ee12a6480556 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:02.629777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6edb5-0c28-42d8-86ab-ee12a6480556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:02.631371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6edb5-0c28-42d8-86ab-ee12a6480556 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:02.643009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 392/777] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 12:11:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:02.648987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e84f7e-54c9-4308-a076-809acdc53986 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:02.784134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e84f7e-54c9-4308-a076-809acdc53986 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:02.837284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9819-b452-4153-90ca-fae6030215e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:02.838255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9819-b452-4153-90ca-fae6030215e3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:02.838739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9819-b452-4153-90ca-fae6030215e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:02.839245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9819-b452-4153-90ca-fae6030215e3 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:02.840207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec9819-b452-4153-90ca-fae6030215e3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:02.840713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec9819-b452-4153-90ca-fae6030215e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:02.842285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec9819-b452-4153-90ca-fae6030215e3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:02.848473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 386/778] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 12:11:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:02.854329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6edb5-0c28-42d8-86ab-ee12a6480556 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:02.971113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:02.994167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6edb5-0c28-42d8-86ab-ee12a6480556 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:03.049869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71f66-8daf-4ae4-9fc3-d2e2ef4eb876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:03.050546 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71f66-8daf-4ae4-9fc3-d2e2ef4eb876 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:03.050835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71f66-8daf-4ae4-9fc3-d2e2ef4eb876 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:03.051117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71f66-8daf-4ae4-9fc3-d2e2ef4eb876 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:03.051917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd71f66-8daf-4ae4-9fc3-d2e2ef4eb876 None admin] RBAC: Adding query filter params (interface=public, service_id=f7dcf77631c441eaad17188d8b6c6594, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:03.052263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd71f66-8daf-4ae4-9fc3-d2e2ef4eb876 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:03.053712 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd71f66-8daf-4ae4-9fc3-d2e2ef4eb876 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:03.066782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 393/779] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 12:11:02 2022] GET /identity/v3/endpoints?service_id=f7dcf77631c441eaad17188d8b6c6594&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:03.070733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a59b3-8342-424f-ba0c-aee6caed8d14 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:03.071278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a59b3-8342-424f-ba0c-aee6caed8d14 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:03.071779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a59b3-8342-424f-ba0c-aee6caed8d14 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:03.072609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71f66-8daf-4ae4-9fc3-d2e2ef4eb876 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:03.073902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 387/780] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:03.079420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c22be-76f3-4a76-9968-4365bfca0151 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:03.080036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c22be-76f3-4a76-9968-4365bfca0151 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:03.080530 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c22be-76f3-4a76-9968-4365bfca0151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:03.098247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4e6c22be-76f3-4a76-9968-4365bfca0151 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:03.100592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4e6c22be-76f3-4a76-9968-4365bfca0151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:03.142646 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:03.224195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 388/781] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:03.252324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c22be-76f3-4a76-9968-4365bfca0151 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:03.268774 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71f66-8daf-4ae4-9fc3-d2e2ef4eb876 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:03.331008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4335702-8583-4031-9d00-7cc627903eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:03.332070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4335702-8583-4031-9d00-7cc627903eba None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:03.332596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4335702-8583-4031-9d00-7cc627903eba None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:03.335060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4335702-8583-4031-9d00-7cc627903eba None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:03.335970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4335702-8583-4031-9d00-7cc627903eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:03.337642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4335702-8583-4031-9d00-7cc627903eba None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:03.349815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 394/782] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 12:11:03 2022] GET /identity/v3/services => generated 772 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:03.414265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c22be-76f3-4a76-9968-4365bfca0151 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:03.464330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf717b3a-c162-4282-a2ce-d19bf5a331c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:03.465934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf717b3a-c162-4282-a2ce-d19bf5a331c7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:03.466597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf717b3a-c162-4282-a2ce-d19bf5a331c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:03.467079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf717b3a-c162-4282-a2ce-d19bf5a331c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:03.484218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf717b3a-c162-4282-a2ce-d19bf5a331c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-cf717b3a-c162-4282-a2ce-d19bf5a331c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:03.493441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:03.494437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:11:03.495279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:03.498311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 389/783] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:11:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:03.504791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4335702-8583-4031-9d00-7cc627903eba None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:03.521115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:03.579950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771db9df-275e-4f4d-ab33-842d36f44d5e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:03.580640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771db9df-275e-4f4d-ab33-842d36f44d5e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:03.581133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771db9df-275e-4f4d-ab33-842d36f44d5e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:03.582865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 390/784] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:03.590221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b463-d604-4585-9cf2-290599cddf07 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:03.590537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b463-d604-4585-9cf2-290599cddf07 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:03.590780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b463-d604-4585-9cf2-290599cddf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:03.614222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0c91b463-d604-4585-9cf2-290599cddf07 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:03.615466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0c91b463-d604-4585-9cf2-290599cddf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:03.632081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:03.655979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4335702-8583-4031-9d00-7cc627903eba None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:03.704195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f9af-44d5-4785-b558-79371a580507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:03.705576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f9af-44d5-4785-b558-79371a580507 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:03.705576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f9af-44d5-4785-b558-79371a580507 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:03.705576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f9af-44d5-4785-b558-79371a580507 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:03.706154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3f9af-44d5-4785-b558-79371a580507 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:03.707367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3f9af-44d5-4785-b558-79371a580507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:03.707846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3f9af-44d5-4785-b558-79371a580507 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:03.716569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 391/785] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:03.721168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 395/786] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:11:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:03.727976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91b463-d604-4585-9cf2-290599cddf07 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:03.744458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f9af-44d5-4785-b558-79371a580507 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:03.892923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:03.921108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f9af-44d5-4785-b558-79371a580507 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:03.933527 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91b463-d604-4585-9cf2-290599cddf07 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:03.961158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f9901-bba9-42b2-8ce2-50ec4768c78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:03.962104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9901-bba9-42b2-8ce2-50ec4768c78d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:03.962477 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9901-bba9-42b2-8ce2-50ec4768c78d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:03.962863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f9901-bba9-42b2-8ce2-50ec4768c78d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:03.975386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f9901-bba9-42b2-8ce2-50ec4768c78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-a56f9901-bba9-42b2-8ce2-50ec4768c78d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:03.983742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:03.984687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:03.985514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:03.986351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 396/787] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:11:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:03.993283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f9901-bba9-42b2-8ce2-50ec4768c78d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:04.022743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f6501-91d1-4e30-a61a-fc8235cdfed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:04.023473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f6501-91d1-4e30-a61a-fc8235cdfed9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:04.023753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f6501-91d1-4e30-a61a-fc8235cdfed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:04.024043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f6501-91d1-4e30-a61a-fc8235cdfed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:04.050981 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f6501-91d1-4e30-a61a-fc8235cdfed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:04.052483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f6501-91d1-4e30-a61a-fc8235cdfed9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:04.073966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-807f6501-91d1-4e30-a61a-fc8235cdfed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:04.085498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:04.086427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:04.087717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:04.087717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:04.087717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:04.087717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:04.087717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 392/788] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:04.101802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f6501-91d1-4e30-a61a-fc8235cdfed9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:04.110311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f9901-bba9-42b2-8ce2-50ec4768c78d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:04.142698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:04.146229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5edeba-c99d-49e4-a217-22023dcb0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:04.147446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5edeba-c99d-49e4-a217-22023dcb0074 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:04.147741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5edeba-c99d-49e4-a217-22023dcb0074 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:04.148051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5edeba-c99d-49e4-a217-22023dcb0074 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:04.148819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5edeba-c99d-49e4-a217-22023dcb0074 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:04.149140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5edeba-c99d-49e4-a217-22023dcb0074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:04.150548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5edeba-c99d-49e4-a217-22023dcb0074 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:04.160490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 397/789] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:11:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:04.166403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5edeba-c99d-49e4-a217-22023dcb0074 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:04.304346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f6501-91d1-4e30-a61a-fc8235cdfed9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:04.335475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5edeba-c99d-49e4-a217-22023dcb0074 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:04.374618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256a35b-0ed3-4e7f-ad2e-2d9d410dd43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:04.375644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a35b-0ed3-4e7f-ad2e-2d9d410dd43c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:04.376186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a35b-0ed3-4e7f-ad2e-2d9d410dd43c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:04.376756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a35b-0ed3-4e7f-ad2e-2d9d410dd43c None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:04.377852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256a35b-0ed3-4e7f-ad2e-2d9d410dd43c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:04.379376 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256a35b-0ed3-4e7f-ad2e-2d9d410dd43c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:04.381697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256a35b-0ed3-4e7f-ad2e-2d9d410dd43c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:04.396123 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 393/790] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:04.404311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256a35b-0ed3-4e7f-ad2e-2d9d410dd43c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:04.414608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33a85-7f71-481b-aa54-2512d0fe5034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:04.415419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33a85-7f71-481b-aa54-2512d0fe5034 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:04.416045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33a85-7f71-481b-aa54-2512d0fe5034 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:04.416337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33a85-7f71-481b-aa54-2512d0fe5034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:04.433183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e33a85-7f71-481b-aa54-2512d0fe5034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:04.434823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e33a85-7f71-481b-aa54-2512d0fe5034 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f8e33a85-7f71-481b-aa54-2512d0fe5034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:04.454695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:04.455676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:04.456601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:04.456601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:04.456601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:04.456601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:04.462511 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 398/791] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:04.462511 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33a85-7f71-481b-aa54-2512d0fe5034 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:04.524607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:04.559375 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:04.594905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256a35b-0ed3-4e7f-ad2e-2d9d410dd43c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:04.619572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33a85-7f71-481b-aa54-2512d0fe5034 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:04.639360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ea762-05a8-4545-a874-bae66a68998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:04.640472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ea762-05a8-4545-a874-bae66a68998c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:04.640762 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ea762-05a8-4545-a874-bae66a68998c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:04.641041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ea762-05a8-4545-a874-bae66a68998c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:04.649674 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ea762-05a8-4545-a874-bae66a68998c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:04.651126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ea762-05a8-4545-a874-bae66a68998c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:04.660160 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29b870-c7fc-4e68-b334-81ec2c6d7fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:04.661258 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29b870-c7fc-4e68-b334-81ec2c6d7fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:04.661752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29b870-c7fc-4e68-b334-81ec2c6d7fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:04.662388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29b870-c7fc-4e68-b334-81ec2c6d7fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:04.663326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29b870-c7fc-4e68-b334-81ec2c6d7fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:04.663837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29b870-c7fc-4e68-b334-81ec2c6d7fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:04.665454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29b870-c7fc-4e68-b334-81ec2c6d7fe3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c85ea762-05a8-4545-a874-bae66a68998c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:04.665886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:04.666829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:04.667813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:04.667813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:04.667813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:04.667813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:04.667813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:04.667813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:04.667813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:04.667813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:04.667813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:11:04.667813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:04.671740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 394/792] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 12:11:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:04.673136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76650177-9068-4799-8493-75eab6457d90 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:04.673428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76650177-9068-4799-8493-75eab6457d90 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:04.673711 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76650177-9068-4799-8493-75eab6457d90 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:04.675684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 395/793] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:04.676511 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76650177-9068-4799-8493-75eab6457d90 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:04.684735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 399/794] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:04.690726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810df7-8a38-47da-8763-7f7b9579ae53 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:04.691358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810df7-8a38-47da-8763-7f7b9579ae53 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:04.691880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4810df7-8a38-47da-8763-7f7b9579ae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:04.710747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f4810df7-8a38-47da-8763-7f7b9579ae53 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:04.712449 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f4810df7-8a38-47da-8763-7f7b9579ae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:04.783835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76650177-9068-4799-8493-75eab6457d90 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:04.787303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 400/795] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:04.796736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4810df7-8a38-47da-8763-7f7b9579ae53 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:04.820474 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:04.834522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49a7ab-675a-4202-acf7-31e53a2814a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:04.835456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49a7ab-675a-4202-acf7-31e53a2814a2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:04.835993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49a7ab-675a-4202-acf7-31e53a2814a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:04.836523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49a7ab-675a-4202-acf7-31e53a2814a2 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:04.837580 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49a7ab-675a-4202-acf7-31e53a2814a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:04.838096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49a7ab-675a-4202-acf7-31e53a2814a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:04.839887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49a7ab-675a-4202-acf7-31e53a2814a2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:04.843955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:04.863305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 396/796] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 12:11:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:04.864584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49a7ab-675a-4202-acf7-31e53a2814a2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:04.916750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4810df7-8a38-47da-8763-7f7b9579ae53 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:04.953417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b088f-f09f-4196-a352-0875a14a8f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:04.954229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b088f-f09f-4196-a352-0875a14a8f96 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:04.954515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b088f-f09f-4196-a352-0875a14a8f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:04.954794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b088f-f09f-4196-a352-0875a14a8f96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:04.963365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b088f-f09f-4196-a352-0875a14a8f96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:04.964864 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b088f-f09f-4196-a352-0875a14a8f96 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:04.969107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49a7ab-675a-4202-acf7-31e53a2814a2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-a80b088f-f09f-4196-a352-0875a14a8f96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:04.979851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:04.980839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:04.981785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:04.981785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:04.981785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:04.981785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:04.981785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:04.981785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:04.981785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:04.981785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:04.981785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:11:04.981785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:04.986101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 401/797] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 12:11:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:04.987077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b088f-f09f-4196-a352-0875a14a8f96 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:05.009443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d749d-9610-48de-b553-2b99ae1422e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:05.010731 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d749d-9610-48de-b553-2b99ae1422e1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.011229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d749d-9610-48de-b553-2b99ae1422e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.011756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d749d-9610-48de-b553-2b99ae1422e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.023296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d749d-9610-48de-b553-2b99ae1422e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-e79d749d-9610-48de-b553-2b99ae1422e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:05.031470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:05.032458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:05.033333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:05.036170 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 397/798] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:05.037870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d749d-9610-48de-b553-2b99ae1422e1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:05.089149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:05.089336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:05.096629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b088f-f09f-4196-a352-0875a14a8f96 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:05.132983 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036daf6e-bd84-42de-8d00-974cd2dd4ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:05.134487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036daf6e-bd84-42de-8d00-974cd2dd4ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.134779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036daf6e-bd84-42de-8d00-974cd2dd4ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.135058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036daf6e-bd84-42de-8d00-974cd2dd4ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.146279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036daf6e-bd84-42de-8d00-974cd2dd4ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:05.148680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036daf6e-bd84-42de-8d00-974cd2dd4ec3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:05.149159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d749d-9610-48de-b553-2b99ae1422e1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-036daf6e-bd84-42de-8d00-974cd2dd4ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:05.169098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:05.170060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:05.170932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:05.170932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:05.170932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:05.170932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:05.170932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 402/799] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:05.171216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036daf6e-bd84-42de-8d00-974cd2dd4ec3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:05.190011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eaca07-61c9-48f4-a6a1-4af0e62cd595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:05.190689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eaca07-61c9-48f4-a6a1-4af0e62cd595 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.190970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eaca07-61c9-48f4-a6a1-4af0e62cd595 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.191249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eaca07-61c9-48f4-a6a1-4af0e62cd595 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.192125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eaca07-61c9-48f4-a6a1-4af0e62cd595 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:05.192444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eaca07-61c9-48f4-a6a1-4af0e62cd595 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:05.194486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eaca07-61c9-48f4-a6a1-4af0e62cd595 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:05.216093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 398/800] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 12:11:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:05.216093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a901-6fe5-403b-9f91-e69a6c8dcd9d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.216093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a901-6fe5-403b-9f91-e69a6c8dcd9d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.216093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a901-6fe5-403b-9f91-e69a6c8dcd9d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.216093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 399/801] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:05.217120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266a901-6fe5-403b-9f91-e69a6c8dcd9d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:05.286570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036daf6e-bd84-42de-8d00-974cd2dd4ec3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:05.315051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:05.322818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266a901-6fe5-403b-9f91-e69a6c8dcd9d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:05.325084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a8036-0fa3-4b7d-9fd5-7a6a79336220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:05.325769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a8036-0fa3-4b7d-9fd5-7a6a79336220 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.326059 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a8036-0fa3-4b7d-9fd5-7a6a79336220 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.326338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a8036-0fa3-4b7d-9fd5-7a6a79336220 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.327094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a8036-0fa3-4b7d-9fd5-7a6a79336220 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:05.327407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a8036-0fa3-4b7d-9fd5-7a6a79336220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:05.328828 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a8036-0fa3-4b7d-9fd5-7a6a79336220 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:05.342010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 403/802] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:05.342010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a8036-0fa3-4b7d-9fd5-7a6a79336220 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:05.355873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:05.363800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b422b1-a108-4f0f-b6a2-5e5bd599dfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:05.364799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b422b1-a108-4f0f-b6a2-5e5bd599dfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.365155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b422b1-a108-4f0f-b6a2-5e5bd599dfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.365441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b422b1-a108-4f0f-b6a2-5e5bd599dfe1 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.366174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b422b1-a108-4f0f-b6a2-5e5bd599dfe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:05.366483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b422b1-a108-4f0f-b6a2-5e5bd599dfe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:05.368363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b422b1-a108-4f0f-b6a2-5e5bd599dfe1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:05.381676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 400/803] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:05.387323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1484312-11b8-4704-be36-94c249ee5877 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.387623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1484312-11b8-4704-be36-94c249ee5877 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.387904 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1484312-11b8-4704-be36-94c249ee5877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.406576 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d1484312-11b8-4704-be36-94c249ee5877 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:05.407569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d1484312-11b8-4704-be36-94c249ee5877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:05.449361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a8036-0fa3-4b7d-9fd5-7a6a79336220 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:05.481867 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 401/804] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:05.482714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1484312-11b8-4704-be36-94c249ee5877 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:05.497898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8c4f2-35cd-4a21-a36a-139d688be3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:05.499484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c4f2-35cd-4a21-a36a-139d688be3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.500097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c4f2-35cd-4a21-a36a-139d688be3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.500525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c4f2-35cd-4a21-a36a-139d688be3c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.573462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8c4f2-35cd-4a21-a36a-139d688be3c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:05.574947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8c4f2-35cd-4a21-a36a-139d688be3c2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:05.576522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:05.587102 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:05.596379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1484312-11b8-4704-be36-94c249ee5877 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:05.633627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9822af-5357-424e-93ca-e687e619b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:05.634422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9822af-5357-424e-93ca-e687e619b076 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.634706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9822af-5357-424e-93ca-e687e619b076 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.634982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9822af-5357-424e-93ca-e687e619b076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.645805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9822af-5357-424e-93ca-e687e619b076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:05.647930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9822af-5357-424e-93ca-e687e619b076 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-2f9822af-5357-424e-93ca-e687e619b076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:05.665793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:05.666739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:05.667618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:05.667618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:05.667618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:05.667618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:05.671624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 402/805] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:05.672559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9822af-5357-424e-93ca-e687e619b076 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:05.687866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 404/806] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:11:05.687866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8c4f2-35cd-4a21-a36a-139d688be3c2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:05.783697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9822af-5357-424e-93ca-e687e619b076 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:05.787966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8c4f2-35cd-4a21-a36a-139d688be3c2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:05.798303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:05.821705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f218d6f-6e99-4ea8-801d-7a2739163b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:05.822494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f218d6f-6e99-4ea8-801d-7a2739163b31 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.822777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f218d6f-6e99-4ea8-801d-7a2739163b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.823055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f218d6f-6e99-4ea8-801d-7a2739163b31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.824607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad3cc0-0cc0-4080-b4a6-03c97c152dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:05.825407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad3cc0-0cc0-4080-b4a6-03c97c152dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.825688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad3cc0-0cc0-4080-b4a6-03c97c152dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.825962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad3cc0-0cc0-4080-b4a6-03c97c152dd3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.826616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad3cc0-0cc0-4080-b4a6-03c97c152dd3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:05.828006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad3cc0-0cc0-4080-b4a6-03c97c152dd3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:05.832322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f218d6f-6e99-4ea8-801d-7a2739163b31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:05.833921 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f218d6f-6e99-4ea8-801d-7a2739163b31 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:05.835838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f4ad3cc0-0cc0-4080-b4a6-03c97c152dd3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:05.839969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:05.840942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:05.841756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 405/807] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:05 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:05.842531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad3cc0-0cc0-4080-b4a6-03c97c152dd3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-3f218d6f-6e99-4ea8-801d-7a2739163b31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:05.851705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:05.852820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:05.853746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:05.853746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:05.853746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:05.853746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:05.853746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:05.853746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:05.853746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:05.853746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:05.853746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 403/808] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:05.854318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f218d6f-6e99-4ea8-801d-7a2739163b31 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:05.945336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad3cc0-0cc0-4080-b4a6-03c97c152dd3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:05.954352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f218d6f-6e99-4ea8-801d-7a2739163b31 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:05.978699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f22d62-07e6-49d3-a804-192b15bd3c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:05.979374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f22d62-07e6-49d3-a804-192b15bd3c14 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.979669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f22d62-07e6-49d3-a804-192b15bd3c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.979955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f22d62-07e6-49d3-a804-192b15bd3c14 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.980706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f22d62-07e6-49d3-a804-192b15bd3c14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:05.981047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f22d62-07e6-49d3-a804-192b15bd3c14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:05.982457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f22d62-07e6-49d3-a804-192b15bd3c14 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:05.988085 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e88a69-27d4-4a99-9470-e69c9ec1d3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:05.989263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88a69-27d4-4a99-9470-e69c9ec1d3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.989688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88a69-27d4-4a99-9470-e69c9ec1d3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.990133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88a69-27d4-4a99-9470-e69c9ec1d3f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.994218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 406/809] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:05.995606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0674-76ae-46bb-8729-dc4fd143ac49 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:05.995906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0674-76ae-46bb-8729-dc4fd143ac49 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:05.996215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0674-76ae-46bb-8729-dc4fd143ac49 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:05.999221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 407/810] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:05.999221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c0674-76ae-46bb-8729-dc4fd143ac49 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.003746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e88a69-27d4-4a99-9470-e69c9ec1d3f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.005277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e88a69-27d4-4a99-9470-e69c9ec1d3f2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-23e88a69-27d4-4a99-9470-e69c9ec1d3f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:06.023959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:06.025125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:06.026024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:06.026024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:06.026024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:06.026024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:06.026024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 404/811] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:06.026297 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e88a69-27d4-4a99-9470-e69c9ec1d3f2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.039071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:06.076491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:06.106246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c0674-76ae-46bb-8729-dc4fd143ac49 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:06.127226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e88a69-27d4-4a99-9470-e69c9ec1d3f2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:06.141551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47031ce9-753a-4fe7-84de-d9e1a4f4d0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:06.142215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47031ce9-753a-4fe7-84de-d9e1a4f4d0ea None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.142506 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47031ce9-753a-4fe7-84de-d9e1a4f4d0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.142784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47031ce9-753a-4fe7-84de-d9e1a4f4d0ea None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.143499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47031ce9-753a-4fe7-84de-d9e1a4f4d0ea None admin] RBAC: Adding query filter params (name=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:06.143811 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47031ce9-753a-4fe7-84de-d9e1a4f4d0ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.145231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47031ce9-753a-4fe7-84de-d9e1a4f4d0ea None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.149705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 408/812] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:11:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:06.150483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47031ce9-753a-4fe7-84de-d9e1a4f4d0ea None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.164230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91138691-1246-4c50-9216-5ac841a75eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:06.164984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91138691-1246-4c50-9216-5ac841a75eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.165182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91138691-1246-4c50-9216-5ac841a75eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.165463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91138691-1246-4c50-9216-5ac841a75eb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.166258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91138691-1246-4c50-9216-5ac841a75eb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:06.166571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91138691-1246-4c50-9216-5ac841a75eb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.168037 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91138691-1246-4c50-9216-5ac841a75eb2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.181908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 405/813] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:06.183121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd65599-e3e6-4b98-8389-67b4f79beb2d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.183410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd65599-e3e6-4b98-8389-67b4f79beb2d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.183694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd65599-e3e6-4b98-8389-67b4f79beb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.199958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-efd65599-e3e6-4b98-8389-67b4f79beb2d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:06.201173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-efd65599-e3e6-4b98-8389-67b4f79beb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:06.247535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:06.251373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47031ce9-753a-4fe7-84de-d9e1a4f4d0ea None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:06.270641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 406/814] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:06.272142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd65599-e3e6-4b98-8389-67b4f79beb2d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.289149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c211de-3382-487c-aa0c-d708654c13e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:06.289954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c211de-3382-487c-aa0c-d708654c13e9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.290239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c211de-3382-487c-aa0c-d708654c13e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.290547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c211de-3382-487c-aa0c-d708654c13e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.298079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c211de-3382-487c-aa0c-d708654c13e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.299537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c211de-3382-487c-aa0c-d708654c13e9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c1c211de-3382-487c-aa0c-d708654c13e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:06.315056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:06.316408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:06.317704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:06.317704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:06.317704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:06.317704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:06.317704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:06.317704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:06.317704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:06.317704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:06.317704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:11:06.317704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:06.317704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 409/815] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:11:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:06.318330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:06.318404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c211de-3382-487c-aa0c-d708654c13e9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.378092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd65599-e3e6-4b98-8389-67b4f79beb2d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:06.412549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302e4d9-c71a-439d-ba80-7515f614be25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:06.413293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e4d9-c71a-439d-ba80-7515f614be25 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.413579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e4d9-c71a-439d-ba80-7515f614be25 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.413910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e4d9-c71a-439d-ba80-7515f614be25 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.414689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302e4d9-c71a-439d-ba80-7515f614be25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:06.414998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302e4d9-c71a-439d-ba80-7515f614be25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.416434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302e4d9-c71a-439d-ba80-7515f614be25 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.417180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c211de-3382-487c-aa0c-d708654c13e9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:06.427636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 407/816] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:06.428445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302e4d9-c71a-439d-ba80-7515f614be25 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.462166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674f7bb-96ab-4a78-9a34-6b8ea13f5234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:06.462822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674f7bb-96ab-4a78-9a34-6b8ea13f5234 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.463103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674f7bb-96ab-4a78-9a34-6b8ea13f5234 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.463403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674f7bb-96ab-4a78-9a34-6b8ea13f5234 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.464131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674f7bb-96ab-4a78-9a34-6b8ea13f5234 None admin] RBAC: Adding query filter params (type=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:06.464438 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674f7bb-96ab-4a78-9a34-6b8ea13f5234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.465801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674f7bb-96ab-4a78-9a34-6b8ea13f5234 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.470886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 410/817] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:11:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:06.471717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674f7bb-96ab-4a78-9a34-6b8ea13f5234 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.495223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:06.533553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:06.536324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302e4d9-c71a-439d-ba80-7515f614be25 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:06.570454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccceebe5-424d-4741-a796-2b99ffc4497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:06.571349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccceebe5-424d-4741-a796-2b99ffc4497f None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.571627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccceebe5-424d-4741-a796-2b99ffc4497f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.571907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccceebe5-424d-4741-a796-2b99ffc4497f None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/d8a79dc2ab494cb6aaf3b1f4001b7524/roles/14d046a572664f94934f225e9a3f3b64` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.572675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674f7bb-96ab-4a78-9a34-6b8ea13f5234 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:06.586826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccceebe5-424d-4741-a796-2b99ffc4497f None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=d8a79dc2ab494cb6aaf3b1f4001b7524, role_id=14d046a572664f94934f225e9a3f3b64)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.588310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccceebe5-424d-4741-a796-2b99ffc4497f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.600787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 408/818] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:11:06 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/d8a79dc2ab494cb6aaf3b1f4001b7524/roles/14d046a572664f94934f225e9a3f3b64 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:11:06.601587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccceebe5-424d-4741-a796-2b99ffc4497f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.608418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59a856-271c-4c4d-8579-54a6cdeb0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:06.609263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a856-271c-4c4d-8579-54a6cdeb0b19 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.609553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a856-271c-4c4d-8579-54a6cdeb0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.609833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a856-271c-4c4d-8579-54a6cdeb0b19 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.610626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59a856-271c-4c4d-8579-54a6cdeb0b19 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.611953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59a856-271c-4c4d-8579-54a6cdeb0b19 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-bd59a856-271c-4c4d-8579-54a6cdeb0b19 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:06.625536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:06.626930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 12:11:06.628267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:06.632236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 411/819] 10.222.0.66 () {56 vars in 1129 bytes} [Wed Jun 22 12:11:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:06.634178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59a856-271c-4c4d-8579-54a6cdeb0b19 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.729262 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:06.735517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccceebe5-424d-4741-a796-2b99ffc4497f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:06.746022 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59a856-271c-4c4d-8579-54a6cdeb0b19 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:06.783648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708de75a-358e-4bb7-923f-9d501557b7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:06.784362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708de75a-358e-4bb7-923f-9d501557b7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.784647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708de75a-358e-4bb7-923f-9d501557b7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.784923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708de75a-358e-4bb7-923f-9d501557b7f2 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.785770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708de75a-358e-4bb7-923f-9d501557b7f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:06.786080 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708de75a-358e-4bb7-923f-9d501557b7f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.787543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708de75a-358e-4bb7-923f-9d501557b7f2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.790682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93b704-5ec4-4150-8ca8-99b9d638834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:06.791485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b704-5ec4-4150-8ca8-99b9d638834a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.791772 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b704-5ec4-4150-8ca8-99b9d638834a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.792069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b704-5ec4-4150-8ca8-99b9d638834a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.799401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93b704-5ec4-4150-8ca8-99b9d638834a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.800895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93b704-5ec4-4150-8ca8-99b9d638834a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.807992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 409/820] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 12:11:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:06.809076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708de75a-358e-4bb7-923f-9d501557b7f2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5e93b704-5ec4-4150-8ca8-99b9d638834a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:06.820703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:06.821672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:06.822614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:06.822614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:06.822614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:06.822614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:06.822614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:06.822614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:06.822614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:06.822614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:06.823455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:06.827728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 412/821] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:06.827728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93b704-5ec4-4150-8ca8-99b9d638834a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.922777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708de75a-358e-4bb7-923f-9d501557b7f2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:06.936085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93b704-5ec4-4150-8ca8-99b9d638834a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:06.956853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cec7b0-12f0-4e30-89c7-5b843243212f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:06.957524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cec7b0-12f0-4e30-89c7-5b843243212f None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.957809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cec7b0-12f0-4e30-89c7-5b843243212f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.958088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cec7b0-12f0-4e30-89c7-5b843243212f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.959366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cec7b0-12f0-4e30-89c7-5b843243212f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.960897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cec7b0-12f0-4e30-89c7-5b843243212f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.974570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef5264-4598-490c-8490-31f89d074941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:06.975324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef5264-4598-490c-8490-31f89d074941 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:06.975642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef5264-4598-490c-8490-31f89d074941 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:06.976057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef5264-4598-490c-8490-31f89d074941 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:06.976906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef5264-4598-490c-8490-31f89d074941 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:06.977203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef5264-4598-490c-8490-31f89d074941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:06.978622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef5264-4598-490c-8490-31f89d074941 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:06.981495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 410/822] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 12:11:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:06.988103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 413/823] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 12:11:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:06.988306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cec7b0-12f0-4e30-89c7-5b843243212f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:06.988415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef5264-4598-490c-8490-31f89d074941 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:07.014023 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:07.073592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:07.131864 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cec7b0-12f0-4e30-89c7-5b843243212f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:07.149177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef5264-4598-490c-8490-31f89d074941 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:07.183633 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e2a25-047a-40cc-9658-1fddbec355cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:07.184534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e2a25-047a-40cc-9658-1fddbec355cd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:07.185480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e2a25-047a-40cc-9658-1fddbec355cd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:07.185480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e2a25-047a-40cc-9658-1fddbec355cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:07.200092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb9a13-2a0a-4f16-b53b-14af9342811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:07.200876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9a13-2a0a-4f16-b53b-14af9342811a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:07.201237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9a13-2a0a-4f16-b53b-14af9342811a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:07.201611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9a13-2a0a-4f16-b53b-14af9342811a None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:07.202498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb9a13-2a0a-4f16-b53b-14af9342811a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:07.202885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb9a13-2a0a-4f16-b53b-14af9342811a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:07.204586 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb9a13-2a0a-4f16-b53b-14af9342811a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:07.219347 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 414/824] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:07.220369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb9a13-2a0a-4f16-b53b-14af9342811a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:07.304087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:07.322548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e2a25-047a-40cc-9658-1fddbec355cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:07.324071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e2a25-047a-40cc-9658-1fddbec355cd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:07.339643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb9a13-2a0a-4f16-b53b-14af9342811a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ff3e2a25-047a-40cc-9658-1fddbec355cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:07.342901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:07.343971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:07.345139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:07.345139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:07.345139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:07.345139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:07.351327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 411/825] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:07.351327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e2a25-047a-40cc-9658-1fddbec355cd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:07.379237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce249d1-e656-4964-a538-4b689dab3754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:07.380046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce249d1-e656-4964-a538-4b689dab3754 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:07.380398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce249d1-e656-4964-a538-4b689dab3754 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:07.381238 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce249d1-e656-4964-a538-4b689dab3754 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:07.382020 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce249d1-e656-4964-a538-4b689dab3754 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:07.382396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce249d1-e656-4964-a538-4b689dab3754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:07.383845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce249d1-e656-4964-a538-4b689dab3754 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:07.389185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 415/826] 10.222.0.66 () {56 vars in 1124 bytes} [Wed Jun 22 12:11:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:07.394592 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce249d1-e656-4964-a538-4b689dab3754 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:07.455773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e2a25-047a-40cc-9658-1fddbec355cd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:07.470932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:07.493447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f3cb6-1b14-4e11-8a85-a9ee7d4c41ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:07.494109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f3cb6-1b14-4e11-8a85-a9ee7d4c41ce None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:07.494467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f3cb6-1b14-4e11-8a85-a9ee7d4c41ce None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:07.494816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f3cb6-1b14-4e11-8a85-a9ee7d4c41ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:07.495745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f3cb6-1b14-4e11-8a85-a9ee7d4c41ce None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=1df703568a334eea9550ac643d87b5fe) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:07.496180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f3cb6-1b14-4e11-8a85-a9ee7d4c41ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:07.497676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f3cb6-1b14-4e11-8a85-a9ee7d4c41ce None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:07.512054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 412/827] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:07 2022] GET /identity/v3/role_assignments?user.id=1df703568a334eea9550ac643d87b5fe&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:07.512054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f3cb6-1b14-4e11-8a85-a9ee7d4c41ce None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:07.512368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce249d1-e656-4964-a538-4b689dab3754 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:07.551274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0e843-b5aa-47a3-951d-d96ab1f641dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:07.552220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0e843-b5aa-47a3-951d-d96ab1f641dd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:07.553132 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0e843-b5aa-47a3-951d-d96ab1f641dd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:07.553605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0e843-b5aa-47a3-951d-d96ab1f641dd None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:07.554345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0e843-b5aa-47a3-951d-d96ab1f641dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:07.554670 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0e843-b5aa-47a3-951d-d96ab1f641dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:07.556221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0e843-b5aa-47a3-951d-d96ab1f641dd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:07.558182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:07.584810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 416/828] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:07.586399 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0e843-b5aa-47a3-951d-d96ab1f641dd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:07.690646 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f3cb6-1b14-4e11-8a85-a9ee7d4c41ce None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:07.745750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13468180-9be7-45c2-9b49-6fde6e4239e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:07.746677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13468180-9be7-45c2-9b49-6fde6e4239e8 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:07.747696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13468180-9be7-45c2-9b49-6fde6e4239e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:07.748157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13468180-9be7-45c2-9b49-6fde6e4239e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:07.749371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13468180-9be7-45c2-9b49-6fde6e4239e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:07.751096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13468180-9be7-45c2-9b49-6fde6e4239e8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:07.761187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0e843-b5aa-47a3-951d-d96ab1f641dd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:07.784051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 413/829] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 12:11:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:07.826694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e88875-bc14-4501-a18d-ec341ac1242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:07.826694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e88875-bc14-4501-a18d-ec341ac1242f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:07.827029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e88875-bc14-4501-a18d-ec341ac1242f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:07.827401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e88875-bc14-4501-a18d-ec341ac1242f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:07.835834 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e88875-bc14-4501-a18d-ec341ac1242f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:07.837539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e88875-bc14-4501-a18d-ec341ac1242f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-69e88875-bc14-4501-a18d-ec341ac1242f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:07.853625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:07.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:07.855948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:07.855948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:07.855948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:07.855948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:07.855948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:07.855948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:07.855948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:07.855948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:07.857824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 417/830] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:07.863417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13468180-9be7-45c2-9b49-6fde6e4239e8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:07.905171 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:07.984856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13468180-9be7-45c2-9b49-6fde6e4239e8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:08.022331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77534967-1d25-4b1e-bba3-7b0d0745b25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:08.022911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77534967-1d25-4b1e-bba3-7b0d0745b25b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:08.023190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77534967-1d25-4b1e-bba3-7b0d0745b25b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:08.023463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77534967-1d25-4b1e-bba3-7b0d0745b25b None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:08.024282 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77534967-1d25-4b1e-bba3-7b0d0745b25b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:08.024593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77534967-1d25-4b1e-bba3-7b0d0745b25b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:08.026036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77534967-1d25-4b1e-bba3-7b0d0745b25b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:08.039159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 414/831] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:08.044915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e88875-bc14-4501-a18d-ec341ac1242f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:08.098468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:08.154427 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e88875-bc14-4501-a18d-ec341ac1242f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:08.190853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaccb9b-c434-4a98-b7ee-fb6edb17700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:08.191747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaccb9b-c434-4a98-b7ee-fb6edb17700e None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:08.192042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaccb9b-c434-4a98-b7ee-fb6edb17700e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:08.192330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaccb9b-c434-4a98-b7ee-fb6edb17700e None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/254b5c1a59e94596bf942192b4a30ac0/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:08.194826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaccb9b-c434-4a98-b7ee-fb6edb17700e None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=254b5c1a59e94596bf942192b4a30ac0, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:08.196298 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaccb9b-c434-4a98-b7ee-fb6edb17700e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:08.212037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 418/832] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:11:08 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/254b5c1a59e94596bf942192b4a30ac0/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:11:08.684206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9976-0416-491f-8003-b91c2427e74a None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:08.684607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9976-0416-491f-8003-b91c2427e74a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:08.684788 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9976-0416-491f-8003-b91c2427e74a None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:08.686248 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 415/833] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:08.691714 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253086d-7f57-4c26-b206-524a30130320 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:08.692345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253086d-7f57-4c26-b206-524a30130320 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:08.692844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253086d-7f57-4c26-b206-524a30130320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:08.710805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6253086d-7f57-4c26-b206-524a30130320 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:08.712327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6253086d-7f57-4c26-b206-524a30130320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:08.785742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 419/834] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:08.809218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b9976-0416-491f-8003-b91c2427e74a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:08.915729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:08.926342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b9976-0416-491f-8003-b91c2427e74a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:08.966449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bef88-0c21-4eb1-98a7-0b4137a6bf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:08.967611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bef88-0c21-4eb1-98a7-0b4137a6bf4c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:08.968147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bef88-0c21-4eb1-98a7-0b4137a6bf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:08.968624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bef88-0c21-4eb1-98a7-0b4137a6bf4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:08.980821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bef88-0c21-4eb1-98a7-0b4137a6bf4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-b63bef88-0c21-4eb1-98a7-0b4137a6bf4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:08.988855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:08.989815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:11:08.990709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:08.993517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 416/835] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:11:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:08.998969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253086d-7f57-4c26-b206-524a30130320 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:09.048008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:09.108720 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253086d-7f57-4c26-b206-524a30130320 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:09.147233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6b2c9-4774-4e5b-a4d7-fa89c466b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:09.147908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b2c9-4774-4e5b-a4d7-fa89c466b924 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:09.148218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b2c9-4774-4e5b-a4d7-fa89c466b924 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:09.148496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b2c9-4774-4e5b-a4d7-fa89c466b924 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:09.149240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6b2c9-4774-4e5b-a4d7-fa89c466b924 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:09.149543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6b2c9-4774-4e5b-a4d7-fa89c466b924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:09.150910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6b2c9-4774-4e5b-a4d7-fa89c466b924 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:09.159498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 420/836] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:11:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:09.165259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bef88-0c21-4eb1-98a7-0b4137a6bf4c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:09.277933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bef88-0c21-4eb1-98a7-0b4137a6bf4c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:09.315736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03420b-854b-4a3d-8a96-7c173de3133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:09.316943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03420b-854b-4a3d-8a96-7c173de3133c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:09.317433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03420b-854b-4a3d-8a96-7c173de3133c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:09.317911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03420b-854b-4a3d-8a96-7c173de3133c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:09.329449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03420b-854b-4a3d-8a96-7c173de3133c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:09.331153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03420b-854b-4a3d-8a96-7c173de3133c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-6c03420b-854b-4a3d-8a96-7c173de3133c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:09.349247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:09.350181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:09.351065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:09.351065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:09.351065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:09.351065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:09.353318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 417/837] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:09.361269 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6b2c9-4774-4e5b-a4d7-fa89c466b924 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:09.472091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6b2c9-4774-4e5b-a4d7-fa89c466b924 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:09.473989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:09.510113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b172f-877b-440d-bdaa-84500fc0aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:09.511095 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b172f-877b-440d-bdaa-84500fc0aefa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:09.511561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b172f-877b-440d-bdaa-84500fc0aefa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:09.512069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b172f-877b-440d-bdaa-84500fc0aefa None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:09.512977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b172f-877b-440d-bdaa-84500fc0aefa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:09.513464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b172f-877b-440d-bdaa-84500fc0aefa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:09.515019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b172f-877b-440d-bdaa-84500fc0aefa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:09.528724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 421/838] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:09.537533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03420b-854b-4a3d-8a96-7c173de3133c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:09.542463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:09.647040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03420b-854b-4a3d-8a96-7c173de3133c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:09.686589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed8b8c-22cc-40c0-b218-a5dec632822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:09.687766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed8b8c-22cc-40c0-b218-a5dec632822e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:09.688283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed8b8c-22cc-40c0-b218-a5dec632822e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:09.688788 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed8b8c-22cc-40c0-b218-a5dec632822e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:09.697532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed8b8c-22cc-40c0-b218-a5dec632822e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:09.699202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed8b8c-22cc-40c0-b218-a5dec632822e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-beed8b8c-22cc-40c0-b218-a5dec632822e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:09.714041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:09.715015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:09.715958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:09.715958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:09.715958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:09.715958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:09.715958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:09.715958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:09.715958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:09.715958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:09.715958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:11:09.715958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:09.718523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 418/839] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 12:11:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:09.719869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7abbc3-36e5-4570-a7e4-8270a0fc8d08 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:09.720204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7abbc3-36e5-4570-a7e4-8270a0fc8d08 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:09.720492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7abbc3-36e5-4570-a7e4-8270a0fc8d08 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:09.721870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 422/840] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:11:09.725699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed8b8c-22cc-40c0-b218-a5dec632822e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:09.727939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d322bbf-842b-4177-980e-53fe73c19488 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:09.728477 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d322bbf-842b-4177-980e-53fe73c19488 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:09.728968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d322bbf-842b-4177-980e-53fe73c19488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:09.746121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4d322bbf-842b-4177-980e-53fe73c19488 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:09.747668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4d322bbf-842b-4177-980e-53fe73c19488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:09.802554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:09.835331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 423/841] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:09.850832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d322bbf-842b-4177-980e-53fe73c19488 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:09.860374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed8b8c-22cc-40c0-b218-a5dec632822e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:09.905482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16486836-0072-4990-a265-2d50f5140be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:09.906192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486836-0072-4990-a265-2d50f5140be8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:09.906480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486836-0072-4990-a265-2d50f5140be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:09.906765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486836-0072-4990-a265-2d50f5140be8 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:09.907617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16486836-0072-4990-a265-2d50f5140be8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:09.907933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16486836-0072-4990-a265-2d50f5140be8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:09.909414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16486836-0072-4990-a265-2d50f5140be8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:09.929714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 419/842] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 12:11:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:09.936155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16486836-0072-4990-a265-2d50f5140be8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:09.965013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:09.979153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d322bbf-842b-4177-980e-53fe73c19488 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:10.015900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8fe85-abc9-423b-9d3a-6e21b52e67d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:10.016760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8fe85-abc9-423b-9d3a-6e21b52e67d4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.017044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8fe85-abc9-423b-9d3a-6e21b52e67d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.017326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8fe85-abc9-423b-9d3a-6e21b52e67d4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.017990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8fe85-abc9-423b-9d3a-6e21b52e67d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:10.019369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8fe85-abc9-423b-9d3a-6e21b52e67d4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-42b8fe85-abc9-423b-9d3a-6e21b52e67d4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:10.031718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:10.032759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:10.033935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 424/843] 10.222.0.66 () {56 vars in 1132 bytes} [Wed Jun 22 12:11:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:10.035079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf2006-dd0d-46dd-9721-89dfde65fb70 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.035079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf2006-dd0d-46dd-9721-89dfde65fb70 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.035079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf2006-dd0d-46dd-9721-89dfde65fb70 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.036485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 425/844] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:10.041386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf2006-dd0d-46dd-9721-89dfde65fb70 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:10.056959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16486836-0072-4990-a265-2d50f5140be8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:10.081387 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:10.095716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e318a18-c035-4423-b926-7bb15c28f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:10.096393 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318a18-c035-4423-b926-7bb15c28f723 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.096715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318a18-c035-4423-b926-7bb15c28f723 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.096957 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318a18-c035-4423-b926-7bb15c28f723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.154612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf2006-dd0d-46dd-9721-89dfde65fb70 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:10.170157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e318a18-c035-4423-b926-7bb15c28f723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:10.171713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e318a18-c035-4423-b926-7bb15c28f723 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:10.190760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278d724-5feb-430c-ba4a-4b6cfafd48eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:10.191428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278d724-5feb-430c-ba4a-4b6cfafd48eb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.191837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278d724-5feb-430c-ba4a-4b6cfafd48eb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.192144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278d724-5feb-430c-ba4a-4b6cfafd48eb None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.192859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278d724-5feb-430c-ba4a-4b6cfafd48eb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:10.193812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278d724-5feb-430c-ba4a-4b6cfafd48eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:10.195204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278d724-5feb-430c-ba4a-4b6cfafd48eb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:10.208048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 426/845] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 12:11:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:10.208048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb1fa-32fc-492d-9581-c37dd3900cf7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.208048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb1fa-32fc-492d-9581-c37dd3900cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.208048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb1fa-32fc-492d-9581-c37dd3900cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.225693 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fd6eb1fa-32fc-492d-9581-c37dd3900cf7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:10.226914 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fd6eb1fa-32fc-492d-9581-c37dd3900cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:10.242868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:10.291793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 420/846] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:11:10.292846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e318a18-c035-4423-b926-7bb15c28f723 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:10.311360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 427/847] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:10.317036 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb1fa-32fc-492d-9581-c37dd3900cf7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:10.322614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:10.419102 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e318a18-c035-4423-b926-7bb15c28f723 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:10.438407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb1fa-32fc-492d-9581-c37dd3900cf7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:10.458204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850052d-38b3-4355-9c63-a7997f3e8fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:10.458931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850052d-38b3-4355-9c63-a7997f3e8fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.459208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850052d-38b3-4355-9c63-a7997f3e8fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.459480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850052d-38b3-4355-9c63-a7997f3e8fc7 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.460228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850052d-38b3-4355-9c63-a7997f3e8fc7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:10.460532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850052d-38b3-4355-9c63-a7997f3e8fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:10.461918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850052d-38b3-4355-9c63-a7997f3e8fc7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:10.474134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 421/848] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 12:11:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:10.475517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850052d-38b3-4355-9c63-a7997f3e8fc7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:10.480551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8288ba-9079-43b6-864a-f64b738e3f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:10.481386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8288ba-9079-43b6-864a-f64b738e3f69 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.481670 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8288ba-9079-43b6-864a-f64b738e3f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.481947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8288ba-9079-43b6-864a-f64b738e3f69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.494539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8288ba-9079-43b6-864a-f64b738e3f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:10.496167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8288ba-9079-43b6-864a-f64b738e3f69 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8d8288ba-9079-43b6-864a-f64b738e3f69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:10.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:10.516748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:10.517630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:10.517630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:10.517630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:10.517630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:10.517630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 428/849] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:10.518373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784412e8-cb92-48e6-b943-2fb1cb1ed780 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.518612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784412e8-cb92-48e6-b943-2fb1cb1ed780 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.518899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784412e8-cb92-48e6-b943-2fb1cb1ed780 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.520437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 429/850] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:10.522608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784412e8-cb92-48e6-b943-2fb1cb1ed780 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:10.525940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:10.592883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:10.611838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850052d-38b3-4355-9c63-a7997f3e8fc7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:10.652799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784412e8-cb92-48e6-b943-2fb1cb1ed780 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:10.656048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b47a0-602a-4bbc-b186-ef2ec6073a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:10.656048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b47a0-602a-4bbc-b186-ef2ec6073a9b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.656048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b47a0-602a-4bbc-b186-ef2ec6073a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.656048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b47a0-602a-4bbc-b186-ef2ec6073a9b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.656437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b47a0-602a-4bbc-b186-ef2ec6073a9b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:10.657009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b47a0-602a-4bbc-b186-ef2ec6073a9b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-1e5b47a0-602a-4bbc-b186-ef2ec6073a9b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:10.669774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:10.670801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:10.671631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 422/851] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:11:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:10.673403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb47fe7-77ba-4859-b333-7bd669cd826f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.673403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb47fe7-77ba-4859-b333-7bd669cd826f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.673403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb47fe7-77ba-4859-b333-7bd669cd826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.689612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2cb47fe7-77ba-4859-b333-7bd669cd826f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:10.690815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2cb47fe7-77ba-4859-b333-7bd669cd826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:10.701442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c71f1-1ad8-405a-83c4-24d9e1411410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:10.702815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c71f1-1ad8-405a-83c4-24d9e1411410 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.703560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c71f1-1ad8-405a-83c4-24d9e1411410 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.704032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c71f1-1ad8-405a-83c4-24d9e1411410 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.705189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c71f1-1ad8-405a-83c4-24d9e1411410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:10.706131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c71f1-1ad8-405a-83c4-24d9e1411410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:10.708223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c71f1-1ad8-405a-83c4-24d9e1411410 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:10.725439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 430/852] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:10.725439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c71f1-1ad8-405a-83c4-24d9e1411410 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:10.767572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 423/853] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:10.768480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb47fe7-77ba-4859-b333-7bd669cd826f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:10.793125 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:10.845061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c71f1-1ad8-405a-83c4-24d9e1411410 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:10.860303 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:10.880681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb47fe7-77ba-4859-b333-7bd669cd826f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:10.883625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02905eaf-8a39-498e-ad33-b8b04e4b26a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:10.884069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02905eaf-8a39-498e-ad33-b8b04e4b26a9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.884365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02905eaf-8a39-498e-ad33-b8b04e4b26a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.884645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02905eaf-8a39-498e-ad33-b8b04e4b26a9 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.885482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02905eaf-8a39-498e-ad33-b8b04e4b26a9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:10.885895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02905eaf-8a39-498e-ad33-b8b04e4b26a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:10.887288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02905eaf-8a39-498e-ad33-b8b04e4b26a9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:10.892493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 431/854] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:11:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:10.898288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02905eaf-8a39-498e-ad33-b8b04e4b26a9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:10.918786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066141c-7e86-496f-ac73-968056909381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:10.919623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066141c-7e86-496f-ac73-968056909381 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:10.919920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066141c-7e86-496f-ac73-968056909381 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:10.920245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066141c-7e86-496f-ac73-968056909381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:10.927665 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066141c-7e86-496f-ac73-968056909381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:10.929147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066141c-7e86-496f-ac73-968056909381 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-6066141c-7e86-496f-ac73-968056909381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:10.943237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:10.944227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:10.945098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:10.945098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:10.945098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:10.945098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:10.945098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:10.945098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:10.945098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:10.945098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:10.945098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 424/855] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:10.946406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066141c-7e86-496f-ac73-968056909381 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:11.017937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02905eaf-8a39-498e-ad33-b8b04e4b26a9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:11.047084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:11.057569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b01bae-53ab-4e5c-bbe9-38acf9496289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:11.058373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b01bae-53ab-4e5c-bbe9-38acf9496289 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:11.058660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b01bae-53ab-4e5c-bbe9-38acf9496289 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:11.058941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b01bae-53ab-4e5c-bbe9-38acf9496289 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:11.069565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b01bae-53ab-4e5c-bbe9-38acf9496289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:11.075824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066141c-7e86-496f-ac73-968056909381 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f1b01bae-53ab-4e5c-bbe9-38acf9496289 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:11.077131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:11.078062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:11.078904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 432/856] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:11:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:11.079601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b01bae-53ab-4e5c-bbe9-38acf9496289 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:11.120395 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c0b78-6121-4838-99ce-05eb345aa43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:11.120986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0b78-6121-4838-99ce-05eb345aa43a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:11.121273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0b78-6121-4838-99ce-05eb345aa43a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:11.121550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0b78-6121-4838-99ce-05eb345aa43a None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:11.122275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c0b78-6121-4838-99ce-05eb345aa43a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:11.122568 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c0b78-6121-4838-99ce-05eb345aa43a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:11.123943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c0b78-6121-4838-99ce-05eb345aa43a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:11.128776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 425/857] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:11:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:11.129575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c0b78-6121-4838-99ce-05eb345aa43a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:11.147368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:11.231533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b01bae-53ab-4e5c-bbe9-38acf9496289 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:11.275869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5c8ac-1f4c-403f-b2bd-f3aa67710a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:11.276872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5c8ac-1f4c-403f-b2bd-f3aa67710a43 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:11.276872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5c8ac-1f4c-403f-b2bd-f3aa67710a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:11.277193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5c8ac-1f4c-403f-b2bd-f3aa67710a43 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:11.277953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5c8ac-1f4c-403f-b2bd-f3aa67710a43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:11.278268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5c8ac-1f4c-403f-b2bd-f3aa67710a43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:11.279756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5c8ac-1f4c-403f-b2bd-f3aa67710a43 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:11.304106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 433/858] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:11.307472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5c8ac-1f4c-403f-b2bd-f3aa67710a43 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:11.315481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c0b78-6121-4838-99ce-05eb345aa43a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:11.366958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0aac8-bbb2-4306-b4fa-ec66c1257bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:11.368753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0aac8-bbb2-4306-b4fa-ec66c1257bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:11.368753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0aac8-bbb2-4306-b4fa-ec66c1257bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:11.368753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0aac8-bbb2-4306-b4fa-ec66c1257bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:11.369158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0aac8-bbb2-4306-b4fa-ec66c1257bb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:11.369468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0aac8-bbb2-4306-b4fa-ec66c1257bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:11.372852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0aac8-bbb2-4306-b4fa-ec66c1257bb3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:11.381473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:11.385937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 426/859] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:11.391905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0aac8-bbb2-4306-b4fa-ec66c1257bb3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:11.453602 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5c8ac-1f4c-403f-b2bd-f3aa67710a43 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:11.464243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:11.511153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0aac8-bbb2-4306-b4fa-ec66c1257bb3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:11.555534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6bedd-2c74-4398-b128-f723547bb9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:11.556715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6bedd-2c74-4398-b128-f723547bb9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:11.557159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6bedd-2c74-4398-b128-f723547bb9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:11.557590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6bedd-2c74-4398-b128-f723547bb9e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:11.570752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6bedd-2c74-4398-b128-f723547bb9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:11.572511 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6bedd-2c74-4398-b128-f723547bb9e5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-deb6bedd-2c74-4398-b128-f723547bb9e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:11.592462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:11.593600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:11.594687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:11.594687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:11.594687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:11.594687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:11.601373 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 427/860] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:11.602569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6bedd-2c74-4398-b128-f723547bb9e5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:11.617846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc14206-03e5-4969-9f8b-4b61ac5846ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:11.618552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc14206-03e5-4969-9f8b-4b61ac5846ae None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:11.618831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc14206-03e5-4969-9f8b-4b61ac5846ae None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:11.619122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc14206-03e5-4969-9f8b-4b61ac5846ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:11.620129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc14206-03e5-4969-9f8b-4b61ac5846ae None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=d8a79dc2ab494cb6aaf3b1f4001b7524) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:11.620450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc14206-03e5-4969-9f8b-4b61ac5846ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:11.622080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc14206-03e5-4969-9f8b-4b61ac5846ae None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:11.636148 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 434/861] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:11 2022] GET /identity/v3/role_assignments?user.id=d8a79dc2ab494cb6aaf3b1f4001b7524&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:11.744072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6bedd-2c74-4398-b128-f723547bb9e5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:11.764339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:11.784134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9ce11-471c-45cf-88ff-68f174cccd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:11.784819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9ce11-471c-45cf-88ff-68f174cccd8e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:11.785103 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9ce11-471c-45cf-88ff-68f174cccd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:11.785389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9ce11-471c-45cf-88ff-68f174cccd8e None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:11.786130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9ce11-471c-45cf-88ff-68f174cccd8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:11.786439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9ce11-471c-45cf-88ff-68f174cccd8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:11.788411 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9ce11-471c-45cf-88ff-68f174cccd8e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:11.802445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 428/862] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:11.814317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc14206-03e5-4969-9f8b-4b61ac5846ae None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:11.944317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc14206-03e5-4969-9f8b-4b61ac5846ae None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:11.956863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:11.984141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339ebeb-e574-4925-8eb0-d9cc6f651863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:11.984949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339ebeb-e574-4925-8eb0-d9cc6f651863 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:11.985237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339ebeb-e574-4925-8eb0-d9cc6f651863 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:11.985517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339ebeb-e574-4925-8eb0-d9cc6f651863 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:11.993932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339ebeb-e574-4925-8eb0-d9cc6f651863 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:11.995407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339ebeb-e574-4925-8eb0-d9cc6f651863 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8339ebeb-e574-4925-8eb0-d9cc6f651863 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:12.011624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:12.012761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:12.013684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:12.013684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:12.013684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:12.013684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:12.013684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:12.013684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:12.013684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:12.013684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:12.013684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 12:11:12.013684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:12.013684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 435/863] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:11:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:12.020914 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9ce11-471c-45cf-88ff-68f174cccd8e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:12.133384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9ce11-471c-45cf-88ff-68f174cccd8e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:12.170404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a33118-e93f-40c4-810a-42226af01f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:12.171437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33118-e93f-40c4-810a-42226af01f43 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:12.171942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33118-e93f-40c4-810a-42226af01f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:12.172470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33118-e93f-40c4-810a-42226af01f43 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:12.173520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a33118-e93f-40c4-810a-42226af01f43 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:12.174041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a33118-e93f-40c4-810a-42226af01f43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:12.175703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a33118-e93f-40c4-810a-42226af01f43 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:12.195905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 429/864] 10.222.0.66 () {56 vars in 1135 bytes} [Wed Jun 22 12:11:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:12.201855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339ebeb-e574-4925-8eb0-d9cc6f651863 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:12.308512 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339ebeb-e574-4925-8eb0-d9cc6f651863 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:12.359084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d573103-cdab-4739-afef-68f6c4620828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:12.359744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d573103-cdab-4739-afef-68f6c4620828 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:12.360046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d573103-cdab-4739-afef-68f6c4620828 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:12.360342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d573103-cdab-4739-afef-68f6c4620828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:12.404316 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:12.435916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d573103-cdab-4739-afef-68f6c4620828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:12.437422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d573103-cdab-4739-afef-68f6c4620828 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:12.543618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 436/865] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:11:12.549360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a33118-e93f-40c4-810a-42226af01f43 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:12.589943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:12.594488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27ae7-e877-4966-a8b1-dfd71e6eaac6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:12.594982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27ae7-e877-4966-a8b1-dfd71e6eaac6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:12.595196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27ae7-e877-4966-a8b1-dfd71e6eaac6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:12.596850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 437/866] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:12.603961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d92151-04fb-4d6e-9ac6-dc9548274e95 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:12.604740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d92151-04fb-4d6e-9ac6-dc9548274e95 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:12.605254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d92151-04fb-4d6e-9ac6-dc9548274e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:12.625510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d6d92151-04fb-4d6e-9ac6-dc9548274e95 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:12.627105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d6d92151-04fb-4d6e-9ac6-dc9548274e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:12.665836 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a33118-e93f-40c4-810a-42226af01f43 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:12.708901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f56a5-deda-4b8d-bff0-3b0af3c06e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:12.709629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:12.710333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f56a5-deda-4b8d-bff0-3b0af3c06e10 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:12.710835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f56a5-deda-4b8d-bff0-3b0af3c06e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:12.711358 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f56a5-deda-4b8d-bff0-3b0af3c06e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:12.716219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 438/867] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:12.723873 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f56a5-deda-4b8d-bff0-3b0af3c06e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:12.726184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f56a5-deda-4b8d-bff0-3b0af3c06e10 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:12.740451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d92151-04fb-4d6e-9ac6-dc9548274e95 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-1c6f56a5-deda-4b8d-bff0-3b0af3c06e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:12.746139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:12.747038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:12.748542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:12.748542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:12.748542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:12.748542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:12.748542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 430/868] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:12.752996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f56a5-deda-4b8d-bff0-3b0af3c06e10 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:12.858822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:12.872412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f56a5-deda-4b8d-bff0-3b0af3c06e10 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:12.873468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d92151-04fb-4d6e-9ac6-dc9548274e95 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:12.910492 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1e84b-71ed-46eb-8758-e5c627649cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:12.911149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1e84b-71ed-46eb-8758-e5c627649cee None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:12.911440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1e84b-71ed-46eb-8758-e5c627649cee None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:12.911785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1e84b-71ed-46eb-8758-e5c627649cee None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:12.912556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1e84b-71ed-46eb-8758-e5c627649cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:12.912869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1e84b-71ed-46eb-8758-e5c627649cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:12.914514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1e84b-71ed-46eb-8758-e5c627649cee None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:12.920096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514d269-ff9d-4de4-94a1-6e9cfd7b5b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:12.921065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d269-ff9d-4de4-94a1-6e9cfd7b5b03 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:12.922052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d269-ff9d-4de4-94a1-6e9cfd7b5b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:12.922649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d269-ff9d-4de4-94a1-6e9cfd7b5b03 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:12.924109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514d269-ff9d-4de4-94a1-6e9cfd7b5b03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:12.925992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514d269-ff9d-4de4-94a1-6e9cfd7b5b03 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:12.931853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 431/869] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:12.933215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1e84b-71ed-46eb-8758-e5c627649cee None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:12.946196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 439/870] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:11:12 2022] POST /identity/v3/services => generated 269 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:11:13.059305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1e84b-71ed-46eb-8758-e5c627649cee None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:13.104361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3d298-aa8a-45d8-acc6-a2e3513c7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:13.105514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3d298-aa8a-45d8-acc6-a2e3513c7de4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:13.105959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3d298-aa8a-45d8-acc6-a2e3513c7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:13.106237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3d298-aa8a-45d8-acc6-a2e3513c7de4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:13.114494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3d298-aa8a-45d8-acc6-a2e3513c7de4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:13.116524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3d298-aa8a-45d8-acc6-a2e3513c7de4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-48d3d298-aa8a-45d8-acc6-a2e3513c7de4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:13.131976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:13.132947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:13.133849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:13.133849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:13.133849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:13.133849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:13.133849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:13.133849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:13.133849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:13.133849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:13.133849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 432/871] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:13.141300 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514d269-ff9d-4de4-94a1-6e9cfd7b5b03 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:13.206423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:13.249476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514d269-ff9d-4de4-94a1-6e9cfd7b5b03 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:13.283793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dca00-7e1c-4d1c-aa79-223d21d0b129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:13.284520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dca00-7e1c-4d1c-aa79-223d21d0b129 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:13.284808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dca00-7e1c-4d1c-aa79-223d21d0b129 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:13.285122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dca00-7e1c-4d1c-aa79-223d21d0b129 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:13.285871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dca00-7e1c-4d1c-aa79-223d21d0b129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:13.286182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dca00-7e1c-4d1c-aa79-223d21d0b129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:13.288184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dca00-7e1c-4d1c-aa79-223d21d0b129 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:13.300964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 440/872] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:13.307481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3d298-aa8a-45d8-acc6-a2e3513c7de4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:13.311215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:13.357733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aadcd8-0711-4a51-bff5-ae1bc510d320 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:13.358241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aadcd8-0711-4a51-bff5-ae1bc510d320 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:13.358241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aadcd8-0711-4a51-bff5-ae1bc510d320 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:13.359813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 441/873] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:13.365080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279b4e-6601-47c7-a3bf-e7a9dc72deff None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:13.365342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279b4e-6601-47c7-a3bf-e7a9dc72deff None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:13.365624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7279b4e-6601-47c7-a3bf-e7a9dc72deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:13.382752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f7279b4e-6601-47c7-a3bf-e7a9dc72deff None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:13.383956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f7279b4e-6601-47c7-a3bf-e7a9dc72deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:13.431096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3d298-aa8a-45d8-acc6-a2e3513c7de4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:13.465212 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 442/874] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:13 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:13.483995 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d08db8-bb22-4474-a3f9-f4ef5bec6922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:13.484982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d08db8-bb22-4474-a3f9-f4ef5bec6922 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:13.485576 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d08db8-bb22-4474-a3f9-f4ef5bec6922 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:13.486008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d08db8-bb22-4474-a3f9-f4ef5bec6922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:13.487061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d08db8-bb22-4474-a3f9-f4ef5bec6922 None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=254b5c1a59e94596bf942192b4a30ac0) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:13.487617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d08db8-bb22-4474-a3f9-f4ef5bec6922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:13.488541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7279b4e-6601-47c7-a3bf-e7a9dc72deff None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:13.489501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d08db8-bb22-4474-a3f9-f4ef5bec6922 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:13.498951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 433/875] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:13 2022] GET /identity/v3/role_assignments?user.id=254b5c1a59e94596bf942192b4a30ac0&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:13.546186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:13.605660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7279b4e-6601-47c7-a3bf-e7a9dc72deff None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:13.644465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9722c0-11c9-436a-80fd-f9c6d4821329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:13.646921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9722c0-11c9-436a-80fd-f9c6d4821329 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:13.646921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9722c0-11c9-436a-80fd-f9c6d4821329 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:13.646921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9722c0-11c9-436a-80fd-f9c6d4821329 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:13.646921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9722c0-11c9-436a-80fd-f9c6d4821329 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:13.650531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9722c0-11c9-436a-80fd-f9c6d4821329 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:13.671036 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 443/876] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:11:13 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:11:13.993912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb88da-cd8f-4d43-a2af-87f11758c437 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:13.993912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb88da-cd8f-4d43-a2af-87f11758c437 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:13.993912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb88da-cd8f-4d43-a2af-87f11758c437 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:13.995771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 434/877] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:14.001626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c43764-bc49-453b-8e7a-491f4449bb7d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:14.002209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c43764-bc49-453b-8e7a-491f4449bb7d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:14.002700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c43764-bc49-453b-8e7a-491f4449bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:14.022673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-63c43764-bc49-453b-8e7a-491f4449bb7d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:14.024282 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-63c43764-bc49-453b-8e7a-491f4449bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:14.125936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 444/878] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:14.149816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb88da-cd8f-4d43-a2af-87f11758c437 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:14.226086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:14.263676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb88da-cd8f-4d43-a2af-87f11758c437 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:14.299581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65d655-45ec-43ea-8e58-5d53169db242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:14.300798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d655-45ec-43ea-8e58-5d53169db242 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:14.301299 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d655-45ec-43ea-8e58-5d53169db242 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:14.301784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d655-45ec-43ea-8e58-5d53169db242 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:14.312740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65d655-45ec-43ea-8e58-5d53169db242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-3d65d655-45ec-43ea-8e58-5d53169db242 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:14.321838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:14.322786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:14.323624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:14.326340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 435/879] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 12:11:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:14.332481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c43764-bc49-453b-8e7a-491f4449bb7d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:14.368647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:14.441765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c43764-bc49-453b-8e7a-491f4449bb7d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:14.478204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b8c1b-2da2-4417-b3f2-43378d8e4495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:14.478884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b8c1b-2da2-4417-b3f2-43378d8e4495 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:14.479169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b8c1b-2da2-4417-b3f2-43378d8e4495 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:14.479444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b8c1b-2da2-4417-b3f2-43378d8e4495 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:14.480229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b8c1b-2da2-4417-b3f2-43378d8e4495 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:14.480540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b8c1b-2da2-4417-b3f2-43378d8e4495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:14.481918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b8c1b-2da2-4417-b3f2-43378d8e4495 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:14.491284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 445/880] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 12:11:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:14.496820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65d655-45ec-43ea-8e58-5d53169db242 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:14.603889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65d655-45ec-43ea-8e58-5d53169db242 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:14.633781 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:14.644338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec062a-bc69-4308-bed6-3fd5757b9862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:14.645439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec062a-bc69-4308-bed6-3fd5757b9862 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:14.645943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec062a-bc69-4308-bed6-3fd5757b9862 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:14.646440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec062a-bc69-4308-bed6-3fd5757b9862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:14.657756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec062a-bc69-4308-bed6-3fd5757b9862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:14.659453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec062a-bc69-4308-bed6-3fd5757b9862 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-0cec062a-bc69-4308-bed6-3fd5757b9862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:14.678104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:14.679091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:14.679993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:14.679993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:14.679993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:14.679993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:14.682322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 436/881] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:14.688233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b8c1b-2da2-4417-b3f2-43378d8e4495 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:14.797333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:14.803742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b8c1b-2da2-4417-b3f2-43378d8e4495 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:14.872430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e2f1e-3652-4ce8-8bc4-90bfd407ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:14.873499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2f1e-3652-4ce8-8bc4-90bfd407ce8a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:14.874027 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2f1e-3652-4ce8-8bc4-90bfd407ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:14.874540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2f1e-3652-4ce8-8bc4-90bfd407ce8a None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:14.875942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e2f1e-3652-4ce8-8bc4-90bfd407ce8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:14.876520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e2f1e-3652-4ce8-8bc4-90bfd407ce8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:14.879171 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e2f1e-3652-4ce8-8bc4-90bfd407ce8a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:14.903920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 446/882] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:14.909857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec062a-bc69-4308-bed6-3fd5757b9862 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:15.051507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec062a-bc69-4308-bed6-3fd5757b9862 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:15.088887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618afa74-b186-4cbd-b205-2acffe8b68d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:15.090063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618afa74-b186-4cbd-b205-2acffe8b68d1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:15.090547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618afa74-b186-4cbd-b205-2acffe8b68d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:15.091025 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618afa74-b186-4cbd-b205-2acffe8b68d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:15.100372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618afa74-b186-4cbd-b205-2acffe8b68d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:15.102181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618afa74-b186-4cbd-b205-2acffe8b68d1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-618afa74-b186-4cbd-b205-2acffe8b68d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:15.118507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:15.119516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:15.120495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:15.120495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:15.120495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:15.120495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:15.120495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:15.120495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:15.120495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:15.120495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:15.120495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:11:15.120495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:15.122851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 437/883] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 12:11:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:15.128524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e2f1e-3652-4ce8-8bc4-90bfd407ce8a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:15.254096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e2f1e-3652-4ce8-8bc4-90bfd407ce8a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:15.274848 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a4fcb-27da-483e-9e03-654772bdecaa None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:15.275368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a4fcb-27da-483e-9e03-654772bdecaa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:15.275547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a4fcb-27da-483e-9e03-654772bdecaa None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:15.277290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 438/884] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:11:15.282715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26f223-1a58-42c5-859c-417cefd3a31f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:15.283083 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26f223-1a58-42c5-859c-417cefd3a31f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:15.283461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26f223-1a58-42c5-859c-417cefd3a31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:15.299383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bb6cc-a837-4d5e-9637-1dae496244cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:15.300151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bb6cc-a837-4d5e-9637-1dae496244cc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:15.300439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bb6cc-a837-4d5e-9637-1dae496244cc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:15.300719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bb6cc-a837-4d5e-9637-1dae496244cc None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:15.301586 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bb6cc-a837-4d5e-9637-1dae496244cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:15.301900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bb6cc-a837-4d5e-9637-1dae496244cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:15.302005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-de26f223-1a58-42c5-859c-417cefd3a31f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:15.303744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-de26f223-1a58-42c5-859c-417cefd3a31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:15.304182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bb6cc-a837-4d5e-9637-1dae496244cc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:15.323776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 447/885] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 12:11:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:15.329649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bb6cc-a837-4d5e-9637-1dae496244cc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:15.343924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:15.350430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:15.392531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 439/886] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:15.411180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26f223-1a58-42c5-859c-417cefd3a31f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:15.445694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bb6cc-a837-4d5e-9637-1dae496244cc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:15.484154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79326b5-c99b-457c-a288-eafcaf439288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:15.484746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79326b5-c99b-457c-a288-eafcaf439288 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:15.485036 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79326b5-c99b-457c-a288-eafcaf439288 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:15.485411 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79326b5-c99b-457c-a288-eafcaf439288 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:15.533482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26f223-1a58-42c5-859c-417cefd3a31f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:15.559414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79326b5-c99b-457c-a288-eafcaf439288 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:15.560932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79326b5-c99b-457c-a288-eafcaf439288 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:15.579461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:15.603279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83facdcd-5212-495f-9e25-bc97235512c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:15.604562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83facdcd-5212-495f-9e25-bc97235512c0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:15.605032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83facdcd-5212-495f-9e25-bc97235512c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:15.605495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83facdcd-5212-495f-9e25-bc97235512c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:15.606474 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83facdcd-5212-495f-9e25-bc97235512c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:15.608290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83facdcd-5212-495f-9e25-bc97235512c0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-83facdcd-5212-495f-9e25-bc97235512c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:15.622122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:15.623104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 12:11:15.623918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:15.632437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 440/887] 10.222.0.66 () {56 vars in 1132 bytes} [Wed Jun 22 12:11:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:15.633924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83facdcd-5212-495f-9e25-bc97235512c0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:15.673356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:15.680685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 448/888] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:15 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:11:15.682761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79326b5-c99b-457c-a288-eafcaf439288 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:15.758127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83facdcd-5212-495f-9e25-bc97235512c0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:15.797838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3f6d-c0d2-4e3e-abc8-3c4e491d382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:15.798974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3f6d-c0d2-4e3e-abc8-3c4e491d382f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:15.799510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3f6d-c0d2-4e3e-abc8-3c4e491d382f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:15.800001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3f6d-c0d2-4e3e-abc8-3c4e491d382f None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:15.801010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe3f6d-c0d2-4e3e-abc8-3c4e491d382f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:15.801491 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79326b5-c99b-457c-a288-eafcaf439288 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:15.801734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe3f6d-c0d2-4e3e-abc8-3c4e491d382f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:15.803586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe3f6d-c0d2-4e3e-abc8-3c4e491d382f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:15.817105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 441/889] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 12:11:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:15.818963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3f6d-c0d2-4e3e-abc8-3c4e491d382f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:15.840461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:15.854870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48971a6a-8938-40da-8d11-444e124ef315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:15.855926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48971a6a-8938-40da-8d11-444e124ef315 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:15.856630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48971a6a-8938-40da-8d11-444e124ef315 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:15.857217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48971a6a-8938-40da-8d11-444e124ef315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:15.869155 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48971a6a-8938-40da-8d11-444e124ef315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:15.870859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48971a6a-8938-40da-8d11-444e124ef315 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-48971a6a-8938-40da-8d11-444e124ef315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:15.890982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:15.892163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:15.893086 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:15.893086 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:15.893086 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:15.893086 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:15.895409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 449/890] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:15.901803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48971a6a-8938-40da-8d11-444e124ef315 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:15.941903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:15.946984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3f6d-c0d2-4e3e-abc8-3c4e491d382f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:15.996807 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747aa1e-ade6-4200-89b5-b03ee1ba7592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:15.997818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747aa1e-ade6-4200-89b5-b03ee1ba7592 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:15.998308 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747aa1e-ade6-4200-89b5-b03ee1ba7592 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:15.998586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747aa1e-ade6-4200-89b5-b03ee1ba7592 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:15.999326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747aa1e-ade6-4200-89b5-b03ee1ba7592 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:15.999640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747aa1e-ade6-4200-89b5-b03ee1ba7592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:16.001081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747aa1e-ade6-4200-89b5-b03ee1ba7592 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:16.006893 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 442/891] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 12:11:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:16.008367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903261-4a8b-4672-a6b9-39d78069b2da None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.008656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903261-4a8b-4672-a6b9-39d78069b2da None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.008935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903261-4a8b-4672-a6b9-39d78069b2da None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.012061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 443/892] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:16.018115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a6acd-ca8e-4c6b-9b46-eb83e502ba16 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.018401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a6acd-ca8e-4c6b-9b46-eb83e502ba16 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.018686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a6acd-ca8e-4c6b-9b46-eb83e502ba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.031512 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48971a6a-8938-40da-8d11-444e124ef315 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:16.036441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-826a6acd-ca8e-4c6b-9b46-eb83e502ba16 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:16.037692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-826a6acd-ca8e-4c6b-9b46-eb83e502ba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:16.070961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2790a-51f8-439e-9251-02e409b9e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:16.071626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2790a-51f8-439e-9251-02e409b9e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.071915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2790a-51f8-439e-9251-02e409b9e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.072598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2790a-51f8-439e-9251-02e409b9e7a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.072952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2790a-51f8-439e-9251-02e409b9e7a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:16.073264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2790a-51f8-439e-9251-02e409b9e7a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:16.074643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2790a-51f8-439e-9251-02e409b9e7a2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:16.087602 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 450/893] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:16.092800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2790a-51f8-439e-9251-02e409b9e7a2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:16.116379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 444/894] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:16.120672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a6acd-ca8e-4c6b-9b46-eb83e502ba16 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:16.131872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:16.215044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2790a-51f8-439e-9251-02e409b9e7a2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:16.220123 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:16.234310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a6acd-ca8e-4c6b-9b46-eb83e502ba16 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:16.255371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c122ab8-016f-4832-9525-29e3fd5f3f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:16.256069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122ab8-016f-4832-9525-29e3fd5f3f8f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.256364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122ab8-016f-4832-9525-29e3fd5f3f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.256640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122ab8-016f-4832-9525-29e3fd5f3f8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.257465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c122ab8-016f-4832-9525-29e3fd5f3f8f None admin] RBAC: Adding query filter params (interface=public, service_id=d832cdc35c9445c98e2b2e6c3d392b3d, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:16.257808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c122ab8-016f-4832-9525-29e3fd5f3f8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:16.259194 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c122ab8-016f-4832-9525-29e3fd5f3f8f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:16.264886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 451/895] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 12:11:16 2022] GET /identity/v3/endpoints?service_id=d832cdc35c9445c98e2b2e6c3d392b3d&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:16.266469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658759f-1b4e-4e93-9ceb-3b8232736f88 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.266831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658759f-1b4e-4e93-9ceb-3b8232736f88 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.267122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658759f-1b4e-4e93-9ceb-3b8232736f88 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.268403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 452/896] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:16.269215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658759f-1b4e-4e93-9ceb-3b8232736f88 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:16.279887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad993b-7f18-49ea-9e9d-317fb246774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:16.280743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad993b-7f18-49ea-9e9d-317fb246774a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.281024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad993b-7f18-49ea-9e9d-317fb246774a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.281301 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad993b-7f18-49ea-9e9d-317fb246774a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.289637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad993b-7f18-49ea-9e9d-317fb246774a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:16.291090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad993b-7f18-49ea-9e9d-317fb246774a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-2fad993b-7f18-49ea-9e9d-317fb246774a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:16.306091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:16.307115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:16.308000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:16.308000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:16.308000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:16.308000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:16.308000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:16.308000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:16.308000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:16.308000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:16.308000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 445/897] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:16.308924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad993b-7f18-49ea-9e9d-317fb246774a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:16.399703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:16.410947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658759f-1b4e-4e93-9ceb-3b8232736f88 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:16.444687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad993b-7f18-49ea-9e9d-317fb246774a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:16.467720 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b3878-1974-4207-8d85-09b6eb1cb0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:16.468824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3878-1974-4207-8d85-09b6eb1cb0eb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.469153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3878-1974-4207-8d85-09b6eb1cb0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.469448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3878-1974-4207-8d85-09b6eb1cb0eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.470154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b3878-1974-4207-8d85-09b6eb1cb0eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:16.471660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b3878-1974-4207-8d85-09b6eb1cb0eb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f53b3878-1974-4207-8d85-09b6eb1cb0eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:16.484077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:16.485334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 12:11:16.486371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:16.487277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dd9f3-caf1-4d73-bb11-be0803edd9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:16.487277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dd9f3-caf1-4d73-bb11-be0803edd9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.487277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dd9f3-caf1-4d73-bb11-be0803edd9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.487277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dd9f3-caf1-4d73-bb11-be0803edd9d4 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.488398 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dd9f3-caf1-4d73-bb11-be0803edd9d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:16.488943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 453/898] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:11:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:16.490198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e568c-0f35-436e-977d-2c0bc3631084 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.490494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e568c-0f35-436e-977d-2c0bc3631084 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.490766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e568c-0f35-436e-977d-2c0bc3631084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.490867 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dd9f3-caf1-4d73-bb11-be0803edd9d4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:16.514151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 446/899] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 12:11:16 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:11:16.514151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dd9f3-caf1-4d73-bb11-be0803edd9d4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:16.522629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-141e568c-0f35-436e-977d-2c0bc3631084 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:16.523904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-141e568c-0f35-436e-977d-2c0bc3631084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:16.528060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:16.628181 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 454/900] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:16.629675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e568c-0f35-436e-977d-2c0bc3631084 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:16.640085 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dd9f3-caf1-4d73-bb11-be0803edd9d4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:16.695563 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d0083-52d0-4812-bc0a-2735575acc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:16.696280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d0083-52d0-4812-bc0a-2735575acc00 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.697763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d0083-52d0-4812-bc0a-2735575acc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.697763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d0083-52d0-4812-bc0a-2735575acc00 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.697763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d0083-52d0-4812-bc0a-2735575acc00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:16.698181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d0083-52d0-4812-bc0a-2735575acc00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:16.699483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d0083-52d0-4812-bc0a-2735575acc00 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:16.721337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 447/901] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:16.721337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d0083-52d0-4812-bc0a-2735575acc00 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:16.795819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:16.832805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e568c-0f35-436e-977d-2c0bc3631084 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:16.849184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:16.878263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d0083-52d0-4812-bc0a-2735575acc00 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:16.890710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed520b-c751-469e-9478-20c90eec718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:16.891877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed520b-c751-469e-9478-20c90eec718d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.892433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed520b-c751-469e-9478-20c90eec718d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.892936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed520b-c751-469e-9478-20c90eec718d None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.894318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed520b-c751-469e-9478-20c90eec718d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:16.894861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed520b-c751-469e-9478-20c90eec718d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:16.898022 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed520b-c751-469e-9478-20c90eec718d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:16.913688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 455/902] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:11:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:16.913688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed520b-c751-469e-9478-20c90eec718d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:16.931962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5789fc1-9f74-4ce6-a69a-502d04964dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:16.932838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789fc1-9f74-4ce6-a69a-502d04964dfd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:16.933104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789fc1-9f74-4ce6-a69a-502d04964dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:16.933369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789fc1-9f74-4ce6-a69a-502d04964dfd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:16.934044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5789fc1-9f74-4ce6-a69a-502d04964dfd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:16.935442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5789fc1-9f74-4ce6-a69a-502d04964dfd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c5789fc1-9f74-4ce6-a69a-502d04964dfd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:16.949317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:16.951348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:16.953455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 448/903] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 12:11:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:16.955751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5789fc1-9f74-4ce6-a69a-502d04964dfd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:17.089073 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5789fc1-9f74-4ce6-a69a-502d04964dfd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:17.097614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed520b-c751-469e-9478-20c90eec718d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:17.132096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec54df-2742-4cbf-b4d7-716567f45a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:17.133085 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec54df-2742-4cbf-b4d7-716567f45a47 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:17.133579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec54df-2742-4cbf-b4d7-716567f45a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:17.133851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec54df-2742-4cbf-b4d7-716567f45a47 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:17.134584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec54df-2742-4cbf-b4d7-716567f45a47 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:17.134938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec54df-2742-4cbf-b4d7-716567f45a47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:17.136368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec54df-2742-4cbf-b4d7-716567f45a47 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:17.148415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 449/904] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:11:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:17.150048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec54df-2742-4cbf-b4d7-716567f45a47 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:17.152414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab738ac5-8289-4b01-b311-4bfad7265604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:17.153093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738ac5-8289-4b01-b311-4bfad7265604 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:17.153382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738ac5-8289-4b01-b311-4bfad7265604 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:17.153654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738ac5-8289-4b01-b311-4bfad7265604 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:17.154511 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab738ac5-8289-4b01-b311-4bfad7265604 None admin] RBAC: Adding query filter params (role.id=4c83d9b4ae1941e7a700b5a4408b6264, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=d8a79dc2ab494cb6aaf3b1f4001b7524) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:17.154829 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab738ac5-8289-4b01-b311-4bfad7265604 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:17.155116 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:17.156498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab738ac5-8289-4b01-b311-4bfad7265604 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:17.176464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 456/905] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:16 2022] GET /identity/v3/role_assignments?user.id=d8a79dc2ab494cb6aaf3b1f4001b7524&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=4c83d9b4ae1941e7a700b5a4408b6264 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:17.178351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab738ac5-8289-4b01-b311-4bfad7265604 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:17.205756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:17.307204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec54df-2742-4cbf-b4d7-716567f45a47 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:17.350987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab738ac5-8289-4b01-b311-4bfad7265604 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:17.365531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aee03-10e0-4a97-9192-e5175aad5311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:17.366217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aee03-10e0-4a97-9192-e5175aad5311 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:17.366501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aee03-10e0-4a97-9192-e5175aad5311 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:17.366780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aee03-10e0-4a97-9192-e5175aad5311 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:17.367499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aee03-10e0-4a97-9192-e5175aad5311 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:17.367801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aee03-10e0-4a97-9192-e5175aad5311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:17.369401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aee03-10e0-4a97-9192-e5175aad5311 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:17.375037 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 450/906] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 12:11:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:17.388079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aee03-10e0-4a97-9192-e5175aad5311 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:17.412349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45e541-f7e4-4ac0-9524-e62a4151b2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:17.413069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45e541-f7e4-4ac0-9524-e62a4151b2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:17.413355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45e541-f7e4-4ac0-9524-e62a4151b2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:17.413635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45e541-f7e4-4ac0-9524-e62a4151b2b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:17.414435 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45e541-f7e4-4ac0-9524-e62a4151b2b3 None admin] RBAC: Adding query filter params (interface=public, service_id=17ead48ea7f846dca57d6b4d967e071e, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:17.414749 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45e541-f7e4-4ac0-9524-e62a4151b2b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:17.416179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45e541-f7e4-4ac0-9524-e62a4151b2b3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:17.426530 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 457/907] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 12:11:17 2022] GET /identity/v3/endpoints?service_id=17ead48ea7f846dca57d6b4d967e071e&interface=public®ion_id=RegionOne => generated 194 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:17.435014 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45e541-f7e4-4ac0-9524-e62a4151b2b3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:17.521405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:17.561616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:17.579819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aee03-10e0-4a97-9192-e5175aad5311 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:17.592646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45e541-f7e4-4ac0-9524-e62a4151b2b3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:17.632529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057df3b0-8dc6-4928-a915-679a2a1d90e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:17.633289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df3b0-8dc6-4928-a915-679a2a1d90e7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:17.633690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df3b0-8dc6-4928-a915-679a2a1d90e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:17.633975 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df3b0-8dc6-4928-a915-679a2a1d90e7 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:17.634721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057df3b0-8dc6-4928-a915-679a2a1d90e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:17.635006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057df3b0-8dc6-4928-a915-679a2a1d90e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:17.636752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057df3b0-8dc6-4928-a915-679a2a1d90e7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:17.643310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 451/908] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 12:11:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:17.651542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baeb870-bf06-409b-8df8-7d36ff015706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:17.652742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeb870-bf06-409b-8df8-7d36ff015706 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:17.653236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeb870-bf06-409b-8df8-7d36ff015706 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:17.653734 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeb870-bf06-409b-8df8-7d36ff015706 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:17.654656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baeb870-bf06-409b-8df8-7d36ff015706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:17.656402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baeb870-bf06-409b-8df8-7d36ff015706 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:17.664239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 458/909] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 12:11:17 2022] GET /identity/v3/services => generated 1268 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:11:19.101790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6fcea-b450-4a5e-87d0-069e7d9ac4af None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:19.102331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6fcea-b450-4a5e-87d0-069e7d9ac4af None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:19.102672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6fcea-b450-4a5e-87d0-069e7d9ac4af None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:19.105664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 452/910] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:19.114432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66acbb-ecc9-4df3-9042-ace02cc9d4f5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:19.115479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66acbb-ecc9-4df3-9042-ace02cc9d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:19.115927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66acbb-ecc9-4df3-9042-ace02cc9d4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:19.144377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1d66acbb-ecc9-4df3-9042-ace02cc9d4f5 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:19.147196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1d66acbb-ecc9-4df3-9042-ace02cc9d4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:19.272401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 459/911] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:19.298673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6fcea-b450-4a5e-87d0-069e7d9ac4af None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:19.371942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473efc2b-48ef-40a4-91ed-139408beb8e8 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:19.372251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473efc2b-48ef-40a4-91ed-139408beb8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:19.372498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473efc2b-48ef-40a4-91ed-139408beb8e8 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:19.375014 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 460/912] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:11:19.382816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1be3f2-b41f-490c-8ca3-ff674b322993 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:19.383284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1be3f2-b41f-490c-8ca3-ff674b322993 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:19.383757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1be3f2-b41f-490c-8ca3-ff674b322993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:19.414231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5b1be3f2-b41f-490c-8ca3-ff674b322993 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:19.416068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5b1be3f2-b41f-490c-8ca3-ff674b322993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:19.455626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6fcea-b450-4a5e-87d0-069e7d9ac4af None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:19.503117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:19.510043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c8ba1-3001-44c2-86e2-0360a436e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:19.511194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c8ba1-3001-44c2-86e2-0360a436e179 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:19.511689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c8ba1-3001-44c2-86e2-0360a436e179 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:19.512234 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c8ba1-3001-44c2-86e2-0360a436e179 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:19.513334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c8ba1-3001-44c2-86e2-0360a436e179 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:19.515651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c8ba1-3001-44c2-86e2-0360a436e179 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-1b0c8ba1-3001-44c2-86e2-0360a436e179 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:19.534001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:19.535111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 12:11:19.536048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:19.544086 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 461/914] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:19.544421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 453/914] 10.222.0.66 () {56 vars in 1132 bytes} [Wed Jun 22 12:11:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:19.548158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1be3f2-b41f-490c-8ca3-ff674b322993 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:19.552252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:19.560739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c8ba1-3001-44c2-86e2-0360a436e179 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:19.689487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1be3f2-b41f-490c-8ca3-ff674b322993 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:19.713405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c8ba1-3001-44c2-86e2-0360a436e179 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:19.769813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41d0ad-caf6-47d4-b9b8-a8c7ce9910b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:19.770649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41d0ad-caf6-47d4-b9b8-a8c7ce9910b2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:19.770942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41d0ad-caf6-47d4-b9b8-a8c7ce9910b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:19.771223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41d0ad-caf6-47d4-b9b8-a8c7ce9910b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:19.774016 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fc96d-df1b-452b-b939-3e3c04fcadab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:19.776328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fc96d-df1b-452b-b939-3e3c04fcadab None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:19.777105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fc96d-df1b-452b-b939-3e3c04fcadab None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:19.778354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fc96d-df1b-452b-b939-3e3c04fcadab None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:19.780748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fc96d-df1b-452b-b939-3e3c04fcadab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:19.782607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fc96d-df1b-452b-b939-3e3c04fcadab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:19.785461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41d0ad-caf6-47d4-b9b8-a8c7ce9910b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:19.786350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fc96d-df1b-452b-b939-3e3c04fcadab None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:19.796952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 462/915] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 12:11:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ce41d0ad-caf6-47d4-b9b8-a8c7ce9910b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:19.801337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:19.804417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 454/916] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 12:11:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:19.806068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41d0ad-caf6-47d4-b9b8-a8c7ce9910b2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:19.807653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46e124-6766-498d-98bb-b39a0e883e26 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:19.807653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46e124-6766-498d-98bb-b39a0e883e26 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:19.807653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46e124-6766-498d-98bb-b39a0e883e26 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:19.813819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 463/917] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:19.813819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46e124-6766-498d-98bb-b39a0e883e26 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:19.916307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:19.941776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:19.979776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41d0ad-caf6-47d4-b9b8-a8c7ce9910b2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:19.995388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46e124-6766-498d-98bb-b39a0e883e26 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:20.024974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde20e77-ec56-4aa7-b97a-d6eba9af6ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:20.025659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde20e77-ec56-4aa7-b97a-d6eba9af6ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:20.025943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde20e77-ec56-4aa7-b97a-d6eba9af6ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:20.026225 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde20e77-ec56-4aa7-b97a-d6eba9af6ab9 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:20.026948 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde20e77-ec56-4aa7-b97a-d6eba9af6ab9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:20.027257 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde20e77-ec56-4aa7-b97a-d6eba9af6ab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:20.028717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde20e77-ec56-4aa7-b97a-d6eba9af6ab9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:20.034927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 455/918] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 12:11:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:20.036276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17aad2-3461-4ac0-865f-b0fbe010323c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:20.037242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17aad2-3461-4ac0-865f-b0fbe010323c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:20.037526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17aad2-3461-4ac0-865f-b0fbe010323c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:20.057765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087de6bd-d4ac-4c07-a879-7b9c948343ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:20.058452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de6bd-d4ac-4c07-a879-7b9c948343ed None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:20.058797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de6bd-d4ac-4c07-a879-7b9c948343ed None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:20.059214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de6bd-d4ac-4c07-a879-7b9c948343ed None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:20.059346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5e17aad2-3461-4ac0-865f-b0fbe010323c None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:20.060483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5e17aad2-3461-4ac0-865f-b0fbe010323c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:20.060913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087de6bd-d4ac-4c07-a879-7b9c948343ed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:20.061428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087de6bd-d4ac-4c07-a879-7b9c948343ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:20.063931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087de6bd-d4ac-4c07-a879-7b9c948343ed None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:20.087916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 464/919] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 12:11:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:20.089363 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087de6bd-d4ac-4c07-a879-7b9c948343ed None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:20.189871 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 456/920] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:20.189871 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17aad2-3461-4ac0-865f-b0fbe010323c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:20.244610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087de6bd-d4ac-4c07-a879-7b9c948343ed None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:20.268301 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:20.289828 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:20.298547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded44c32-b2ec-4354-a978-6dc9f07cc112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:20.299218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded44c32-b2ec-4354-a978-6dc9f07cc112 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:20.299502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded44c32-b2ec-4354-a978-6dc9f07cc112 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:20.299782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded44c32-b2ec-4354-a978-6dc9f07cc112 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:20.300570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded44c32-b2ec-4354-a978-6dc9f07cc112 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:20.302654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded44c32-b2ec-4354-a978-6dc9f07cc112 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:20.331473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 465/921] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 12:11:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:20.332524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded44c32-b2ec-4354-a978-6dc9f07cc112 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:20.359805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17aad2-3461-4ac0-865f-b0fbe010323c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:20.420263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5d6aa-8fd0-412b-87de-fe54af2ab594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:20.421660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5d6aa-8fd0-412b-87de-fe54af2ab594 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:20.422209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5d6aa-8fd0-412b-87de-fe54af2ab594 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:20.422702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5d6aa-8fd0-412b-87de-fe54af2ab594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:20.436765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5d6aa-8fd0-412b-87de-fe54af2ab594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:20.438770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5d6aa-8fd0-412b-87de-fe54af2ab594 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-69c5d6aa-8fd0-412b-87de-fe54af2ab594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:20.466320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:20.467307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:20.468647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:20.468647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:20.468647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:20.468647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:20.478429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 457/922] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:20.479775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5d6aa-8fd0-412b-87de-fe54af2ab594 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:20.486657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded44c32-b2ec-4354-a978-6dc9f07cc112 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:20.534852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fabe90-1e0a-4d2d-ac90-7ae73e6752c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:20.535435 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fabe90-1e0a-4d2d-ac90-7ae73e6752c8 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:20.535719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fabe90-1e0a-4d2d-ac90-7ae73e6752c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:20.535998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fabe90-1e0a-4d2d-ac90-7ae73e6752c8 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:20.537314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fabe90-1e0a-4d2d-ac90-7ae73e6752c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:20.538898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fabe90-1e0a-4d2d-ac90-7ae73e6752c8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:20.557939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 466/923] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:11:20 2022] POST /identity/v3/services => generated 241 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:20.582450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdc283-918c-406f-8ef8-6301a07e2adc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:20.582891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdc283-918c-406f-8ef8-6301a07e2adc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:20.583456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdc283-918c-406f-8ef8-6301a07e2adc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:20.588275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 467/924] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:20.595242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dda4fa-c50f-44e6-a252-e1d34db75be7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:20.596145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dda4fa-c50f-44e6-a252-e1d34db75be7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:20.596893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dda4fa-c50f-44e6-a252-e1d34db75be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:20.625315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-47dda4fa-c50f-44e6-a252-e1d34db75be7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:20.628091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-47dda4fa-c50f-44e6-a252-e1d34db75be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:20.637375 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:20.642694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5d6aa-8fd0-412b-87de-fe54af2ab594 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:20.683024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:20.704121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1636f2-b124-462b-a44e-cffe3e9de52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:20.705162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1636f2-b124-462b-a44e-cffe3e9de52c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:20.705619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1636f2-b124-462b-a44e-cffe3e9de52c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:20.706068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1636f2-b124-462b-a44e-cffe3e9de52c None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:20.707467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1636f2-b124-462b-a44e-cffe3e9de52c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:20.707949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1636f2-b124-462b-a44e-cffe3e9de52c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:20.709960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1636f2-b124-462b-a44e-cffe3e9de52c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:20.722901 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 468/925] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:20.723592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 458/926] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:20.731422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dda4fa-c50f-44e6-a252-e1d34db75be7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:20.756553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1636f2-b124-462b-a44e-cffe3e9de52c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:20.888910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1636f2-b124-462b-a44e-cffe3e9de52c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:20.897040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dda4fa-c50f-44e6-a252-e1d34db75be7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:20.931009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55284b-6479-467b-b8d5-005595b7e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:20.932808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55284b-6479-467b-b8d5-005595b7e82c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:20.933548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55284b-6479-467b-b8d5-005595b7e82c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:20.934227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55284b-6479-467b-b8d5-005595b7e82c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:20.935617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55284b-6479-467b-b8d5-005595b7e82c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:20.937499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55284b-6479-467b-b8d5-005595b7e82c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-bf55284b-6479-467b-b8d5-005595b7e82c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:20.951001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:20.952283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 12:11:20.953280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:20.955078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766ac96-ca83-4c2e-a0b5-8aa72d8a7801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:20.956107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 459/927] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:11:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:20.956423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766ac96-ca83-4c2e-a0b5-8aa72d8a7801 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:20.956836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766ac96-ca83-4c2e-a0b5-8aa72d8a7801 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:20.957334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766ac96-ca83-4c2e-a0b5-8aa72d8a7801 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:20.967306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55284b-6479-467b-b8d5-005595b7e82c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:20.976162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766ac96-ca83-4c2e-a0b5-8aa72d8a7801 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:20.979158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766ac96-ca83-4c2e-a0b5-8aa72d8a7801 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:21.000446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8766ac96-ca83-4c2e-a0b5-8aa72d8a7801 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:21.009080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:21.010716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:21.012456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:21.012456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:21.012456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:21.012456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:21.012456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:21.012456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:21.012456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:21.012456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:21.012456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:11:21.012456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:21.016970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 469/928] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 12:11:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:21.026461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766ac96-ca83-4c2e-a0b5-8aa72d8a7801 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:21.069816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:21.098026 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55284b-6479-467b-b8d5-005595b7e82c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:21.137739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc05555-dfba-4e5a-b7c2-7d991d0649b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:21.138896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc05555-dfba-4e5a-b7c2-7d991d0649b9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:21.139692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc05555-dfba-4e5a-b7c2-7d991d0649b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:21.139810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc05555-dfba-4e5a-b7c2-7d991d0649b9 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:21.141542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc05555-dfba-4e5a-b7c2-7d991d0649b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:21.142059 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc05555-dfba-4e5a-b7c2-7d991d0649b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:21.143705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc05555-dfba-4e5a-b7c2-7d991d0649b9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:21.154140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 460/929] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:11:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:21.154329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766ac96-ca83-4c2e-a0b5-8aa72d8a7801 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:21.156139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc05555-dfba-4e5a-b7c2-7d991d0649b9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:21.203141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee367fbe-c660-4bd5-af9d-ba8201e05a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:21.203873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee367fbe-c660-4bd5-af9d-ba8201e05a88 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:21.204501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee367fbe-c660-4bd5-af9d-ba8201e05a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:21.204924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee367fbe-c660-4bd5-af9d-ba8201e05a88 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:21.206821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee367fbe-c660-4bd5-af9d-ba8201e05a88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:21.207370 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee367fbe-c660-4bd5-af9d-ba8201e05a88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:21.210665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee367fbe-c660-4bd5-af9d-ba8201e05a88 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:21.240061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 470/930] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 12:11:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:21.244770 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee367fbe-c660-4bd5-af9d-ba8201e05a88 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:21.288474 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:21.323726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc05555-dfba-4e5a-b7c2-7d991d0649b9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:21.375909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8dd21-42b2-4df2-9047-2576acfec895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:21.376525 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8dd21-42b2-4df2-9047-2576acfec895 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:21.376837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8dd21-42b2-4df2-9047-2576acfec895 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:21.377274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8dd21-42b2-4df2-9047-2576acfec895 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:21.378003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8dd21-42b2-4df2-9047-2576acfec895 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:21.378312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8dd21-42b2-4df2-9047-2576acfec895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:21.381150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8dd21-42b2-4df2-9047-2576acfec895 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:21.391655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 461/931] 10.222.0.66 () {56 vars in 1114 bytes} [Wed Jun 22 12:11:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:21.400177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8dd21-42b2-4df2-9047-2576acfec895 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:21.420900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:21.435868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee367fbe-c660-4bd5-af9d-ba8201e05a88 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:21.491993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf34ced-875f-4ad0-9d55-4ffb18bba4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:21.493182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34ced-875f-4ad0-9d55-4ffb18bba4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:21.493928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34ced-875f-4ad0-9d55-4ffb18bba4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:21.494314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34ced-875f-4ad0-9d55-4ffb18bba4f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:21.511020 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf34ced-875f-4ad0-9d55-4ffb18bba4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:21.512726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf34ced-875f-4ad0-9d55-4ffb18bba4f2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-eaf34ced-875f-4ad0-9d55-4ffb18bba4f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:21.539173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:21.540314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:21.541320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:21.541320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:21.541320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:21.541320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:21.544174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 471/932] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:21.546595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf34ced-875f-4ad0-9d55-4ffb18bba4f2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:21.549878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8dd21-42b2-4df2-9047-2576acfec895 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:21.605076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750ed8-43e4-4823-8636-eb6ccdf87455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:21.606275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750ed8-43e4-4823-8636-eb6ccdf87455 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:21.606849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750ed8-43e4-4823-8636-eb6ccdf87455 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:21.607449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750ed8-43e4-4823-8636-eb6ccdf87455 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:21.608712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25750ed8-43e4-4823-8636-eb6ccdf87455 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:21.610730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25750ed8-43e4-4823-8636-eb6ccdf87455 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:21.636858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 462/933] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 12:11:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:21.690562 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf34ced-875f-4ad0-9d55-4ffb18bba4f2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:21.750516 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d566e0-9e15-47ac-b0b1-8398e235f771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:21.751620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d566e0-9e15-47ac-b0b1-8398e235f771 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:21.752163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d566e0-9e15-47ac-b0b1-8398e235f771 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:21.752706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d566e0-9e15-47ac-b0b1-8398e235f771 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:21.753902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d566e0-9e15-47ac-b0b1-8398e235f771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:21.754768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d566e0-9e15-47ac-b0b1-8398e235f771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:21.757944 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d566e0-9e15-47ac-b0b1-8398e235f771 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:21.769385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:21.778020 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 472/934] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:21.784499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750ed8-43e4-4823-8636-eb6ccdf87455 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:21.789375 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:21.916765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750ed8-43e4-4823-8636-eb6ccdf87455 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:21.955883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9e7dd-dd4d-4d47-8919-0c2e197d061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:21.957001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9e7dd-dd4d-4d47-8919-0c2e197d061a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:21.957438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9e7dd-dd4d-4d47-8919-0c2e197d061a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:21.957865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9e7dd-dd4d-4d47-8919-0c2e197d061a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:21.965853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9e7dd-dd4d-4d47-8919-0c2e197d061a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:21.967565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9e7dd-dd4d-4d47-8919-0c2e197d061a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-70e9e7dd-dd4d-4d47-8919-0c2e197d061a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:21.983706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:21.984932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:21.986062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:21.986062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:21.986062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:21.986062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:21.986062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:21.986062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:21.986062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:21.986062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:21.988369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 463/935] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:21.996053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d566e0-9e15-47ac-b0b1-8398e235f771 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:22.141765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d566e0-9e15-47ac-b0b1-8398e235f771 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:22.198706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31b59-8237-4179-9b85-eed271c52a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:22.199705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31b59-8237-4179-9b85-eed271c52a5e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:22.200097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31b59-8237-4179-9b85-eed271c52a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:22.200460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31b59-8237-4179-9b85-eed271c52a5e None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:22.201305 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a31b59-8237-4179-9b85-eed271c52a5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:22.201833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a31b59-8237-4179-9b85-eed271c52a5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:22.204343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a31b59-8237-4179-9b85-eed271c52a5e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:22.221448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 473/936] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:22.229466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9e7dd-dd4d-4d47-8919-0c2e197d061a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:22.311691 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:22.368885 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9e7dd-dd4d-4d47-8919-0c2e197d061a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:22.408996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f73fa-d675-4bcb-9dfa-7781d3e6e1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:22.411356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f73fa-d675-4bcb-9dfa-7781d3e6e1bd None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:22.412050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f73fa-d675-4bcb-9dfa-7781d3e6e1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:22.412428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f73fa-d675-4bcb-9dfa-7781d3e6e1bd None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/d8a79dc2ab494cb6aaf3b1f4001b7524/roles/4c83d9b4ae1941e7a700b5a4408b6264` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:22.416239 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f73fa-d675-4bcb-9dfa-7781d3e6e1bd None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=d8a79dc2ab494cb6aaf3b1f4001b7524, role_id=4c83d9b4ae1941e7a700b5a4408b6264)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:22.418058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f73fa-d675-4bcb-9dfa-7781d3e6e1bd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:22.442898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 464/937] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:11:22 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/d8a79dc2ab494cb6aaf3b1f4001b7524/roles/4c83d9b4ae1941e7a700b5a4408b6264 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:11:22.715616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56ad8-d274-4c8d-b91b-07c7dd504baf None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:22.716159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56ad8-d274-4c8d-b91b-07c7dd504baf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:22.716591 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56ad8-d274-4c8d-b91b-07c7dd504baf None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:22.719243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 474/938] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:22.725311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cea15-3952-436e-b0cf-64d486648564 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:22.725604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cea15-3952-436e-b0cf-64d486648564 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:22.725893 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cea15-3952-436e-b0cf-64d486648564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:22.743968 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-765cea15-3952-436e-b0cf-64d486648564 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:22.745254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-765cea15-3952-436e-b0cf-64d486648564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:22.848150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 465/939] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:22.870483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56ad8-d274-4c8d-b91b-07c7dd504baf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:22.966936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:23.026881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56ad8-d274-4c8d-b91b-07c7dd504baf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:23.066489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a08968-6a44-456e-a844-97923d027246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:23.067723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a08968-6a44-456e-a844-97923d027246 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:23.068249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a08968-6a44-456e-a844-97923d027246 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:23.068728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a08968-6a44-456e-a844-97923d027246 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:23.069622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a08968-6a44-456e-a844-97923d027246 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:23.071208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a08968-6a44-456e-a844-97923d027246 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:23.071421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0404b86-baee-4ffc-89e2-504d1ae545f2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:23.071709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0404b86-baee-4ffc-89e2-504d1ae545f2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:23.071991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0404b86-baee-4ffc-89e2-504d1ae545f2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:23.076141 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 466/940] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:23.079116 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f75db-c99e-4eef-89b3-c5efcdec65b4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:23.079405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f75db-c99e-4eef-89b3-c5efcdec65b4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:23.079681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f75db-c99e-4eef-89b3-c5efcdec65b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b5a08968-6a44-456e-a844-97923d027246 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:23.086297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:23.087340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 12:11:23.088216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:23.091111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 475/941] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:23.097416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a08968-6a44-456e-a844-97923d027246 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:23.103812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-853f75db-c99e-4eef-89b3-c5efcdec65b4 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:23.105339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-853f75db-c99e-4eef-89b3-c5efcdec65b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:23.173505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:23.202832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 467/942] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:23.221668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f75db-c99e-4eef-89b3-c5efcdec65b4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:23.223408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a08968-6a44-456e-a844-97923d027246 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:23.249732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:23.262315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a1f88-25b0-453a-9768-38cedfdc91fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:23.263371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a1f88-25b0-453a-9768-38cedfdc91fc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:23.263862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a1f88-25b0-453a-9768-38cedfdc91fc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:23.264458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a1f88-25b0-453a-9768-38cedfdc91fc None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:23.265714 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a1f88-25b0-453a-9768-38cedfdc91fc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:23.266234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a1f88-25b0-453a-9768-38cedfdc91fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:23.267845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a1f88-25b0-453a-9768-38cedfdc91fc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:23.274223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 476/943] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:11:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:23.280376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a1f88-25b0-453a-9768-38cedfdc91fc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:23.356300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f75db-c99e-4eef-89b3-c5efcdec65b4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:23.398531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ad6c-4af7-4a6c-a786-86d636e8f51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:23.399317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ad6c-4af7-4a6c-a786-86d636e8f51d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:23.399606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ad6c-4af7-4a6c-a786-86d636e8f51d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:23.399894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ad6c-4af7-4a6c-a786-86d636e8f51d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:23.400598 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08ad6c-4af7-4a6c-a786-86d636e8f51d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:23.402003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08ad6c-4af7-4a6c-a786-86d636e8f51d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-4f08ad6c-4af7-4a6c-a786-86d636e8f51d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:23.416518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:23.418100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:23.419404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:23.422481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 468/944] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 12:11:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:23.423854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ad6c-4af7-4a6c-a786-86d636e8f51d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:23.424548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a1f88-25b0-453a-9768-38cedfdc91fc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:23.462506 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033db8f-efc9-4189-8882-a5d98f2eb10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:23.463611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033db8f-efc9-4189-8882-a5d98f2eb10b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:23.464208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033db8f-efc9-4189-8882-a5d98f2eb10b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:23.464729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033db8f-efc9-4189-8882-a5d98f2eb10b None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:23.465829 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033db8f-efc9-4189-8882-a5d98f2eb10b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:23.466358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033db8f-efc9-4189-8882-a5d98f2eb10b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:23.468056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033db8f-efc9-4189-8882-a5d98f2eb10b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:23.474956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 477/945] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:11:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:23.490024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:23.580361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ad6c-4af7-4a6c-a786-86d636e8f51d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:23.636285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287db7cc-f6ba-420f-8e26-2732107c5f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:23.637738 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287db7cc-f6ba-420f-8e26-2732107c5f70 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:23.638278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287db7cc-f6ba-420f-8e26-2732107c5f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:23.638760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287db7cc-f6ba-420f-8e26-2732107c5f70 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:23.639778 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287db7cc-f6ba-420f-8e26-2732107c5f70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:23.640584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287db7cc-f6ba-420f-8e26-2732107c5f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:23.642195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287db7cc-f6ba-420f-8e26-2732107c5f70 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:23.649233 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 469/946] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 12:11:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:23.657481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033db8f-efc9-4189-8882-a5d98f2eb10b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:23.728340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:23.785308 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033db8f-efc9-4189-8882-a5d98f2eb10b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:23.831513 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff53481-2eb7-4da3-b1f5-3e41626055c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:23.833073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff53481-2eb7-4da3-b1f5-3e41626055c5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:23.833500 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff53481-2eb7-4da3-b1f5-3e41626055c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:23.833939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff53481-2eb7-4da3-b1f5-3e41626055c5 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:23.834801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff53481-2eb7-4da3-b1f5-3e41626055c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:23.835246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff53481-2eb7-4da3-b1f5-3e41626055c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:23.836804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff53481-2eb7-4da3-b1f5-3e41626055c5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:23.847962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 478/947] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 12:11:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:23.853249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287db7cc-f6ba-420f-8e26-2732107c5f70 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:23.965349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287db7cc-f6ba-420f-8e26-2732107c5f70 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:23.977439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:24.004372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bf23b-3151-4c42-8515-adcc9b66c750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:24.005025 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bf23b-3151-4c42-8515-adcc9b66c750 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:24.005322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bf23b-3151-4c42-8515-adcc9b66c750 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:24.005604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bf23b-3151-4c42-8515-adcc9b66c750 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:24.006426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bf23b-3151-4c42-8515-adcc9b66c750 None admin] RBAC: Adding query filter params (interface=public, service_id=109dcf24a20c46cfbfeeba1a960ef500, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:24.006746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bf23b-3151-4c42-8515-adcc9b66c750 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:24.008254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bf23b-3151-4c42-8515-adcc9b66c750 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:24.019200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 470/948] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 12:11:23 2022] GET /identity/v3/endpoints?service_id=109dcf24a20c46cfbfeeba1a960ef500&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:24.021206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff53481-2eb7-4da3-b1f5-3e41626055c5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:24.037036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bcd76-6647-4062-9803-3a39b9a6d5d9 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:24.037352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bcd76-6647-4062-9803-3a39b9a6d5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:24.037615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bcd76-6647-4062-9803-3a39b9a6d5d9 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:24.041205 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 471/949] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:24.045760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff34e6-b628-4a0c-93c5-7b0aab389f82 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:24.046144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff34e6-b628-4a0c-93c5-7b0aab389f82 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:24.046337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff34e6-b628-4a0c-93c5-7b0aab389f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:24.065480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-15ff34e6-b628-4a0c-93c5-7b0aab389f82 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:24.066750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-15ff34e6-b628-4a0c-93c5-7b0aab389f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:24.148161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 472/950] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:24.155800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff53481-2eb7-4da3-b1f5-3e41626055c5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:24.167811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff34e6-b628-4a0c-93c5-7b0aab389f82 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:24.176782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:24.201383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea0ca4-a168-4e15-b092-b6c1f1bf0926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:24.202439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea0ca4-a168-4e15-b092-b6c1f1bf0926 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:24.202868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea0ca4-a168-4e15-b092-b6c1f1bf0926 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:24.203329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea0ca4-a168-4e15-b092-b6c1f1bf0926 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:24.204234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea0ca4-a168-4e15-b092-b6c1f1bf0926 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:24.206060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea0ca4-a168-4e15-b092-b6c1f1bf0926 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:24.213780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 479/951] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 12:11:24 2022] GET /identity/v3/services => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:11:24.298623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff34e6-b628-4a0c-93c5-7b0aab389f82 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:24.302129 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:24.347713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c713-479a-4d41-a844-c09b97ded8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:24.349261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c713-479a-4d41-a844-c09b97ded8fe None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:24.349728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c713-479a-4d41-a844-c09b97ded8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:24.350159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c713-479a-4d41-a844-c09b97ded8fe None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:24.351045 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614c713-479a-4d41-a844-c09b97ded8fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:24.352724 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614c713-479a-4d41-a844-c09b97ded8fe None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:24.354345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: WARNING keystone.server.flask.common [None req-1614c713-479a-4d41-a844-c09b97ded8fe None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 12:11:24.378023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.sql.core [None req-1614c713-479a-4d41-a844-c09b97ded8fe None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 12:11:24.378023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 12:11:24.378023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [parameters: {'id': '7ed736a171334a78ae96e6ff6fa547c7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 12:11:24.378023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80176) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-1614c713-479a-4d41-a844-c09b97ded8fe None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7ed736a171334a78ae96e6ff6fa547c7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7ed736a171334a78ae96e6ff6fa547c7. Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application conn.query(q) Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 12:11:24.390769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application result.read() Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 22 12:11:24.392438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application next(self.gen) Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application yield resource Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application next(self.gen) Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise self.value Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application session.commit() Jun 22 12:11:24.393722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self.session.flush() Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application compat.raise_( Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 12:11:24.394911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 12:11:24.396181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application conn.query(q) Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application result.read() Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 12:11:24.397124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [parameters: {'id': '7ed736a171334a78ae96e6ff6fa547c7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:24.398044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:24.398876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:24.399774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:24.399774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 22 12:11:24.399774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 22 12:11:24.399774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:24.399774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:24.399774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 22 12:11:24.399774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 22 12:11:24.399774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7ed736a171334a78ae96e6ff6fa547c7. Jun 22 12:11:24.399774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:24.400754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 473/952] 10.222.0.66 () {60 vars in 1140 bytes} [Wed Jun 22 12:11:24 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:24.406898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea0ca4-a168-4e15-b092-b6c1f1bf0926 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:24.529966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea0ca4-a168-4e15-b092-b6c1f1bf0926 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:24.567907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28957f-4f7d-4773-a87e-2bfc1e605297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:24.569111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28957f-4f7d-4773-a87e-2bfc1e605297 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:24.569604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28957f-4f7d-4773-a87e-2bfc1e605297 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:24.570101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28957f-4f7d-4773-a87e-2bfc1e605297 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:24.580511 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28957f-4f7d-4773-a87e-2bfc1e605297 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:24.582331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28957f-4f7d-4773-a87e-2bfc1e605297 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5b28957f-4f7d-4773-a87e-2bfc1e605297 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:24.598215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:24.599909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:24.600885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:24.600885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:24.600885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:24.600885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:24.600885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:24.600885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:24.600885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:24.600885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:24.603541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 480/953] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:24.609673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c713-479a-4d41-a844-c09b97ded8fe None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:24.724200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c713-479a-4d41-a844-c09b97ded8fe None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:24.766187 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d90488-550a-4cdf-8fa1-7ebc11fa21c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:24.766880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90488-550a-4cdf-8fa1-7ebc11fa21c3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:24.767169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90488-550a-4cdf-8fa1-7ebc11fa21c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:24.767451 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90488-550a-4cdf-8fa1-7ebc11fa21c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:24.768270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d90488-550a-4cdf-8fa1-7ebc11fa21c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:24.768582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d90488-550a-4cdf-8fa1-7ebc11fa21c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:24.770273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d90488-550a-4cdf-8fa1-7ebc11fa21c3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:24.800196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 474/954] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:11:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:25.399889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c00852-60c0-4ed4-ad68-4d4f46dbffe0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:25.400638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c00852-60c0-4ed4-ad68-4d4f46dbffe0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:25.400638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c00852-60c0-4ed4-ad68-4d4f46dbffe0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:25.402707 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 481/955] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:25.409209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107266a7-e6dd-4c01-ac58-1b405d67fb71 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:25.409732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107266a7-e6dd-4c01-ac58-1b405d67fb71 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:25.409820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107266a7-e6dd-4c01-ac58-1b405d67fb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:25.434138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-107266a7-e6dd-4c01-ac58-1b405d67fb71 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:25.436739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-107266a7-e6dd-4c01-ac58-1b405d67fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:25.461211 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:25.544090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 475/956] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:25.579200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c00852-60c0-4ed4-ad68-4d4f46dbffe0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:25.640908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:25.704944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840221-692d-44a6-8c98-1e69871d1477 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:25.705324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840221-692d-44a6-8c98-1e69871d1477 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:25.705506 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840221-692d-44a6-8c98-1e69871d1477 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:25.707286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 476/957] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:25.707539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c00852-60c0-4ed4-ad68-4d4f46dbffe0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:25.713772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c197a5e-38bf-430b-b9b9-302fb29b7507 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:25.714220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c197a5e-38bf-430b-b9b9-302fb29b7507 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:25.714632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c197a5e-38bf-430b-b9b9-302fb29b7507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:25.737488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0c197a5e-38bf-430b-b9b9-302fb29b7507 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:25.740159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0c197a5e-38bf-430b-b9b9-302fb29b7507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:25.751264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429c092-8da5-4006-9180-20ea34d78631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:25.752151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c092-8da5-4006-9180-20ea34d78631 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:25.752433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c092-8da5-4006-9180-20ea34d78631 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:25.752705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c092-8da5-4006-9180-20ea34d78631 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:25.764798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429c092-8da5-4006-9180-20ea34d78631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0429c092-8da5-4006-9180-20ea34d78631 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:25.773909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:25.774945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:25.776374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 482/958] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 12:11:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:25.781328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429c092-8da5-4006-9180-20ea34d78631 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:25.848382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 477/959] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:25.866509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c197a5e-38bf-430b-b9b9-302fb29b7507 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:25.899797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:25.904012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429c092-8da5-4006-9180-20ea34d78631 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:25.942388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a114b3f-f981-4a2e-a5ea-ecc7cab2dc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:25.943494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114b3f-f981-4a2e-a5ea-ecc7cab2dc0e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:25.944081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114b3f-f981-4a2e-a5ea-ecc7cab2dc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:25.944610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114b3f-f981-4a2e-a5ea-ecc7cab2dc0e None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:25.945720 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a114b3f-f981-4a2e-a5ea-ecc7cab2dc0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:25.946252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a114b3f-f981-4a2e-a5ea-ecc7cab2dc0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:25.947831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a114b3f-f981-4a2e-a5ea-ecc7cab2dc0e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:25.956627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:25.958994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 483/960] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 12:11:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:25.964333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a114b3f-f981-4a2e-a5ea-ecc7cab2dc0e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:25.981878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c197a5e-38bf-430b-b9b9-302fb29b7507 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:26.026749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071f4e4-afa4-4322-8c2e-26a700bb5d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:26.028417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071f4e4-afa4-4322-8c2e-26a700bb5d20 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:26.028719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071f4e4-afa4-4322-8c2e-26a700bb5d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:26.029229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071f4e4-afa4-4322-8c2e-26a700bb5d20 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:26.030593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071f4e4-afa4-4322-8c2e-26a700bb5d20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:26.033521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071f4e4-afa4-4322-8c2e-26a700bb5d20 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:26.064610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 478/961] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:11:25 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:11:26.084810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a114b3f-f981-4a2e-a5ea-ecc7cab2dc0e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:26.153268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02edbe-6433-44ea-9fb1-a70b95e93041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:26.155308 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02edbe-6433-44ea-9fb1-a70b95e93041 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:26.156140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02edbe-6433-44ea-9fb1-a70b95e93041 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:26.156958 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02edbe-6433-44ea-9fb1-a70b95e93041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:26.173629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02edbe-6433-44ea-9fb1-a70b95e93041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:26.175705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02edbe-6433-44ea-9fb1-a70b95e93041 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5b02edbe-6433-44ea-9fb1-a70b95e93041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:26.203048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:26.205117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:26.207129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:26.207129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:26.207129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:26.207129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:26.211815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 484/962] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:26.217756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071f4e4-afa4-4322-8c2e-26a700bb5d20 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:26.348606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071f4e4-afa4-4322-8c2e-26a700bb5d20 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:26.385763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ba216-d74d-4ae9-b84b-85a0bc3c1ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:26.386801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ba216-d74d-4ae9-b84b-85a0bc3c1ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:26.387335 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ba216-d74d-4ae9-b84b-85a0bc3c1ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:26.387820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ba216-d74d-4ae9-b84b-85a0bc3c1ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:26.388793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ba216-d74d-4ae9-b84b-85a0bc3c1ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:26.389311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ba216-d74d-4ae9-b84b-85a0bc3c1ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:26.391154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ba216-d74d-4ae9-b84b-85a0bc3c1ab6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:26.402817 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:26.408717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 479/963] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:26.417156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02edbe-6433-44ea-9fb1-a70b95e93041 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:26.431462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:26.516291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3aa16-d3d1-4802-b699-30ef7d7556fd None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:26.516797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3aa16-d3d1-4802-b699-30ef7d7556fd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:26.516797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3aa16-d3d1-4802-b699-30ef7d7556fd None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:26.518467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 480/964] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:26.524401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7109aa-51d1-4a69-9f35-d728304d9cc4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:26.524737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7109aa-51d1-4a69-9f35-d728304d9cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:26.524975 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7109aa-51d1-4a69-9f35-d728304d9cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:26.540299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02edbe-6433-44ea-9fb1-a70b95e93041 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:26.545219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7a7109aa-51d1-4a69-9f35-d728304d9cc4 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:26.546438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7a7109aa-51d1-4a69-9f35-d728304d9cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:26.578666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf9484-bcc6-4fbc-a488-85b35bed3bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:26.579908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf9484-bcc6-4fbc-a488-85b35bed3bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:26.580428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf9484-bcc6-4fbc-a488-85b35bed3bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:26.580908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf9484-bcc6-4fbc-a488-85b35bed3bd7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:26.590078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf9484-bcc6-4fbc-a488-85b35bed3bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:26.592076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf9484-bcc6-4fbc-a488-85b35bed3bd7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-40cf9484-bcc6-4fbc-a488-85b35bed3bd7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:26.608649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:26.609661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:26.610596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:26.610596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:26.610596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:26.610596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:26.610596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:26.610596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:26.610596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:26.610596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:26.610596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 12:11:26.610596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:26.613115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 485/965] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 12:11:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:26.619223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf9484-bcc6-4fbc-a488-85b35bed3bd7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:26.640324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 481/966] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:26.660036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7109aa-51d1-4a69-9f35-d728304d9cc4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:26.706646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:26.745363 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf9484-bcc6-4fbc-a488-85b35bed3bd7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:26.789915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7109aa-51d1-4a69-9f35-d728304d9cc4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:26.792846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeea93-5225-4bbb-8300-d62c2563cac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:26.793825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeea93-5225-4bbb-8300-d62c2563cac8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:26.794338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeea93-5225-4bbb-8300-d62c2563cac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:26.794827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeea93-5225-4bbb-8300-d62c2563cac8 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:26.795896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eeea93-5225-4bbb-8300-d62c2563cac8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:26.796456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eeea93-5225-4bbb-8300-d62c2563cac8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:26.798219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eeea93-5225-4bbb-8300-d62c2563cac8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:26.827496 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:26.831303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 486/967] 10.222.0.66 () {56 vars in 1149 bytes} [Wed Jun 22 12:11:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:26.835613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeea93-5225-4bbb-8300-d62c2563cac8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:26.841071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15ee7f-37cf-4af6-992e-17a37c7fa755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:26.842260 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15ee7f-37cf-4af6-992e-17a37c7fa755 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:26.842798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15ee7f-37cf-4af6-992e-17a37c7fa755 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:26.843290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15ee7f-37cf-4af6-992e-17a37c7fa755 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:26.844268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15ee7f-37cf-4af6-992e-17a37c7fa755 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:26.846099 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15ee7f-37cf-4af6-992e-17a37c7fa755 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-7c15ee7f-37cf-4af6-992e-17a37c7fa755 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:26.861427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:26.862621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:26.863626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:26.867275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 482/968] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 12:11:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:26.872993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15ee7f-37cf-4af6-992e-17a37c7fa755 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:26.975072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeea93-5225-4bbb-8300-d62c2563cac8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:27.012324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15ee7f-37cf-4af6-992e-17a37c7fa755 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:27.018791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:27.029863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c013d8-acce-4d8f-8e6d-8a632bef2776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:27.031177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c013d8-acce-4d8f-8e6d-8a632bef2776 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:27.032193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c013d8-acce-4d8f-8e6d-8a632bef2776 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:27.032489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c013d8-acce-4d8f-8e6d-8a632bef2776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:27.055882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f53163-fdbc-4d08-9e81-12205cf8f062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:27.056476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f53163-fdbc-4d08-9e81-12205cf8f062 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:27.056762 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f53163-fdbc-4d08-9e81-12205cf8f062 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:27.057040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f53163-fdbc-4d08-9e81-12205cf8f062 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:27.057765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f53163-fdbc-4d08-9e81-12205cf8f062 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:27.058061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f53163-fdbc-4d08-9e81-12205cf8f062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:27.059476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f53163-fdbc-4d08-9e81-12205cf8f062 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:27.071916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 483/969] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 12:11:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:27.071916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351cc7-0276-4b60-8b4a-39a97918bfa0 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:27.071916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351cc7-0276-4b60-8b4a-39a97918bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:27.071916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351cc7-0276-4b60-8b4a-39a97918bfa0 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:27.071916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 484/970] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:27.074791 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351cc7-0276-4b60-8b4a-39a97918bfa0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:27.130110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c013d8-acce-4d8f-8e6d-8a632bef2776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:27.132299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c013d8-acce-4d8f-8e6d-8a632bef2776 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:27.153828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:27.199927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351cc7-0276-4b60-8b4a-39a97918bfa0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:27.237119 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b7ad5-d1ac-4e16-8263-0dbfa9e31817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:27.238937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b7ad5-d1ac-4e16-8263-0dbfa9e31817 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:27.239251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b7ad5-d1ac-4e16-8263-0dbfa9e31817 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:27.239628 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b7ad5-d1ac-4e16-8263-0dbfa9e31817 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:27.240300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b7ad5-d1ac-4e16-8263-0dbfa9e31817 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:27.240602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b7ad5-d1ac-4e16-8263-0dbfa9e31817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:27.242917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b7ad5-d1ac-4e16-8263-0dbfa9e31817 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:27.250223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 485/971] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 12:11:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:27.256799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664607e-6854-416b-a52e-1e490d557e4b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:27.257090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664607e-6854-416b-a52e-1e490d557e4b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:27.257372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664607e-6854-416b-a52e-1e490d557e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:27.261265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 487/972] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:26 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 12:11:27.262518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c013d8-acce-4d8f-8e6d-8a632bef2776 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:27.279821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a664607e-6854-416b-a52e-1e490d557e4b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:27.281101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a664607e-6854-416b-a52e-1e490d557e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:27.299756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:27.360154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 486/973] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:27.360154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664607e-6854-416b-a52e-1e490d557e4b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:27.392643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c013d8-acce-4d8f-8e6d-8a632bef2776 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:27.432319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea301b56-9d9c-4df6-a6a1-f3081d3b712f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:27.433100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea301b56-9d9c-4df6-a6a1-f3081d3b712f None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:27.433254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea301b56-9d9c-4df6-a6a1-f3081d3b712f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:27.433528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea301b56-9d9c-4df6-a6a1-f3081d3b712f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:27.434271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea301b56-9d9c-4df6-a6a1-f3081d3b712f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:27.435660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea301b56-9d9c-4df6-a6a1-f3081d3b712f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:27.438228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:27.458227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 488/974] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 12:11:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:27.459877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea301b56-9d9c-4df6-a6a1-f3081d3b712f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:27.518694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664607e-6854-416b-a52e-1e490d557e4b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:27.576825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3dcd4-fe39-4808-9de2-8026c8cca0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:27.578350 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3dcd4-fe39-4808-9de2-8026c8cca0cc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:27.579426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3dcd4-fe39-4808-9de2-8026c8cca0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:27.580057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3dcd4-fe39-4808-9de2-8026c8cca0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:27.590430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:27.597816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3dcd4-fe39-4808-9de2-8026c8cca0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:27.600314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3dcd4-fe39-4808-9de2-8026c8cca0cc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:27.618329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea301b56-9d9c-4df6-a6a1-f3081d3b712f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f4f3dcd4-fe39-4808-9de2-8026c8cca0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:27.626053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:27.627036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:27.627954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:27.627954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:27.627954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:27.627954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:27.633103 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 487/975] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:27.635468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3dcd4-fe39-4808-9de2-8026c8cca0cc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:27.684398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96538012-c525-4039-803a-ba299227321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:27.685589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96538012-c525-4039-803a-ba299227321b None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:27.686105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96538012-c525-4039-803a-ba299227321b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:27.686385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96538012-c525-4039-803a-ba299227321b None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:27.687111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96538012-c525-4039-803a-ba299227321b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:27.688724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96538012-c525-4039-803a-ba299227321b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:27.690088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: WARNING keystone.server.flask.common [None req-96538012-c525-4039-803a-ba299227321b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 12:11:27.704626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.sql.core [None req-96538012-c525-4039-803a-ba299227321b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 12:11:27.704626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 12:11:27.704626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [parameters: {'user_id': '7cefb144182f4470b1a8a8f9337797fe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 12:11:27.704626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80175) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-96538012-c525-4039-803a-ba299227321b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application conn.query(q) Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application result.read() Jun 22 12:11:27.729143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 12:11:27.730138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application next(self.gen) Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application yield resource Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application next(self.gen) Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise self.value Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application session.commit() Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 12:11:27.731093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.session.flush() Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application compat.raise_( Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 12:11:27.731998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 12:11:27.733259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application conn.query(q) Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application result.read() Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 12:11:27.734090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [parameters: {'user_id': '7cefb144182f4470b1a8a8f9337797fe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:27.734937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 22 12:11:27.735748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 22 12:11:27.737170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 22 12:11:27.737170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 22 12:11:27.737170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 12:11:27.737170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 12:11:27.737170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 12:11:27.737170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:27.737170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 489/976] 10.222.0.66 () {60 vars in 1131 bytes} [Wed Jun 22 12:11:27 2022] POST /identity/v3/users => generated 160 bytes in 272 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:27.740457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96538012-c525-4039-803a-ba299227321b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:27.776533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:27.782268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3dcd4-fe39-4808-9de2-8026c8cca0cc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:27.828073 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f67582-0cdf-43e5-bfb1-952ac4e198c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:27.829211 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f67582-0cdf-43e5-bfb1-952ac4e198c0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:27.829908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f67582-0cdf-43e5-bfb1-952ac4e198c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:27.830335 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f67582-0cdf-43e5-bfb1-952ac4e198c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:27.831508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f67582-0cdf-43e5-bfb1-952ac4e198c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:27.832478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f67582-0cdf-43e5-bfb1-952ac4e198c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:27.835277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f67582-0cdf-43e5-bfb1-952ac4e198c0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:27.860215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 488/977] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:27.861330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f67582-0cdf-43e5-bfb1-952ac4e198c0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:27.896060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96538012-c525-4039-803a-ba299227321b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:27.946778 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba71baa-783a-4f3d-9700-7006b5979a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:27.948233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba71baa-783a-4f3d-9700-7006b5979a38 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:27.948676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba71baa-783a-4f3d-9700-7006b5979a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:27.949108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba71baa-783a-4f3d-9700-7006b5979a38 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:27.962207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba71baa-783a-4f3d-9700-7006b5979a38 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:27.965195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba71baa-783a-4f3d-9700-7006b5979a38 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:27.983250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f67582-0cdf-43e5-bfb1-952ac4e198c0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9ba71baa-783a-4f3d-9700-7006b5979a38 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:27.986948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:27.988177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:27.989932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:27.989932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:27.989932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:27.989932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:27.989932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:27.989932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:27.989932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:27.989932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:27.989932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 12:11:27.989932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:27.992445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 490/978] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:11:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:27.998461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba71baa-783a-4f3d-9700-7006b5979a38 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:28.009969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:28.030418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b6b49-0ce3-4a54-817f-d20a0f35eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:28.031319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b6b49-0ce3-4a54-817f-d20a0f35eef9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:28.031672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b6b49-0ce3-4a54-817f-d20a0f35eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:28.032065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b6b49-0ce3-4a54-817f-d20a0f35eef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:28.040087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b6b49-0ce3-4a54-817f-d20a0f35eef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:28.041642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b6b49-0ce3-4a54-817f-d20a0f35eef9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-9e9b6b49-0ce3-4a54-817f-d20a0f35eef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:28.057539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:28.058550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:28.059444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:28.059444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:28.059444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:28.059444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:28.059444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:28.059444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:28.059444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:28.059444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:28.063776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 489/979] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:28.064765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b6b49-0ce3-4a54-817f-d20a0f35eef9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:28.088587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:28.107838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba71baa-783a-4f3d-9700-7006b5979a38 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:28.143293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60093ab-9a9c-48d5-9a4f-6538db00d95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:28.143980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60093ab-9a9c-48d5-9a4f-6538db00d95c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:28.144318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60093ab-9a9c-48d5-9a4f-6538db00d95c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:28.144599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60093ab-9a9c-48d5-9a4f-6538db00d95c None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:28.145481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60093ab-9a9c-48d5-9a4f-6538db00d95c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:28.145796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60093ab-9a9c-48d5-9a4f-6538db00d95c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:28.147320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60093ab-9a9c-48d5-9a4f-6538db00d95c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:28.186299 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b6b49-0ce3-4a54-817f-d20a0f35eef9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:28.192582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 491/980] 10.222.0.66 () {56 vars in 1101 bytes} [Wed Jun 22 12:11:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:28.240116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e77b03-17de-4136-bd6d-a012b13ca4bc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:28.240768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e77b03-17de-4136-bd6d-a012b13ca4bc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:28.240768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e77b03-17de-4136-bd6d-a012b13ca4bc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:28.242665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 492/981] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:11:28.245396 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3d979-f434-46cf-a133-47910f46418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:28.246078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3d979-f434-46cf-a133-47910f46418c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:28.246428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3d979-f434-46cf-a133-47910f46418c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:28.246672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3d979-f434-46cf-a133-47910f46418c None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:28.248409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab31df7-f834-47a2-9c99-3a643156bf97 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:28.248719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab31df7-f834-47a2-9c99-3a643156bf97 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:28.248871 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3d979-f434-46cf-a133-47910f46418c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:28.249031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab31df7-f834-47a2-9c99-3a643156bf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:28.249167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3d979-f434-46cf-a133-47910f46418c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:28.250582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3d979-f434-46cf-a133-47910f46418c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:28.265992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 490/982] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:28.268548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-aab31df7-f834-47a2-9c99-3a643156bf97 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:28.270096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aab31df7-f834-47a2-9c99-3a643156bf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:28.280914 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3d979-f434-46cf-a133-47910f46418c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:28.348443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:28.364952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 493/983] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:28.392798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab31df7-f834-47a2-9c99-3a643156bf97 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:28.447994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:28.484104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3d979-f434-46cf-a133-47910f46418c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:28.531097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab31df7-f834-47a2-9c99-3a643156bf97 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:28.540306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e876e-e100-4813-9937-5fbd7fdcf018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:28.541118 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e876e-e100-4813-9937-5fbd7fdcf018 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:28.541956 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e876e-e100-4813-9937-5fbd7fdcf018 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:28.541956 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e876e-e100-4813-9937-5fbd7fdcf018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:28.542604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e876e-e100-4813-9937-5fbd7fdcf018 None admin] RBAC: Adding query filter params (role.id=4c83d9b4ae1941e7a700b5a4408b6264, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=d8a79dc2ab494cb6aaf3b1f4001b7524) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:28.542980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e876e-e100-4813-9937-5fbd7fdcf018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:28.544452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e876e-e100-4813-9937-5fbd7fdcf018 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:28.553522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 491/984] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:28 2022] GET /identity/v3/role_assignments?user.id=d8a79dc2ab494cb6aaf3b1f4001b7524&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=4c83d9b4ae1941e7a700b5a4408b6264 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:28.579024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5764f3-5915-40c1-963a-db983421e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:28.579878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5764f3-5915-40c1-963a-db983421e68d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:28.580193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5764f3-5915-40c1-963a-db983421e68d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:28.580475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5764f3-5915-40c1-963a-db983421e68d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:28.581166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5764f3-5915-40c1-963a-db983421e68d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:28.582639 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5764f3-5915-40c1-963a-db983421e68d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3b5764f3-5915-40c1-963a-db983421e68d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:28.596470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:28.597844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:28.598798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 494/985] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:28.611289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e876e-e100-4813-9937-5fbd7fdcf018 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:28.773934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e876e-e100-4813-9937-5fbd7fdcf018 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:28.843529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d4726-a273-4351-a593-b31f3aa74bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:28.844751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4726-a273-4351-a593-b31f3aa74bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:28.845266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4726-a273-4351-a593-b31f3aa74bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:28.845772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4726-a273-4351-a593-b31f3aa74bc1 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:28.847146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d4726-a273-4351-a593-b31f3aa74bc1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:28.847688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d4726-a273-4351-a593-b31f3aa74bc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:28.851041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d4726-a273-4351-a593-b31f3aa74bc1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:28.861476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 492/986] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:11:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:28.868415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5764f3-5915-40c1-963a-db983421e68d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:28.986780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:29.064229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5764f3-5915-40c1-963a-db983421e68d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:29.107058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b5e39-4644-4cb6-835f-8e4355c739e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:29.107797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b5e39-4644-4cb6-835f-8e4355c739e2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:29.108116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b5e39-4644-4cb6-835f-8e4355c739e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:29.108405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b5e39-4644-4cb6-835f-8e4355c739e2 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:29.109142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b5e39-4644-4cb6-835f-8e4355c739e2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:29.109452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b5e39-4644-4cb6-835f-8e4355c739e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:29.110875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b5e39-4644-4cb6-835f-8e4355c739e2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:29.117291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 495/987] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:11:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:29.123680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d4726-a273-4351-a593-b31f3aa74bc1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:29.144325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:29.316308 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d4726-a273-4351-a593-b31f3aa74bc1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:29.376044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb4f63-13c4-4960-adfd-39e9aa1ba1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:29.377357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb4f63-13c4-4960-adfd-39e9aa1ba1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:29.377841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb4f63-13c4-4960-adfd-39e9aa1ba1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:29.378361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb4f63-13c4-4960-adfd-39e9aa1ba1c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:29.379994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb4f63-13c4-4960-adfd-39e9aa1ba1c3 None admin] RBAC: Adding query filter params (interface=public, service_id=9c45ba1d4eae4fe9810800c0f8aeff6c, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:29.380578 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb4f63-13c4-4960-adfd-39e9aa1ba1c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:29.383107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb4f63-13c4-4960-adfd-39e9aa1ba1c3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:29.393918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 493/988] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 12:11:29 2022] GET /identity/v3/endpoints?service_id=9c45ba1d4eae4fe9810800c0f8aeff6c&interface=public®ion_id=RegionOne => generated 194 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:29.403574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b5e39-4644-4cb6-835f-8e4355c739e2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:29.606712 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b5e39-4644-4cb6-835f-8e4355c739e2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:29.638189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:29.654924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08db75-b9de-47da-90c2-21141bf3ba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:29.655612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08db75-b9de-47da-90c2-21141bf3ba38 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:29.655901 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08db75-b9de-47da-90c2-21141bf3ba38 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:29.656218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08db75-b9de-47da-90c2-21141bf3ba38 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:29.656928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08db75-b9de-47da-90c2-21141bf3ba38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:29.658345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08db75-b9de-47da-90c2-21141bf3ba38 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:29.666060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 496/989] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 12:11:29 2022] GET /identity/v3/services => generated 1727 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:11:29.697843 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2736f0a-53f7-4159-9e82-91936049bcab None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:29.698659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2736f0a-53f7-4159-9e82-91936049bcab None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:29.698659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2736f0a-53f7-4159-9e82-91936049bcab None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:29.700199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 494/990] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:11:29.706153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6dafd-e179-43b7-bca7-3867c3e9c8af None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:29.706429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6dafd-e179-43b7-bca7-3867c3e9c8af None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:29.706779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6dafd-e179-43b7-bca7-3867c3e9c8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:29.727733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bdd6dafd-e179-43b7-bca7-3867c3e9c8af None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:29.729155 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bdd6dafd-e179-43b7-bca7-3867c3e9c8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:29.829047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 497/991] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:29.852709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2736f0a-53f7-4159-9e82-91936049bcab None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:29.939120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:29.977462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2736f0a-53f7-4159-9e82-91936049bcab None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:30.016954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce7b2-bf04-4b31-a09d-769285f63dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:30.017774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce7b2-bf04-4b31-a09d-769285f63dba None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:30.018069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce7b2-bf04-4b31-a09d-769285f63dba None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:30.018340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce7b2-bf04-4b31-a09d-769285f63dba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:30.019017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ce7b2-bf04-4b31-a09d-769285f63dba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:30.021012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ce7b2-bf04-4b31-a09d-769285f63dba None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-e94ce7b2-bf04-4b31-a09d-769285f63dba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:30.033974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:30.035040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:30.036444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:30.037682 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 495/992] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 12:11:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:30.041825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6dafd-e179-43b7-bca7-3867c3e9c8af None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:30.161385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6dafd-e179-43b7-bca7-3867c3e9c8af None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:30.181131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:30.209022 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c937f5-4a02-4e60-8a86-aa887b8b395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:30.209988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c937f5-4a02-4e60-8a86-aa887b8b395f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:30.210454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c937f5-4a02-4e60-8a86-aa887b8b395f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:30.210906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c937f5-4a02-4e60-8a86-aa887b8b395f None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:30.212129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c937f5-4a02-4e60-8a86-aa887b8b395f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:30.212633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c937f5-4a02-4e60-8a86-aa887b8b395f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:30.214985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c937f5-4a02-4e60-8a86-aa887b8b395f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:30.231127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 498/993] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 12:11:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:30.232216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce7b2-bf04-4b31-a09d-769285f63dba None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:30.351109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce7b2-bf04-4b31-a09d-769285f63dba None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:30.390019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac7992-4ad4-4238-bd07-9eb82998f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:30.390966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac7992-4ad4-4238-bd07-9eb82998f584 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:30.391235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac7992-4ad4-4238-bd07-9eb82998f584 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:30.391512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac7992-4ad4-4238-bd07-9eb82998f584 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:30.398615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac7992-4ad4-4238-bd07-9eb82998f584 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:30.398615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac7992-4ad4-4238-bd07-9eb82998f584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:30.398615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac7992-4ad4-4238-bd07-9eb82998f584 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:30.412983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:30.413227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c937f5-4a02-4e60-8a86-aa887b8b395f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:30.413373 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 496/994] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 12:11:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:30.550680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c937f5-4a02-4e60-8a86-aa887b8b395f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:30.600622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb97ee8-366e-4fea-bd7f-1a0775bcc5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:30.601293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb97ee8-366e-4fea-bd7f-1a0775bcc5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:30.601572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb97ee8-366e-4fea-bd7f-1a0775bcc5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:30.601851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb97ee8-366e-4fea-bd7f-1a0775bcc5d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:30.602659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb97ee8-366e-4fea-bd7f-1a0775bcc5d9 None admin] RBAC: Adding query filter params (interface=admin, service_id=109dcf24a20c46cfbfeeba1a960ef500, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:30.602969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb97ee8-366e-4fea-bd7f-1a0775bcc5d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:30.604397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb97ee8-366e-4fea-bd7f-1a0775bcc5d9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:30.610637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 499/995] 10.222.0.66 () {56 vars in 1249 bytes} [Wed Jun 22 12:11:30 2022] GET /identity/v3/endpoints?service_id=109dcf24a20c46cfbfeeba1a960ef500&interface=admin®ion_id=RegionOne => generated 193 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:30.619646 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac7992-4ad4-4238-bd07-9eb82998f584 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:30.744206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac7992-4ad4-4238-bd07-9eb82998f584 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:30.785751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451146f9-308d-44e3-a85d-8db67a1b3ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:30.786953 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451146f9-308d-44e3-a85d-8db67a1b3ffb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:30.787419 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451146f9-308d-44e3-a85d-8db67a1b3ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:30.788083 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451146f9-308d-44e3-a85d-8db67a1b3ffb None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:30.790177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451146f9-308d-44e3-a85d-8db67a1b3ffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:30.792422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ccbc3-c475-4915-99af-04ac4f948b2b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:30.792766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ccbc3-c475-4915-99af-04ac4f948b2b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:30.793031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ccbc3-c475-4915-99af-04ac4f948b2b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:30.794198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451146f9-308d-44e3-a85d-8db67a1b3ffb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:30.796284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 500/996] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:11:30.802945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 497/997] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 12:11:30 2022] GET /identity/v3/services => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:11:30.803180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc394-8814-4c23-938e-8dce35a7020b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:30.803502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc394-8814-4c23-938e-8dce35a7020b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:30.803779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc394-8814-4c23-938e-8dce35a7020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:30.826950 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a9cbc394-8814-4c23-938e-8dce35a7020b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:30.828192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a9cbc394-8814-4c23-938e-8dce35a7020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:30.880420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:30.929446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 501/998] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:30.971054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451146f9-308d-44e3-a85d-8db67a1b3ffb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:31.093413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:31.151584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451146f9-308d-44e3-a85d-8db67a1b3ffb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:31.201062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f96f7b-13b4-49a7-b8bd-d6fbd37cfd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:31.202348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f96f7b-13b4-49a7-b8bd-d6fbd37cfd1f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:31.202776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f96f7b-13b4-49a7-b8bd-d6fbd37cfd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:31.203244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f96f7b-13b4-49a7-b8bd-d6fbd37cfd1f None admin] PATH_INFO: `/v3/services/image` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:31.204372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f96f7b-13b4-49a7-b8bd-d6fbd37cfd1f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:31.206774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f96f7b-13b4-49a7-b8bd-d6fbd37cfd1f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-23f96f7b-13b4-49a7-b8bd-d6fbd37cfd1f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:31.220240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:31.221388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:31.222450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 498/999] 10.222.0.66 () {56 vars in 1105 bytes} [Wed Jun 22 12:11:30 2022] GET /identity/v3/services/image => generated 86 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:31.230065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc394-8814-4c23-938e-8dce35a7020b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:31.347832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc394-8814-4c23-938e-8dce35a7020b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:31.391802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3852a4-4043-4f63-8291-2f647c9b98bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:31.392542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3852a4-4043-4f63-8291-2f647c9b98bc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:31.392826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3852a4-4043-4f63-8291-2f647c9b98bc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:31.393104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3852a4-4043-4f63-8291-2f647c9b98bc None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:31.393832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3852a4-4043-4f63-8291-2f647c9b98bc None admin] RBAC: Adding query filter params (name=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:31.394144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3852a4-4043-4f63-8291-2f647c9b98bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:31.395595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3852a4-4043-4f63-8291-2f647c9b98bc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:31.401860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 502/1000] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:31.408553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f96f7b-13b4-49a7-b8bd-d6fbd37cfd1f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:31.544044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f96f7b-13b4-49a7-b8bd-d6fbd37cfd1f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:31.587589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:31.601951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed65756-579f-466c-9b2c-67792a053356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:31.602951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65756-579f-466c-9b2c-67792a053356 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:31.603427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65756-579f-466c-9b2c-67792a053356 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:31.603904 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65756-579f-466c-9b2c-67792a053356 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:31.605223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed65756-579f-466c-9b2c-67792a053356 None admin] RBAC: Adding query filter params (type=image) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:31.605767 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed65756-579f-466c-9b2c-67792a053356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:31.608259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed65756-579f-466c-9b2c-67792a053356 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:31.620224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 499/1001] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:31.917586 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc046c-1fa9-41ac-a4dd-489e5e36d0da None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:31.917586 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc046c-1fa9-41ac-a4dd-489e5e36d0da None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:31.918560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc046c-1fa9-41ac-a4dd-489e5e36d0da None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:31.919410 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 503/1002] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:31.925094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17df48-dcca-45ad-8c31-36e427fee994 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:31.925761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17df48-dcca-45ad-8c31-36e427fee994 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:31.925761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17df48-dcca-45ad-8c31-36e427fee994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:31.944499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1f17df48-dcca-45ad-8c31-36e427fee994 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:31.945750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1f17df48-dcca-45ad-8c31-36e427fee994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:32.025145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 500/1003] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:32.049041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc046c-1fa9-41ac-a4dd-489e5e36d0da None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:32.094876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:32.191883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc046c-1fa9-41ac-a4dd-489e5e36d0da None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:32.257104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a20b39-c855-40ec-afe5-85de32046ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:32.258848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20b39-c855-40ec-afe5-85de32046ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:32.259585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20b39-c855-40ec-afe5-85de32046ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:32.260330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20b39-c855-40ec-afe5-85de32046ca0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:32.261691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a20b39-c855-40ec-afe5-85de32046ca0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:32.264438 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a20b39-c855-40ec-afe5-85de32046ca0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d8a20b39-c855-40ec-afe5-85de32046ca0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:32.285420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:32.287012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:32.288682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 504/1004] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:32.295772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17df48-dcca-45ad-8c31-36e427fee994 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:32.419235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17df48-dcca-45ad-8c31-36e427fee994 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:32.447040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:32.463951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6c7cd-5191-4436-89f9-6af58aaa559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:32.464922 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6c7cd-5191-4436-89f9-6af58aaa559f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:32.465399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6c7cd-5191-4436-89f9-6af58aaa559f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:32.465804 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6c7cd-5191-4436-89f9-6af58aaa559f None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:32.466671 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6c7cd-5191-4436-89f9-6af58aaa559f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:32.467105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6c7cd-5191-4436-89f9-6af58aaa559f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:32.468725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6c7cd-5191-4436-89f9-6af58aaa559f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:32.478558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 501/1005] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:11:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:32.484444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a20b39-c855-40ec-afe5-85de32046ca0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:32.625636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a20b39-c855-40ec-afe5-85de32046ca0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:32.627345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:32.671279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb84d1-bae5-48ac-80b3-ad202627280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:32.671951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb84d1-bae5-48ac-80b3-ad202627280d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:32.672263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb84d1-bae5-48ac-80b3-ad202627280d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:32.672539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb84d1-bae5-48ac-80b3-ad202627280d None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:32.673250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb84d1-bae5-48ac-80b3-ad202627280d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:32.673554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb84d1-bae5-48ac-80b3-ad202627280d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:32.674938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb84d1-bae5-48ac-80b3-ad202627280d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:32.681480 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 505/1006] 10.222.0.66 () {56 vars in 1112 bytes} [Wed Jun 22 12:11:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:32.687585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6c7cd-5191-4436-89f9-6af58aaa559f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:32.804767 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6c7cd-5191-4436-89f9-6af58aaa559f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:32.866563 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4b5d5-6733-4906-ab4c-fc9b229515fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:32.867642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4b5d5-6733-4906-ab4c-fc9b229515fb None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:32.868182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4b5d5-6733-4906-ab4c-fc9b229515fb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:32.868661 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4b5d5-6733-4906-ab4c-fc9b229515fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:32.869981 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4b5d5-6733-4906-ab4c-fc9b229515fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:32.872467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4b5d5-6733-4906-ab4c-fc9b229515fb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:32.902544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 502/1007] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 12:11:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:32.916131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32784ca5-1f32-469b-87f5-7cb3d906fbca None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:32.916509 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32784ca5-1f32-469b-87f5-7cb3d906fbca None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:32.916876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32784ca5-1f32-469b-87f5-7cb3d906fbca None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:32.918564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 506/1008] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:32.924933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b4b94-b21b-4b59-ad6c-d3b37427db7c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:32.925222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b4b94-b21b-4b59-ad6c-d3b37427db7c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:32.925986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b4b94-b21b-4b59-ad6c-d3b37427db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:32.944412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-398b4b94-b21b-4b59-ad6c-d3b37427db7c None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:32.945618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-398b4b94-b21b-4b59-ad6c-d3b37427db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:32.994294 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:33.045686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 503/1009] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:32 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:33.069627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32784ca5-1f32-469b-87f5-7cb3d906fbca None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:33.189661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32784ca5-1f32-469b-87f5-7cb3d906fbca None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:33.236897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f17df7-ea2c-4497-9962-2cb1e1ed85b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:33.238254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f17df7-ea2c-4497-9962-2cb1e1ed85b1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:33.238766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f17df7-ea2c-4497-9962-2cb1e1ed85b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:33.239843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f17df7-ea2c-4497-9962-2cb1e1ed85b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:33.241065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f17df7-ea2c-4497-9962-2cb1e1ed85b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:33.243594 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f17df7-ea2c-4497-9962-2cb1e1ed85b1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b8f17df7-ea2c-4497-9962-2cb1e1ed85b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:33.260061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:33.261175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:33.262035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 507/1010] 10.222.0.66 () {56 vars in 1126 bytes} [Wed Jun 22 12:11:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:33.268052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b4b94-b21b-4b59-ad6c-d3b37427db7c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:33.435445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b4b94-b21b-4b59-ad6c-d3b37427db7c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:33.497473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ed4e5-6041-40da-a056-bc43094c6478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:33.498649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ed4e5-6041-40da-a056-bc43094c6478 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:33.499158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ed4e5-6041-40da-a056-bc43094c6478 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:33.499661 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ed4e5-6041-40da-a056-bc43094c6478 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:33.501040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ed4e5-6041-40da-a056-bc43094c6478 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:33.501513 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ed4e5-6041-40da-a056-bc43094c6478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:33.504263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ed4e5-6041-40da-a056-bc43094c6478 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:33.514545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 504/1011] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 12:11:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:33.523948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f17df7-ea2c-4497-9962-2cb1e1ed85b1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:33.573058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:33.655318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f17df7-ea2c-4497-9962-2cb1e1ed85b1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:33.692203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aced171-04dd-4fb1-81ba-4b9b2821121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:33.692807 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced171-04dd-4fb1-81ba-4b9b2821121f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:33.693096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced171-04dd-4fb1-81ba-4b9b2821121f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:33.693373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aced171-04dd-4fb1-81ba-4b9b2821121f None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:33.694102 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aced171-04dd-4fb1-81ba-4b9b2821121f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:33.694415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aced171-04dd-4fb1-81ba-4b9b2821121f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:33.695824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aced171-04dd-4fb1-81ba-4b9b2821121f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:33.702808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 508/1012] 10.222.0.66 () {56 vars in 1122 bytes} [Wed Jun 22 12:11:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:33.708371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ed4e5-6041-40da-a056-bc43094c6478 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:33.724397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1cf46-5a92-448a-a586-f8bb4f94dbfb None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:33.724966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1cf46-5a92-448a-a586-f8bb4f94dbfb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:33.725255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1cf46-5a92-448a-a586-f8bb4f94dbfb None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:33.726677 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 509/1013] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:33.732476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb291fb-eb3a-4473-9548-f4e6f6ae6267 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:33.732783 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb291fb-eb3a-4473-9548-f4e6f6ae6267 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:33.733045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb291fb-eb3a-4473-9548-f4e6f6ae6267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:33.745712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:33.752418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1cb291fb-eb3a-4473-9548-f4e6f6ae6267 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:33.753675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1cb291fb-eb3a-4473-9548-f4e6f6ae6267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:33.842750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ed4e5-6041-40da-a056-bc43094c6478 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:33.847460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 510/1014] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:33 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:33.871052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb291fb-eb3a-4473-9548-f4e6f6ae6267 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:33.893003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44628a0-1f3d-4ccc-85c6-9481cf5d7515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:33.893732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44628a0-1f3d-4ccc-85c6-9481cf5d7515 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:33.893968 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44628a0-1f3d-4ccc-85c6-9481cf5d7515 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:33.894252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44628a0-1f3d-4ccc-85c6-9481cf5d7515 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:33.895013 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44628a0-1f3d-4ccc-85c6-9481cf5d7515 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:33.896982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44628a0-1f3d-4ccc-85c6-9481cf5d7515 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:33.905109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:33.933271 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 505/1015] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 12:11:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:34.019620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb291fb-eb3a-4473-9548-f4e6f6ae6267 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:34.074839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323a614-0ff8-4bac-8889-47f39f031530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:34.076077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323a614-0ff8-4bac-8889-47f39f031530 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:34.076584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323a614-0ff8-4bac-8889-47f39f031530 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:34.077093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323a614-0ff8-4bac-8889-47f39f031530 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:34.078491 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323a614-0ff8-4bac-8889-47f39f031530 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:34.081260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323a614-0ff8-4bac-8889-47f39f031530 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:34.101312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 511/1016] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:11:33 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:11:35.515636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23dce8-d26d-43ea-a7ff-d07cd2ee50ff None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:35.516195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23dce8-d26d-43ea-a7ff-d07cd2ee50ff None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:35.516574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23dce8-d26d-43ea-a7ff-d07cd2ee50ff None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:35.519139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 506/1017] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:35.527503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182972c-5742-4f89-ae58-47340aafd982 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:35.528178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182972c-5742-4f89-ae58-47340aafd982 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:35.528535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182972c-5742-4f89-ae58-47340aafd982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:35.557484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d182972c-5742-4f89-ae58-47340aafd982 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:35.559550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d182972c-5742-4f89-ae58-47340aafd982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:35.677578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 512/1018] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:35.711557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23dce8-d26d-43ea-a7ff-d07cd2ee50ff None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:35.837648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:35.854816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23dce8-d26d-43ea-a7ff-d07cd2ee50ff None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:35.903584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ace286-e004-4f9b-81e1-67db7215498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:35.904443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ace286-e004-4f9b-81e1-67db7215498e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:35.904728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ace286-e004-4f9b-81e1-67db7215498e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:35.905005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ace286-e004-4f9b-81e1-67db7215498e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:35.918189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ace286-e004-4f9b-81e1-67db7215498e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-28ace286-e004-4f9b-81e1-67db7215498e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:35.926634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:35.932537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:35.933570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 507/1019] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 12:11:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:35.938088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182972c-5742-4f89-ae58-47340aafd982 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:35.947105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:36.074618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182972c-5742-4f89-ae58-47340aafd982 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:36.112725 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f3894-a3ff-4955-ad46-0291c862db05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:36.113501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3894-a3ff-4955-ad46-0291c862db05 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.114432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3894-a3ff-4955-ad46-0291c862db05 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.114832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3894-a3ff-4955-ad46-0291c862db05 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.115869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f3894-a3ff-4955-ad46-0291c862db05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:36.116323 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f3894-a3ff-4955-ad46-0291c862db05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:36.117849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f3894-a3ff-4955-ad46-0291c862db05 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:36.132252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 513/1020] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 12:11:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:36.133462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ace286-e004-4f9b-81e1-67db7215498e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:36.236951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cdb28-c0df-4833-a5f5-10c90fed21ad None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.237249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cdb28-c0df-4833-a5f5-10c90fed21ad None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.237543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cdb28-c0df-4833-a5f5-10c90fed21ad None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.239133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 514/1021] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:11:36.243900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc201f-ac7a-4fbb-9bfb-363f02b7e628 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.244216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc201f-ac7a-4fbb-9bfb-363f02b7e628 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.244501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc201f-ac7a-4fbb-9bfb-363f02b7e628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.258823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ace286-e004-4f9b-81e1-67db7215498e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:36.261550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4efc201f-ac7a-4fbb-9bfb-363f02b7e628 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:36.262759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4efc201f-ac7a-4fbb-9bfb-363f02b7e628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:36.294857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeed278-eebb-4dea-8e91-0340f9bc7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:36.295752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeed278-eebb-4dea-8e91-0340f9bc7ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.296010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeed278-eebb-4dea-8e91-0340f9bc7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.296312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeed278-eebb-4dea-8e91-0340f9bc7ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.308560 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeed278-eebb-4dea-8e91-0340f9bc7ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:36.310043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeed278-eebb-4dea-8e91-0340f9bc7ea8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-4eeed278-eebb-4dea-8e91-0340f9bc7ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:36.327048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:36.327990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:36.328923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:36.328923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:36.328923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:36.328923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:36.328923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 508/1022] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:36.332360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:36.334029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeed278-eebb-4dea-8e91-0340f9bc7ea8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:36.338089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:36.340077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 515/1023] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:36.363080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc201f-ac7a-4fbb-9bfb-363f02b7e628 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:36.448879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeed278-eebb-4dea-8e91-0340f9bc7ea8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:36.471255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc201f-ac7a-4fbb-9bfb-363f02b7e628 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:36.485579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc643524-f657-4555-be7a-ef4088a27234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:36.486341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643524-f657-4555-be7a-ef4088a27234 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.486695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643524-f657-4555-be7a-ef4088a27234 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.486968 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643524-f657-4555-be7a-ef4088a27234 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.487703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc643524-f657-4555-be7a-ef4088a27234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:36.488058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc643524-f657-4555-be7a-ef4088a27234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:36.490257 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc643524-f657-4555-be7a-ef4088a27234 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:36.502468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 509/1024] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:36.502468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbb81e-a5a4-434f-8198-effec4dbda87 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.502468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbb81e-a5a4-434f-8198-effec4dbda87 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.502468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbb81e-a5a4-434f-8198-effec4dbda87 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.502468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 510/1025] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:36.508165 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbb81e-a5a4-434f-8198-effec4dbda87 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:36.515811 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51ccf3-de55-43eb-b921-ac2980c7f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:36.516634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51ccf3-de55-43eb-b921-ac2980c7f9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.516923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51ccf3-de55-43eb-b921-ac2980c7f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.517199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51ccf3-de55-43eb-b921-ac2980c7f9c1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.517848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51ccf3-de55-43eb-b921-ac2980c7f9c1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:36.519215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51ccf3-de55-43eb-b921-ac2980c7f9c1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0c51ccf3-de55-43eb-b921-ac2980c7f9c1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:36.531327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:36.533041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:36.534174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 516/1026] 10.222.0.66 () {56 vars in 1105 bytes} [Wed Jun 22 12:11:36 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:36.535173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a75f-7c1f-4f46-9b57-97817e0536cf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.535173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a75f-7c1f-4f46-9b57-97817e0536cf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.535173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a75f-7c1f-4f46-9b57-97817e0536cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.552633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-be08a75f-7c1f-4f46-9b57-97817e0536cf None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:36.553826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-be08a75f-7c1f-4f46-9b57-97817e0536cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:36.575981 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:36.611387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:36.618707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbb81e-a5a4-434f-8198-effec4dbda87 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:36.622910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 517/1027] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:36.623756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08a75f-7c1f-4f46-9b57-97817e0536cf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:36.658754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaab29-c9f0-4960-ae09-7be962f2b711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:36.659539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaab29-c9f0-4960-ae09-7be962f2b711 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.659826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaab29-c9f0-4960-ae09-7be962f2b711 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.660160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaab29-c9f0-4960-ae09-7be962f2b711 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.667564 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceaab29-c9f0-4960-ae09-7be962f2b711 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:36.669037 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceaab29-c9f0-4960-ae09-7be962f2b711 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-1ceaab29-c9f0-4960-ae09-7be962f2b711 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:36.683672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:36.684704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:36.685644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:36.685644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:36.685644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:36.685644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:36.685644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:36.685644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:36.685644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:36.685644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:36.685644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:11:36.685644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:36.685644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 511/1028] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 12:11:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:36.686246 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaab29-c9f0-4960-ae09-7be962f2b711 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:36.738138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08a75f-7c1f-4f46-9b57-97817e0536cf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:36.775551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178286c1-3aa5-4e3f-8592-739c405d0f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:36.776273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178286c1-3aa5-4e3f-8592-739c405d0f77 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.776608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178286c1-3aa5-4e3f-8592-739c405d0f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.776918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178286c1-3aa5-4e3f-8592-739c405d0f77 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.777663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178286c1-3aa5-4e3f-8592-739c405d0f77 None admin] RBAC: Adding query filter params (name=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:36.777997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178286c1-3aa5-4e3f-8592-739c405d0f77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:36.779380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178286c1-3aa5-4e3f-8592-739c405d0f77 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:36.785515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 518/1029] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:36.786451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178286c1-3aa5-4e3f-8592-739c405d0f77 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:36.794316 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaab29-c9f0-4960-ae09-7be962f2b711 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:36.821863 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:36.835111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771a5ec-4fc7-447c-8d3d-1c502a37d2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:36.835904 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771a5ec-4fc7-447c-8d3d-1c502a37d2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.836218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771a5ec-4fc7-447c-8d3d-1c502a37d2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.836492 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771a5ec-4fc7-447c-8d3d-1c502a37d2e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.837673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771a5ec-4fc7-447c-8d3d-1c502a37d2e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:36.839106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771a5ec-4fc7-447c-8d3d-1c502a37d2e2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:36.840880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 512/1030] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:36.841536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771a5ec-4fc7-447c-8d3d-1c502a37d2e2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:36.849404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:36.895278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178286c1-3aa5-4e3f-8592-739c405d0f77 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:36.930943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34340615-c5a5-48b3-a60d-a41ece4a6020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:36.931620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340615-c5a5-48b3-a60d-a41ece4a6020 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.931901 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340615-c5a5-48b3-a60d-a41ece4a6020 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.932211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340615-c5a5-48b3-a60d-a41ece4a6020 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.933046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34340615-c5a5-48b3-a60d-a41ece4a6020 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:36.933353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34340615-c5a5-48b3-a60d-a41ece4a6020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:36.934785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34340615-c5a5-48b3-a60d-a41ece4a6020 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:36.943509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771a5ec-4fc7-447c-8d3d-1c502a37d2e2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:36.953948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 519/1031] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 12:11:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:36.955732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34340615-c5a5-48b3-a60d-a41ece4a6020 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:36.980315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1995f8-be7e-48f7-9fac-ebf2afdb77d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:36.980982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1995f8-be7e-48f7-9fac-ebf2afdb77d7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:36.981269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1995f8-be7e-48f7-9fac-ebf2afdb77d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:36.981549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1995f8-be7e-48f7-9fac-ebf2afdb77d7 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:36.982267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1995f8-be7e-48f7-9fac-ebf2afdb77d7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:36.982576 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1995f8-be7e-48f7-9fac-ebf2afdb77d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:36.983962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1995f8-be7e-48f7-9fac-ebf2afdb77d7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:36.990120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 513/1032] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:36.990992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1995f8-be7e-48f7-9fac-ebf2afdb77d7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:37.066293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:37.074755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34340615-c5a5-48b3-a60d-a41ece4a6020 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:37.092073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:37.117397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1995f8-be7e-48f7-9fac-ebf2afdb77d7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:37.118558 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd66ba5-f69c-473e-9d91-c1ec042f4ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:37.119248 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd66ba5-f69c-473e-9d91-c1ec042f4ca7 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:37.119539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd66ba5-f69c-473e-9d91-c1ec042f4ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:37.119828 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd66ba5-f69c-473e-9d91-c1ec042f4ca7 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:37.120599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd66ba5-f69c-473e-9d91-c1ec042f4ca7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:37.122098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd66ba5-f69c-473e-9d91-c1ec042f4ca7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:37.153040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 520/1033] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:11:36 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:37.153923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd66ba5-f69c-473e-9d91-c1ec042f4ca7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:37.168587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e79304-ada7-4348-a820-f4f31961570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:37.169269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e79304-ada7-4348-a820-f4f31961570b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:37.169931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e79304-ada7-4348-a820-f4f31961570b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:37.170247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e79304-ada7-4348-a820-f4f31961570b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:37.273074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e79304-ada7-4348-a820-f4f31961570b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:37.274571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e79304-ada7-4348-a820-f4f31961570b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:37.299900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd66ba5-f69c-473e-9d91-c1ec042f4ca7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:37.356690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe39ba3-fff0-45af-98d2-b895cbb99012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:37.358317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe39ba3-fff0-45af-98d2-b895cbb99012 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:37.358317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe39ba3-fff0-45af-98d2-b895cbb99012 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:37.358317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe39ba3-fff0-45af-98d2-b895cbb99012 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:37.358699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe39ba3-fff0-45af-98d2-b895cbb99012 None admin] RBAC: Adding query filter params (interface=public, service_id=13bd678bacd54b049e71b9799bb26928, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:37.358834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:37.359020 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe39ba3-fff0-45af-98d2-b895cbb99012 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:37.361155 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe39ba3-fff0-45af-98d2-b895cbb99012 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:37.371598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 521/1034] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 12:11:37 2022] GET /identity/v3/endpoints?service_id=13bd678bacd54b049e71b9799bb26928&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:37.379397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe39ba3-fff0-45af-98d2-b895cbb99012 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:37.430532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 514/1035] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:36 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:11:37.440003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:37.440735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e79304-ada7-4348-a820-f4f31961570b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:37.543549 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe39ba3-fff0-45af-98d2-b895cbb99012 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:37.586627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692f5b3-bc20-40c2-bd05-14c44c0a26dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:37.587315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692f5b3-bc20-40c2-bd05-14c44c0a26dd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:37.587607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692f5b3-bc20-40c2-bd05-14c44c0a26dd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:37.587892 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692f5b3-bc20-40c2-bd05-14c44c0a26dd None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:37.588632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692f5b3-bc20-40c2-bd05-14c44c0a26dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:37.590049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692f5b3-bc20-40c2-bd05-14c44c0a26dd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:37.591994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e79304-ada7-4348-a820-f4f31961570b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:37.597429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 522/1036] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 12:11:37 2022] GET /identity/v3/services => generated 1957 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:11:37.649733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b7a02-ed23-42c1-8ef2-3ec3c39d0617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:37.650579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b7a02-ed23-42c1-8ef2-3ec3c39d0617 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:37.650866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b7a02-ed23-42c1-8ef2-3ec3c39d0617 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:37.651145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b7a02-ed23-42c1-8ef2-3ec3c39d0617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:37.664318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b7a02-ed23-42c1-8ef2-3ec3c39d0617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:37.665813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b7a02-ed23-42c1-8ef2-3ec3c39d0617 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-929b7a02-ed23-42c1-8ef2-3ec3c39d0617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:37.686833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:37.687964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:37.689562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:37.689562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:37.689562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:37.689562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:37.689562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 515/1037] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:37.697217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692f5b3-bc20-40c2-bd05-14c44c0a26dd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:37.819853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:37.832932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692f5b3-bc20-40c2-bd05-14c44c0a26dd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:37.871187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f189e-0432-44e7-920f-5f79f90566af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:37.871877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f189e-0432-44e7-920f-5f79f90566af None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:37.872203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f189e-0432-44e7-920f-5f79f90566af None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:37.872485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f189e-0432-44e7-920f-5f79f90566af None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:37.873226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f189e-0432-44e7-920f-5f79f90566af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:37.873535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f189e-0432-44e7-920f-5f79f90566af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:37.874928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f189e-0432-44e7-920f-5f79f90566af None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:37.892628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 523/1038] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:37.894007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b7a02-ed23-42c1-8ef2-3ec3c39d0617 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:37.906876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:38.007801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b7a02-ed23-42c1-8ef2-3ec3c39d0617 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:38.044727 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a61551-ca1d-41e9-b828-2fac5b39206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:38.045407 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a61551-ca1d-41e9-b828-2fac5b39206c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:38.045690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a61551-ca1d-41e9-b828-2fac5b39206c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:38.045977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a61551-ca1d-41e9-b828-2fac5b39206c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:38.053307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a61551-ca1d-41e9-b828-2fac5b39206c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:38.054744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a61551-ca1d-41e9-b828-2fac5b39206c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-30a61551-ca1d-41e9-b828-2fac5b39206c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:38.068946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:38.069887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:38.070825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:38.070825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:38.070825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:38.070825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:38.070825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:38.070825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:38.070825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:38.070825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:38.070825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 516/1039] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:38.077510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f189e-0432-44e7-920f-5f79f90566af None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:38.184898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f189e-0432-44e7-920f-5f79f90566af None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:38.218088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4a8cb-543f-41b7-aba5-2c1d727d01f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:38.218746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4a8cb-543f-41b7-aba5-2c1d727d01f6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:38.219055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4a8cb-543f-41b7-aba5-2c1d727d01f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:38.219307 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4a8cb-543f-41b7-aba5-2c1d727d01f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:38.220134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4a8cb-543f-41b7-aba5-2c1d727d01f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:38.220431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4a8cb-543f-41b7-aba5-2c1d727d01f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:38.221873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4a8cb-543f-41b7-aba5-2c1d727d01f6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:38.234793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 524/1040] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:38.241131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a61551-ca1d-41e9-b828-2fac5b39206c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:38.315366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:38.355382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a61551-ca1d-41e9-b828-2fac5b39206c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:38.401668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe149a5-b826-478d-b86a-6a9adecbcc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:38.402330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe149a5-b826-478d-b86a-6a9adecbcc1c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:38.402615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe149a5-b826-478d-b86a-6a9adecbcc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:38.402890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe149a5-b826-478d-b86a-6a9adecbcc1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:38.403734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe149a5-b826-478d-b86a-6a9adecbcc1c None admin] RBAC: Adding query filter params (role.id=4c83d9b4ae1941e7a700b5a4408b6264, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=1df703568a334eea9550ac643d87b5fe) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:38.404086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe149a5-b826-478d-b86a-6a9adecbcc1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:38.405555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe149a5-b826-478d-b86a-6a9adecbcc1c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:38.419715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 517/1041] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:38 2022] GET /identity/v3/role_assignments?user.id=1df703568a334eea9550ac643d87b5fe&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=4c83d9b4ae1941e7a700b5a4408b6264 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:39.304214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf867-f9c3-4c6d-b3fb-9393299015f8 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:39.304760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf867-f9c3-4c6d-b3fb-9393299015f8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:39.304760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf867-f9c3-4c6d-b3fb-9393299015f8 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:39.306275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 525/1042] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:39.311288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd0199-5429-41f8-8b3c-f0d7055d2e1b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:39.311701 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd0199-5429-41f8-8b3c-f0d7055d2e1b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:39.311862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd0199-5429-41f8-8b3c-f0d7055d2e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:39.329753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b7cd0199-5429-41f8-8b3c-f0d7055d2e1b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:39.330946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b7cd0199-5429-41f8-8b3c-f0d7055d2e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:39.402782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 518/1043] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:39.429220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaf867-f9c3-4c6d-b3fb-9393299015f8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:39.445964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:39.562825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaf867-f9c3-4c6d-b3fb-9393299015f8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:39.619204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d798706-7645-4257-9736-c7ae1777b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:39.620330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d798706-7645-4257-9736-c7ae1777b03f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:39.620703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d798706-7645-4257-9736-c7ae1777b03f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:39.621115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d798706-7645-4257-9736-c7ae1777b03f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:39.622842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d798706-7645-4257-9736-c7ae1777b03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:39.625135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d798706-7645-4257-9736-c7ae1777b03f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:39.632544 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 526/1044] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:39.633817 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd0199-5429-41f8-8b3c-f0d7055d2e1b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:39.698522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:39.726620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d755-ea8b-4db4-8dfa-3362a26e178b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:39.726913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d755-ea8b-4db4-8dfa-3362a26e178b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:39.727201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d755-ea8b-4db4-8dfa-3362a26e178b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:39.728748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 527/1045] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:11:39.733497 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a5b7-f4f8-4264-a9ef-09c2568b0283 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:39.733782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a5b7-f4f8-4264-a9ef-09c2568b0283 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:39.734068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a5b7-f4f8-4264-a9ef-09c2568b0283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:39.737505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd0199-5429-41f8-8b3c-f0d7055d2e1b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:39.750896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-59d5a5b7-f4f8-4264-a9ef-09c2568b0283 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:39.752111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-59d5a5b7-f4f8-4264-a9ef-09c2568b0283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:39.775494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa0e93-f746-4811-89f4-b2c46a2c1fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:39.776197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa0e93-f746-4811-89f4-b2c46a2c1fb9 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:39.776632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa0e93-f746-4811-89f4-b2c46a2c1fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:39.776918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa0e93-f746-4811-89f4-b2c46a2c1fb9 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:39.777635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa0e93-f746-4811-89f4-b2c46a2c1fb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:39.779056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa0e93-f746-4811-89f4-b2c46a2c1fb9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:39.799716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 519/1046] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:11:39 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:39.848079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 528/1047] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:39.871228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa0e93-f746-4811-89f4-b2c46a2c1fb9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:39.987846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa0e93-f746-4811-89f4-b2c46a2c1fb9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:40.008161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:40.029579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0be69c-1c24-4769-9b21-ee22b46d7fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:40.030722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0be69c-1c24-4769-9b21-ee22b46d7fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:40.031221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0be69c-1c24-4769-9b21-ee22b46d7fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:40.031753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0be69c-1c24-4769-9b21-ee22b46d7fc4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:40.032459 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0be69c-1c24-4769-9b21-ee22b46d7fc4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:40.033827 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0be69c-1c24-4769-9b21-ee22b46d7fc4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-9c0be69c-1c24-4769-9b21-ee22b46d7fc4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:40.047464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:40.048546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 12:11:40.049374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:40.050121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 520/1048] 10.222.0.66 () {56 vars in 1105 bytes} [Wed Jun 22 12:11:39 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:40.055003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5a5b7-f4f8-4264-a9ef-09c2568b0283 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:40.070173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:40.159589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5a5b7-f4f8-4264-a9ef-09c2568b0283 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:40.196321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb9385-ddb9-4176-86fb-eae3a814cb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:40.196992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb9385-ddb9-4176-86fb-eae3a814cb5a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:40.197275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb9385-ddb9-4176-86fb-eae3a814cb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:40.197551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb9385-ddb9-4176-86fb-eae3a814cb5a None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:40.198256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb9385-ddb9-4176-86fb-eae3a814cb5a None admin] RBAC: Adding query filter params (name=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:40.198563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb9385-ddb9-4176-86fb-eae3a814cb5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:40.199927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb9385-ddb9-4176-86fb-eae3a814cb5a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:40.210277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 529/1049] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:40.211803 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0be69c-1c24-4769-9b21-ee22b46d7fc4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:40.314006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0be69c-1c24-4769-9b21-ee22b46d7fc4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:40.351356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62457109-90a2-4b36-bd99-5c67644e5f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:40.351977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62457109-90a2-4b36-bd99-5c67644e5f1b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:40.352288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62457109-90a2-4b36-bd99-5c67644e5f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:40.352562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62457109-90a2-4b36-bd99-5c67644e5f1b None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:40.353268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62457109-90a2-4b36-bd99-5c67644e5f1b None admin] RBAC: Adding query filter params (type=image) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:40.353571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62457109-90a2-4b36-bd99-5c67644e5f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:40.354930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62457109-90a2-4b36-bd99-5c67644e5f1b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:40.364318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 521/1050] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:40.366193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb9385-ddb9-4176-86fb-eae3a814cb5a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:40.449232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:40.463188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ddda-85c0-4910-8e94-47fbbebb7b42 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:40.463478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ddda-85c0-4910-8e94-47fbbebb7b42 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:40.463759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ddda-85c0-4910-8e94-47fbbebb7b42 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:40.465186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 522/1051] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:11:40.470038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35f20-6301-4e8f-a5c7-ae00102350ec None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:40.470335 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35f20-6301-4e8f-a5c7-ae00102350ec None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:40.470618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35f20-6301-4e8f-a5c7-ae00102350ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:40.484408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb9385-ddb9-4176-86fb-eae3a814cb5a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:40.487618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-38f35f20-6301-4e8f-a5c7-ae00102350ec None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:40.489382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-38f35f20-6301-4e8f-a5c7-ae00102350ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:40.523566 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d54c-d172-47c7-9149-5349da31f23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:40.524277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d54c-d172-47c7-9149-5349da31f23a None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:40.524519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d54c-d172-47c7-9149-5349da31f23a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:40.524798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d54c-d172-47c7-9149-5349da31f23a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:40.525721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91d54c-d172-47c7-9149-5349da31f23a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:40.527923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91d54c-d172-47c7-9149-5349da31f23a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:40.533621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:40.550369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 530/1052] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 12:11:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:40.568769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 523/1053] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:40.591942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d54c-d172-47c7-9149-5349da31f23a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:40.729057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d54c-d172-47c7-9149-5349da31f23a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:40.768659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:40.779163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d617d6-73e8-49ab-9433-742c9bfbbf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:40.780609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d617d6-73e8-49ab-9433-742c9bfbbf0d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:40.781464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d617d6-73e8-49ab-9433-742c9bfbbf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:40.781874 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d617d6-73e8-49ab-9433-742c9bfbbf0d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:40.798122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d617d6-73e8-49ab-9433-742c9bfbbf0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-a9d617d6-73e8-49ab-9433-742c9bfbbf0d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:40.807168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:40.808168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:40.809039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 531/1054] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 12:11:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:40.815001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f35f20-6301-4e8f-a5c7-ae00102350ec None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:40.927938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f35f20-6301-4e8f-a5c7-ae00102350ec None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:40.968047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd663bf-530f-436c-afbe-a78bfc1043f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:40.969025 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd663bf-530f-436c-afbe-a78bfc1043f9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:40.969344 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd663bf-530f-436c-afbe-a78bfc1043f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:40.970068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd663bf-530f-436c-afbe-a78bfc1043f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:40.970969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd663bf-530f-436c-afbe-a78bfc1043f9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:40.971373 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd663bf-530f-436c-afbe-a78bfc1043f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:40.973799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd663bf-530f-436c-afbe-a78bfc1043f9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:40.985801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 524/1055] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 12:11:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:40.993866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d617d6-73e8-49ab-9433-742c9bfbbf0d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:41.110838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d617d6-73e8-49ab-9433-742c9bfbbf0d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:41.148436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ef1c1-1fdd-4e73-8a91-4540d803ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:41.149283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ef1c1-1fdd-4e73-8a91-4540d803ab93 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:41.149571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ef1c1-1fdd-4e73-8a91-4540d803ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:41.149846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ef1c1-1fdd-4e73-8a91-4540d803ab93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:41.167382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ef1c1-1fdd-4e73-8a91-4540d803ab93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:41.168927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ef1c1-1fdd-4e73-8a91-4540d803ab93 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0f9ef1c1-1fdd-4e73-8a91-4540d803ab93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:41.186733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:41.187708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:41.188990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:41.188990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:41.188990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:41.188990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:41.189555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 532/1056] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:41.194371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd663bf-530f-436c-afbe-a78bfc1043f9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:41.232657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:41.303340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd663bf-530f-436c-afbe-a78bfc1043f9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:41.343053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2cb0a-fbd8-4429-a3a8-b4ddab64ae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:41.343715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2cb0a-fbd8-4429-a3a8-b4ddab64ae09 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:41.343987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2cb0a-fbd8-4429-a3a8-b4ddab64ae09 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:41.344289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2cb0a-fbd8-4429-a3a8-b4ddab64ae09 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:41.345024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2cb0a-fbd8-4429-a3a8-b4ddab64ae09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:41.345332 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2cb0a-fbd8-4429-a3a8-b4ddab64ae09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:41.346705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2cb0a-fbd8-4429-a3a8-b4ddab64ae09 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:41.365340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 525/1057] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:41.367105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ef1c1-1fdd-4e73-8a91-4540d803ab93 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:41.419664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:41.480138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ef1c1-1fdd-4e73-8a91-4540d803ab93 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:41.514192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99190738-6274-4226-a15b-5609f93290a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:41.515320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99190738-6274-4226-a15b-5609f93290a2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:41.515612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99190738-6274-4226-a15b-5609f93290a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:41.515885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99190738-6274-4226-a15b-5609f93290a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:41.523788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99190738-6274-4226-a15b-5609f93290a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:41.525263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99190738-6274-4226-a15b-5609f93290a2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-99190738-6274-4226-a15b-5609f93290a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:41.540685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:41.541663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:41.542616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:41.542616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:41.542616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:41.542616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:41.542616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:41.542616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:41.542616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:41.542616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:41.542616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:11:41.542616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:41.542616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 533/1058] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 12:11:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:41.547702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2cb0a-fbd8-4429-a3a8-b4ddab64ae09 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:41.645482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:41.653777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2cb0a-fbd8-4429-a3a8-b4ddab64ae09 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:41.691632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fca74-2667-4608-9e67-8299282ab150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:41.692333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fca74-2667-4608-9e67-8299282ab150 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:41.692618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fca74-2667-4608-9e67-8299282ab150 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:41.692894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fca74-2667-4608-9e67-8299282ab150 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:41.693735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fca74-2667-4608-9e67-8299282ab150 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:41.694044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fca74-2667-4608-9e67-8299282ab150 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:41.695462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fca74-2667-4608-9e67-8299282ab150 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:41.720226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 526/1059] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 12:11:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:41.721390 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99190738-6274-4226-a15b-5609f93290a2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:41.839444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99190738-6274-4226-a15b-5609f93290a2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:41.842790 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:41.878532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ae75f-b8bf-4a6e-8683-153b417f3852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:41.879325 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae75f-b8bf-4a6e-8683-153b417f3852 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:41.879609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae75f-b8bf-4a6e-8683-153b417f3852 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:41.879884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ae75f-b8bf-4a6e-8683-153b417f3852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:41.891103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ae75f-b8bf-4a6e-8683-153b417f3852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:41.892503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ae75f-b8bf-4a6e-8683-153b417f3852 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2f7ae75f-b8bf-4a6e-8683-153b417f3852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:41.911728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:41.913208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:41.915846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:41.915846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:41.915846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:41.915846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:41.915846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 534/1060] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:41.919345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fca74-2667-4608-9e67-8299282ab150 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:41.959077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e18442-459c-46f0-84bd-780497b785f5 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:41.959342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e18442-459c-46f0-84bd-780497b785f5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:41.959736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e18442-459c-46f0-84bd-780497b785f5 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:41.961317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 535/1061] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:41.966342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb859759-67d7-4cd5-abaf-42d95d6521ae None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:41.967024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb859759-67d7-4cd5-abaf-42d95d6521ae None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:41.967024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb859759-67d7-4cd5-abaf-42d95d6521ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:41.986160 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cb859759-67d7-4cd5-abaf-42d95d6521ae None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:41.987395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cb859759-67d7-4cd5-abaf-42d95d6521ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:42.059945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fca74-2667-4608-9e67-8299282ab150 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:42.076208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 536/1062] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:42.097641 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb859759-67d7-4cd5-abaf-42d95d6521ae None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:42.099027 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a55843-4783-4a10-844d-d7330ea1beaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:42.099898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a55843-4783-4a10-844d-d7330ea1beaf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:42.100355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a55843-4783-4a10-844d-d7330ea1beaf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:42.100787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a55843-4783-4a10-844d-d7330ea1beaf None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:42.101665 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a55843-4783-4a10-844d-d7330ea1beaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:42.102156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a55843-4783-4a10-844d-d7330ea1beaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:42.103684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a55843-4783-4a10-844d-d7330ea1beaf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:42.116178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 527/1063] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:42.121449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a55843-4783-4a10-844d-d7330ea1beaf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:42.136410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:42.197948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:42.216487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb859759-67d7-4cd5-abaf-42d95d6521ae None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:42.233085 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a55843-4783-4a10-844d-d7330ea1beaf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:42.252931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeef45c-2ad3-4144-911a-83ca4ee5d327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:42.253735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeef45c-2ad3-4144-911a-83ca4ee5d327 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:42.254024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeef45c-2ad3-4144-911a-83ca4ee5d327 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:42.254807 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeef45c-2ad3-4144-911a-83ca4ee5d327 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:42.266085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeef45c-2ad3-4144-911a-83ca4ee5d327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:42.269212 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e99bd-cb43-4457-accf-231c4acf1a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:42.270067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e99bd-cb43-4457-accf-231c4acf1a5e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:42.270443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e99bd-cb43-4457-accf-231c4acf1a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:42.270704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e99bd-cb43-4457-accf-231c4acf1a5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9eeef45c-2ad3-4144-911a-83ca4ee5d327 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:42.273848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:42.274784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:42.275643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 537/1064] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:11:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:42.281795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeef45c-2ad3-4144-911a-83ca4ee5d327 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:42.282996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e99bd-cb43-4457-accf-231c4acf1a5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:42.284572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e99bd-cb43-4457-accf-231c4acf1a5e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-5d0e99bd-cb43-4457-accf-231c4acf1a5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:42.299610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:42.300569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:42.301558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:42.301558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:42.301558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:42.301558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:42.301558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:42.301558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:42.301558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:42.301558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:42.301558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 528/1065] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:42.306540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e99bd-cb43-4457-accf-231c4acf1a5e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:42.386680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:42.391517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeef45c-2ad3-4144-911a-83ca4ee5d327 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:42.419266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e99bd-cb43-4457-accf-231c4acf1a5e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:42.429729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c14ca-a83a-4f68-bc90-f5a356f6ee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:42.430400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c14ca-a83a-4f68-bc90-f5a356f6ee14 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:42.430696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c14ca-a83a-4f68-bc90-f5a356f6ee14 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:42.430971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c14ca-a83a-4f68-bc90-f5a356f6ee14 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:42.431726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c14ca-a83a-4f68-bc90-f5a356f6ee14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:42.432052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c14ca-a83a-4f68-bc90-f5a356f6ee14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:42.433471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c14ca-a83a-4f68-bc90-f5a356f6ee14 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:42.442795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 538/1066] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:11:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:42.448823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c14ca-a83a-4f68-bc90-f5a356f6ee14 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:42.462453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:42.472646 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0241-7341-4fe8-970f-226eb103dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:42.473345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0241-7341-4fe8-970f-226eb103dbed None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:42.473868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0241-7341-4fe8-970f-226eb103dbed None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:42.474000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0241-7341-4fe8-970f-226eb103dbed None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:42.474755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec0241-7341-4fe8-970f-226eb103dbed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:42.475096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec0241-7341-4fe8-970f-226eb103dbed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:42.476666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec0241-7341-4fe8-970f-226eb103dbed None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:42.489390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 529/1067] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:42.495206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0241-7341-4fe8-970f-226eb103dbed None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:42.564049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c14ca-a83a-4f68-bc90-f5a356f6ee14 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:42.600134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396bdb9-8547-4282-b794-740940da33fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:42.601009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396bdb9-8547-4282-b794-740940da33fe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:42.601287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396bdb9-8547-4282-b794-740940da33fe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:42.601694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396bdb9-8547-4282-b794-740940da33fe None admin] PATH_INFO: `/v3/users/518964f196b44d098e6fa9ab98a72149` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:42.607160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0241-7341-4fe8-970f-226eb103dbed None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:42.616544 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396bdb9-8547-4282-b794-740940da33fe None admin] RBAC: Authorizing `identity:get_user(user_id=518964f196b44d098e6fa9ab98a72149)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:42.618006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396bdb9-8547-4282-b794-740940da33fe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:42.624383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 539/1068] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:11:42 2022] GET /identity/v3/users/518964f196b44d098e6fa9ab98a72149 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:42.625462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396bdb9-8547-4282-b794-740940da33fe None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:42.645606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:42.651926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b7582-3776-49d9-aebe-9143f478e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:42.653455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7582-3776-49d9-aebe-9143f478e347 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:42.653751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7582-3776-49d9-aebe-9143f478e347 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:42.654131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7582-3776-49d9-aebe-9143f478e347 None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/1df703568a334eea9550ac643d87b5fe/roles/4c83d9b4ae1941e7a700b5a4408b6264` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:42.656485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b7582-3776-49d9-aebe-9143f478e347 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=1df703568a334eea9550ac643d87b5fe, role_id=4c83d9b4ae1941e7a700b5a4408b6264)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:42.657935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b7582-3776-49d9-aebe-9143f478e347 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:42.671565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 530/1069] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:11:42 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/1df703568a334eea9550ac643d87b5fe/roles/4c83d9b4ae1941e7a700b5a4408b6264 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:11:42.672935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc14dc-a110-49d3-8441-7b5f01376374 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:42.673231 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc14dc-a110-49d3-8441-7b5f01376374 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:42.673508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc14dc-a110-49d3-8441-7b5f01376374 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:42.675010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 531/1070] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:42.681143 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd156f-0fbc-4655-8965-3f00aa51d80f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:42.681443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd156f-0fbc-4655-8965-3f00aa51d80f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:42.681723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd156f-0fbc-4655-8965-3f00aa51d80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:42.701077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-dcbd156f-0fbc-4655-8965-3f00aa51d80f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:42.702017 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:42.702447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dcbd156f-0fbc-4655-8965-3f00aa51d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:42.744478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396bdb9-8547-4282-b794-740940da33fe None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:42.782992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513d2f1-9191-44f3-a861-98a6455b7973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:42.791955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d2f1-9191-44f3-a861-98a6455b7973 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:42.792215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 532/1071] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:42.792318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d2f1-9191-44f3-a861-98a6455b7973 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:42.792318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d2f1-9191-44f3-a861-98a6455b7973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:42.813173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd156f-0fbc-4655-8965-3f00aa51d80f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:42.878779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513d2f1-9191-44f3-a861-98a6455b7973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:42.880794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513d2f1-9191-44f3-a861-98a6455b7973 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:42.944830 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd156f-0fbc-4655-8965-3f00aa51d80f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:42.955074 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:42.977720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:42.997409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7944a-860e-4ff8-adc1-be3ed4bc99b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:42.998434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7944a-860e-4ff8-adc1-be3ed4bc99b9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:42.998902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7944a-860e-4ff8-adc1-be3ed4bc99b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:42.999424 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7944a-860e-4ff8-adc1-be3ed4bc99b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:43.026071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 540/1072] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 12:11:43.027348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513d2f1-9191-44f3-a861-98a6455b7973 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:43.085130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7944a-860e-4ff8-adc1-be3ed4bc99b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:43.086780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7944a-860e-4ff8-adc1-be3ed4bc99b9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:43.155237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513d2f1-9191-44f3-a861-98a6455b7973 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:43.211312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2e9c0-d207-4fa1-a104-a87ce2795450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:43.212131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2e9c0-d207-4fa1-a104-a87ce2795450 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:43.212422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2e9c0-d207-4fa1-a104-a87ce2795450 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:43.212710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2e9c0-d207-4fa1-a104-a87ce2795450 None admin] PATH_INFO: `/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:43.213960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2e9c0-d207-4fa1-a104-a87ce2795450 None admin] RBAC: Authorizing `identity:get_project(project_id=758fdbf8fa7943efb1cbead7d55f6db9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:43.215424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2e9c0-d207-4fa1-a104-a87ce2795450 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:43.217237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 541/1073] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:11:43 2022] GET /identity/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9 => generated 311 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:43.223622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2e9c0-d207-4fa1-a104-a87ce2795450 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:43.226171 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 533/1074] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:11:43.233463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7944a-860e-4ff8-adc1-be3ed4bc99b9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:43.266293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:43.267932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:43.354416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2e9c0-d207-4fa1-a104-a87ce2795450 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:43.356943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7944a-860e-4ff8-adc1-be3ed4bc99b9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:43.391115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02066b5-4623-4ccd-9df9-210bd0ba3b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:43.392161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02066b5-4623-4ccd-9df9-210bd0ba3b69 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:43.393080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02066b5-4623-4ccd-9df9-210bd0ba3b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:43.393523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02066b5-4623-4ccd-9df9-210bd0ba3b69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:43.394430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef67352-6fc9-4dbe-96ea-29090c0b30f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:43.395569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02066b5-4623-4ccd-9df9-210bd0ba3b69 None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=758fdbf8fa7943efb1cbead7d55f6db9, user.id=518964f196b44d098e6fa9ab98a72149) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:43.395766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef67352-6fc9-4dbe-96ea-29090c0b30f0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:43.396072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef67352-6fc9-4dbe-96ea-29090c0b30f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:43.396356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef67352-6fc9-4dbe-96ea-29090c0b30f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:43.396643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02066b5-4623-4ccd-9df9-210bd0ba3b69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:43.398274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02066b5-4623-4ccd-9df9-210bd0ba3b69 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:43.407153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef67352-6fc9-4dbe-96ea-29090c0b30f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:43.408674 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef67352-6fc9-4dbe-96ea-29090c0b30f0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:43.416413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 542/1075] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:43 2022] GET /identity/v3/role_assignments?user.id=518964f196b44d098e6fa9ab98a72149&scope.project.id=758fdbf8fa7943efb1cbead7d55f6db9&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-1ef67352-6fc9-4dbe-96ea-29090c0b30f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:43.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:43.429932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:43.431051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:43.431051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:43.431051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:43.431051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:43.435078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 534/1076] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:43.436774 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02066b5-4623-4ccd-9df9-210bd0ba3b69 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:43.544773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:43.548781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02066b5-4623-4ccd-9df9-210bd0ba3b69 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:43.586011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3ef94-338c-40cb-8ba3-24188581d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:43.586681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ef94-338c-40cb-8ba3-24188581d250 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:43.586967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ef94-338c-40cb-8ba3-24188581d250 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:43.587247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3ef94-338c-40cb-8ba3-24188581d250 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:43.587974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3ef94-338c-40cb-8ba3-24188581d250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:43.588313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3ef94-338c-40cb-8ba3-24188581d250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:43.589697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3ef94-338c-40cb-8ba3-24188581d250 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:43.602500 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 543/1077] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:44.754715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651d465-46c1-4d41-bb76-37c52cefda9d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:44.755243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651d465-46c1-4d41-bb76-37c52cefda9d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:44.755243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651d465-46c1-4d41-bb76-37c52cefda9d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:44.756645 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 535/1078] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:44.761675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd176e6-e379-4597-8b7d-45cf2d8a13e5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:44.762075 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd176e6-e379-4597-8b7d-45cf2d8a13e5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:44.762229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd176e6-e379-4597-8b7d-45cf2d8a13e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:44.779178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3fd176e6-e379-4597-8b7d-45cf2d8a13e5 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:44.780463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3fd176e6-e379-4597-8b7d-45cf2d8a13e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:44.849262 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 544/1079] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:44.872682 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651d465-46c1-4d41-bb76-37c52cefda9d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:44.948075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:44.974380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651d465-46c1-4d41-bb76-37c52cefda9d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:45.009369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7b09-07e0-483d-af4f-a1e18bfc221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:45.010110 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7b09-07e0-483d-af4f-a1e18bfc221a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:45.010394 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7b09-07e0-483d-af4f-a1e18bfc221a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:45.010673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7b09-07e0-483d-af4f-a1e18bfc221a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:45.021246 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7b09-07e0-483d-af4f-a1e18bfc221a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-af0d7b09-07e0-483d-af4f-a1e18bfc221a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:45.029439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:45.030541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:45.031399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 536/1080] 10.222.0.66 () {56 vars in 1120 bytes} [Wed Jun 22 12:11:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:45.036726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd176e6-e379-4597-8b7d-45cf2d8a13e5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:45.122836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:45.135916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd176e6-e379-4597-8b7d-45cf2d8a13e5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:45.170562 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019704ee-587b-4da4-a039-7ad1c9494da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:45.171225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019704ee-587b-4da4-a039-7ad1c9494da9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:45.171509 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019704ee-587b-4da4-a039-7ad1c9494da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:45.171785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019704ee-587b-4da4-a039-7ad1c9494da9 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:45.172565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019704ee-587b-4da4-a039-7ad1c9494da9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:45.172872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019704ee-587b-4da4-a039-7ad1c9494da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:45.174235 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019704ee-587b-4da4-a039-7ad1c9494da9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:45.182046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 545/1081] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 12:11:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:45.187721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7b09-07e0-483d-af4f-a1e18bfc221a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:45.285028 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7b09-07e0-483d-af4f-a1e18bfc221a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:45.317855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efa156-7adc-4963-a152-320ce709aeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:45.318639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa156-7adc-4963-a152-320ce709aeaa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:45.318924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa156-7adc-4963-a152-320ce709aeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:45.319202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa156-7adc-4963-a152-320ce709aeaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:45.321124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:45.330493 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efa156-7adc-4963-a152-320ce709aeaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:45.331938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efa156-7adc-4963-a152-320ce709aeaa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-01efa156-7adc-4963-a152-320ce709aeaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:45.349213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:45.350323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:45.351655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:45.351655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:45.351655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:45.351655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:45.351655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 537/1082] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:45.356129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019704ee-587b-4da4-a039-7ad1c9494da9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:45.451605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d7a3d-def1-4ac9-b446-d160d3a20608 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:45.451894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d7a3d-def1-4ac9-b446-d160d3a20608 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:45.452213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d7a3d-def1-4ac9-b446-d160d3a20608 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:45.453740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 538/1083] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:45.459258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc250d9-1a3b-4177-ba0e-6286d61ed037 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:45.459547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc250d9-1a3b-4177-ba0e-6286d61ed037 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:45.459829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc250d9-1a3b-4177-ba0e-6286d61ed037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:45.471582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019704ee-587b-4da4-a039-7ad1c9494da9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:45.477631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7cc250d9-1a3b-4177-ba0e-6286d61ed037 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:45.478838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7cc250d9-1a3b-4177-ba0e-6286d61ed037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:45.515559 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31f9c8-aee0-4b5e-b80a-c4d37003c064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:45.516255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31f9c8-aee0-4b5e-b80a-c4d37003c064 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:45.516545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31f9c8-aee0-4b5e-b80a-c4d37003c064 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:45.516827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31f9c8-aee0-4b5e-b80a-c4d37003c064 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:45.517557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31f9c8-aee0-4b5e-b80a-c4d37003c064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:45.517869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31f9c8-aee0-4b5e-b80a-c4d37003c064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:45.519258 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31f9c8-aee0-4b5e-b80a-c4d37003c064 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:45.532382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 546/1084] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:45.539771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31f9c8-aee0-4b5e-b80a-c4d37003c064 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:45.549587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 539/1085] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:11:45.554093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:45.574395 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc250d9-1a3b-4177-ba0e-6286d61ed037 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:45.649843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31f9c8-aee0-4b5e-b80a-c4d37003c064 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:45.679878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc250d9-1a3b-4177-ba0e-6286d61ed037 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:45.685238 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a64d5-ef23-461a-a589-6dfe3905b0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:45.686188 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a64d5-ef23-461a-a589-6dfe3905b0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:45.686337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a64d5-ef23-461a-a589-6dfe3905b0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:45.686572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a64d5-ef23-461a-a589-6dfe3905b0c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:45.695073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a64d5-ef23-461a-a589-6dfe3905b0c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:45.696959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a64d5-ef23-461a-a589-6dfe3905b0c2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:45.697953 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-4b4a64d5-ef23-461a-a589-6dfe3905b0c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:11:45.712130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:45.713332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:45.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:45.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:45.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:11:45.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:11:45.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:11:45.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:11:45.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:11:45.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:11:45.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 12:11:45.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:45.714401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 547/1086] 10.222.0.66 () {56 vars in 1093 bytes} [Wed Jun 22 12:11:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:45.719144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a64d5-ef23-461a-a589-6dfe3905b0c2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:45.720903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259aa39-e303-48b4-aa73-a7387f8f9d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:45.721723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259aa39-e303-48b4-aa73-a7387f8f9d9c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:45.722218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259aa39-e303-48b4-aa73-a7387f8f9d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:45.722631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259aa39-e303-48b4-aa73-a7387f8f9d9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:45.735710 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259aa39-e303-48b4-aa73-a7387f8f9d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f259aa39-e303-48b4-aa73-a7387f8f9d9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:45.744161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:45.745128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:45.745982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 540/1087] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:11:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:45.751722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259aa39-e303-48b4-aa73-a7387f8f9d9c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:45.793374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:45.828064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a64d5-ef23-461a-a589-6dfe3905b0c2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:45.860100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259aa39-e303-48b4-aa73-a7387f8f9d9c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:45.863857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a62eca-36c2-48d9-9fe5-8067862cbf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:45.864778 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a62eca-36c2-48d9-9fe5-8067862cbf89 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:45.865069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a62eca-36c2-48d9-9fe5-8067862cbf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:45.865350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a62eca-36c2-48d9-9fe5-8067862cbf89 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:45.866201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a62eca-36c2-48d9-9fe5-8067862cbf89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:45.866513 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a62eca-36c2-48d9-9fe5-8067862cbf89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:45.867968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a62eca-36c2-48d9-9fe5-8067862cbf89 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:45.886517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 548/1088] 10.222.0.66 () {56 vars in 1133 bytes} [Wed Jun 22 12:11:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:45.892930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a62eca-36c2-48d9-9fe5-8067862cbf89 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:45.897076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64776e5-5c15-497c-945c-e65bd784e05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:45.897763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64776e5-5c15-497c-945c-e65bd784e05f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:45.898049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64776e5-5c15-497c-945c-e65bd784e05f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:45.898329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64776e5-5c15-497c-945c-e65bd784e05f None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:45.899090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64776e5-5c15-497c-945c-e65bd784e05f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:45.899400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64776e5-5c15-497c-945c-e65bd784e05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:45.900820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64776e5-5c15-497c-945c-e65bd784e05f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:45.911048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 541/1089] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:11:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:45.918021 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64776e5-5c15-497c-945c-e65bd784e05f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:45.957903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:46.027378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64776e5-5c15-497c-945c-e65bd784e05f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:46.042012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a62eca-36c2-48d9-9fe5-8067862cbf89 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:46.068924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:46.069673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db19a5-5cab-4e2a-b197-f0808f06797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:46.071251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db19a5-5cab-4e2a-b197-f0808f06797f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:46.071770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db19a5-5cab-4e2a-b197-f0808f06797f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:46.072344 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db19a5-5cab-4e2a-b197-f0808f06797f None admin] PATH_INFO: `/v3/users/518964f196b44d098e6fa9ab98a72149` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:46.074554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db19a5-5cab-4e2a-b197-f0808f06797f None admin] RBAC: Authorizing `identity:get_user(user_id=518964f196b44d098e6fa9ab98a72149)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:46.077556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab0a24-340b-44cb-b30e-01f5437b09c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:46.077836 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db19a5-5cab-4e2a-b197-f0808f06797f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:46.078197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab0a24-340b-44cb-b30e-01f5437b09c8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:46.078485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab0a24-340b-44cb-b30e-01f5437b09c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:46.078758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab0a24-340b-44cb-b30e-01f5437b09c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:46.085739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 542/1090] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:11:45 2022] GET /identity/v3/users/518964f196b44d098e6fa9ab98a72149 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:11:46.087455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db19a5-5cab-4e2a-b197-f0808f06797f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:46.151599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab0a24-340b-44cb-b30e-01f5437b09c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:46.153112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab0a24-340b-44cb-b30e-01f5437b09c8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:46.195977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db19a5-5cab-4e2a-b197-f0808f06797f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:46.203336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:46.232454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954dd7-6ad4-45e7-8c6b-a3dc5034559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:46.233309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954dd7-6ad4-45e7-8c6b-a3dc5034559d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:46.233600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954dd7-6ad4-45e7-8c6b-a3dc5034559d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:46.233882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954dd7-6ad4-45e7-8c6b-a3dc5034559d None admin] PATH_INFO: `/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:46.235114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20954dd7-6ad4-45e7-8c6b-a3dc5034559d None admin] RBAC: Authorizing `identity:get_project(project_id=758fdbf8fa7943efb1cbead7d55f6db9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:46.236804 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20954dd7-6ad4-45e7-8c6b-a3dc5034559d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:46.238387 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 543/1091] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:11:46 2022] GET /identity/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:46.244413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954dd7-6ad4-45e7-8c6b-a3dc5034559d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:46.261746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 549/1092] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:11:46.271246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab0a24-340b-44cb-b30e-01f5437b09c8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:46.300279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:46.349390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954dd7-6ad4-45e7-8c6b-a3dc5034559d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:46.376701 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab0a24-340b-44cb-b30e-01f5437b09c8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:46.385203 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582709e8-3ad1-426e-aa69-69f43089837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:46.386088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582709e8-3ad1-426e-aa69-69f43089837d None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:46.386372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582709e8-3ad1-426e-aa69-69f43089837d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:46.386654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582709e8-3ad1-426e-aa69-69f43089837d None admin] PATH_INFO: `/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9/users/518964f196b44d098e6fa9ab98a72149/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:46.388670 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582709e8-3ad1-426e-aa69-69f43089837d None admin] RBAC: Authorizing `identity:create_grant(project_id=758fdbf8fa7943efb1cbead7d55f6db9, user_id=518964f196b44d098e6fa9ab98a72149, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:46.390389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582709e8-3ad1-426e-aa69-69f43089837d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:46.404108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 544/1093] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:11:46 2022] PUT /identity/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9/users/518964f196b44d098e6fa9ab98a72149/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:11:46.413481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87861267-f58f-4bd4-a7ba-e334e479ef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:46.414308 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861267-f58f-4bd4-a7ba-e334e479ef7e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:46.414589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861267-f58f-4bd4-a7ba-e334e479ef7e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:46.414866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861267-f58f-4bd4-a7ba-e334e479ef7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:46.427266 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87861267-f58f-4bd4-a7ba-e334e479ef7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:46.428802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87861267-f58f-4bd4-a7ba-e334e479ef7e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-87861267-f58f-4bd4-a7ba-e334e479ef7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:11:46.448672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:46.449931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:46.450938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:11:46.450938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:11:46.450938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:11:46.450938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:46.450938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 550/1094] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:11:46.456191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582709e8-3ad1-426e-aa69-69f43089837d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:46.496865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:46.578197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582709e8-3ad1-426e-aa69-69f43089837d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:46.616567 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e44d74-4aa3-4b93-92cb-c8a4dcd3155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:46.617156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e44d74-4aa3-4b93-92cb-c8a4dcd3155f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:46.617444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e44d74-4aa3-4b93-92cb-c8a4dcd3155f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:46.617726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e44d74-4aa3-4b93-92cb-c8a4dcd3155f None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:46.618462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e44d74-4aa3-4b93-92cb-c8a4dcd3155f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:46.618775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e44d74-4aa3-4b93-92cb-c8a4dcd3155f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:46.620179 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e44d74-4aa3-4b93-92cb-c8a4dcd3155f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:46.633067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 545/1095] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:46.638866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87861267-f58f-4bd4-a7ba-e334e479ef7e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:46.727558 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:46.748698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87861267-f58f-4bd4-a7ba-e334e479ef7e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:46.787149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d4254-bfad-4121-816c-cb23d51d8845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:46.787945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d4254-bfad-4121-816c-cb23d51d8845 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:46.788263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d4254-bfad-4121-816c-cb23d51d8845 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:46.788545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d4254-bfad-4121-816c-cb23d51d8845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:46.795583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d4254-bfad-4121-816c-cb23d51d8845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:46.797078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d4254-bfad-4121-816c-cb23d51d8845 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-109d4254-bfad-4121-816c-cb23d51d8845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:11:46.811520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:46.812796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:46.814037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:11:46.814037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:11:46.814037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:11:46.814037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:11:46.814037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:11:46.814037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:11:46.814037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:11:46.814037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:11:46.814037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 551/1096] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:11:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:46.819220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e44d74-4aa3-4b93-92cb-c8a4dcd3155f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:46.919187 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:46.926764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e44d74-4aa3-4b93-92cb-c8a4dcd3155f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:46.961093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa2eb6-88cc-45de-b14b-6ba596a19740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:46.961757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2eb6-88cc-45de-b14b-6ba596a19740 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:46.962036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2eb6-88cc-45de-b14b-6ba596a19740 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:46.962310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2eb6-88cc-45de-b14b-6ba596a19740 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:46.963111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa2eb6-88cc-45de-b14b-6ba596a19740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:46.963416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa2eb6-88cc-45de-b14b-6ba596a19740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:46.964895 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa2eb6-88cc-45de-b14b-6ba596a19740 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:46.977837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 546/1097] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:11:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:46.984519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d4254-bfad-4121-816c-cb23d51d8845 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:47.096717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d4254-bfad-4121-816c-cb23d51d8845 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:47.133069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2308a-0976-4adc-8f55-2786007485e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:47.133728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2308a-0976-4adc-8f55-2786007485e7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:47.134013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2308a-0976-4adc-8f55-2786007485e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:47.134291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2308a-0976-4adc-8f55-2786007485e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:47.135130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2308a-0976-4adc-8f55-2786007485e7 None admin] RBAC: Adding query filter params (role.id=4c83d9b4ae1941e7a700b5a4408b6264, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=1df703568a334eea9550ac643d87b5fe) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:47.135447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2308a-0976-4adc-8f55-2786007485e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:47.136944 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2308a-0976-4adc-8f55-2786007485e7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:47.143751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 552/1098] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:46 2022] GET /identity/v3/role_assignments?user.id=1df703568a334eea9550ac643d87b5fe&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=4c83d9b4ae1941e7a700b5a4408b6264 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:48.483163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ad449-2153-47ec-b971-500113e379a6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:48.483719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ad449-2153-47ec-b971-500113e379a6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:48.483719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ad449-2153-47ec-b971-500113e379a6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:48.485155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 547/1099] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:48.491249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6165-0eca-4b86-8289-fada80cfb265 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:48.491729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6165-0eca-4b86-8289-fada80cfb265 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:48.491818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6165-0eca-4b86-8289-fada80cfb265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:48.497877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:48.510844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ac0e6165-0eca-4b86-8289-fada80cfb265 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:48.512089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ac0e6165-0eca-4b86-8289-fada80cfb265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:48.582829 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 553/1100] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:48.606793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ad449-2153-47ec-b971-500113e379a6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:48.710736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ad449-2153-47ec-b971-500113e379a6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:48.743591 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de7ac5-1621-43c4-8c62-55d5a37d56e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:48.744328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7ac5-1621-43c4-8c62-55d5a37d56e0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:48.744616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7ac5-1621-43c4-8c62-55d5a37d56e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:48.744894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7ac5-1621-43c4-8c62-55d5a37d56e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:48.755330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de7ac5-1621-43c4-8c62-55d5a37d56e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f9de7ac5-1621-43c4-8c62-55d5a37d56e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:11:48.762841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:11:48.764060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:11:48.765539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 548/1101] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:11:48.770796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6165-0eca-4b86-8289-fada80cfb265 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:48.869676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6165-0eca-4b86-8289-fada80cfb265 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:48.902896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca1215-05d1-4b18-be7d-9d98a9ce54a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:48.903558 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1215-05d1-4b18-be7d-9d98a9ce54a8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:48.904141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1215-05d1-4b18-be7d-9d98a9ce54a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:48.904423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1215-05d1-4b18-be7d-9d98a9ce54a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:48.905164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca1215-05d1-4b18-be7d-9d98a9ce54a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:48.905473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca1215-05d1-4b18-be7d-9d98a9ce54a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:48.906841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca1215-05d1-4b18-be7d-9d98a9ce54a8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:48.908203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:48.916333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 554/1102] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:11:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:48.922251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de7ac5-1621-43c4-8c62-55d5a37d56e0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:48.938004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:49.025597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de7ac5-1621-43c4-8c62-55d5a37d56e0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:49.058218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ccb09-ea54-46e2-a533-41e0be3443ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:49.059071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ccb09-ea54-46e2-a533-41e0be3443ee None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:49.059352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ccb09-ea54-46e2-a533-41e0be3443ee None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:49.059627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ccb09-ea54-46e2-a533-41e0be3443ee None admin] PATH_INFO: `/v3/users/518964f196b44d098e6fa9ab98a72149` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:49.060833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ccb09-ea54-46e2-a533-41e0be3443ee None admin] RBAC: Authorizing `identity:get_user(user_id=518964f196b44d098e6fa9ab98a72149)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:49.062251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ccb09-ea54-46e2-a533-41e0be3443ee None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:49.063869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 549/1103] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:11:48 2022] GET /identity/v3/users/518964f196b44d098e6fa9ab98a72149 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:49.070395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca1215-05d1-4b18-be7d-9d98a9ce54a8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:49.168916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca1215-05d1-4b18-be7d-9d98a9ce54a8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:49.201529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d6455-df40-48de-b710-d2a645b5aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:49.202171 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d6455-df40-48de-b710-d2a645b5aceb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:49.202455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d6455-df40-48de-b710-d2a645b5aceb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:49.202738 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d6455-df40-48de-b710-d2a645b5aceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:49.261549 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:49.269004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d6455-df40-48de-b710-d2a645b5aceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:49.270997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d6455-df40-48de-b710-d2a645b5aceb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:49.366214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 555/1104] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 12:11:49.372160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ccb09-ea54-46e2-a533-41e0be3443ee None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:49.452339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:49.470077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ccb09-ea54-46e2-a533-41e0be3443ee None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:49.504804 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd72860-acf8-467b-a1b2-f9e0d45f78cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:49.505654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd72860-acf8-467b-a1b2-f9e0d45f78cb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:49.505933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd72860-acf8-467b-a1b2-f9e0d45f78cb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:49.506204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd72860-acf8-467b-a1b2-f9e0d45f78cb None admin] PATH_INFO: `/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:49.507374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd72860-acf8-467b-a1b2-f9e0d45f78cb None admin] RBAC: Authorizing `identity:get_project(project_id=758fdbf8fa7943efb1cbead7d55f6db9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:49.508809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd72860-acf8-467b-a1b2-f9e0d45f78cb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:49.510503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 550/1105] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:11:49 2022] GET /identity/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:49.516984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d6455-df40-48de-b710-d2a645b5aceb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:49.609013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:49.621817 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d6455-df40-48de-b710-d2a645b5aceb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:49.656619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca959f1e-c7d5-423a-95cc-d3e79e3a34ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:49.657265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959f1e-c7d5-423a-95cc-d3e79e3a34ff None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:49.657557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959f1e-c7d5-423a-95cc-d3e79e3a34ff None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:49.657833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959f1e-c7d5-423a-95cc-d3e79e3a34ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:49.658670 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca959f1e-c7d5-423a-95cc-d3e79e3a34ff None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=758fdbf8fa7943efb1cbead7d55f6db9, user.id=518964f196b44d098e6fa9ab98a72149) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:49.658985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca959f1e-c7d5-423a-95cc-d3e79e3a34ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:49.660956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca959f1e-c7d5-423a-95cc-d3e79e3a34ff None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:49.667642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 556/1106] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:49 2022] GET /identity/v3/role_assignments?user.id=518964f196b44d098e6fa9ab98a72149&scope.project.id=758fdbf8fa7943efb1cbead7d55f6db9&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:51.705913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7c45e-a881-490c-bcee-44f961009663 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:51.706483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7c45e-a881-490c-bcee-44f961009663 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:51.706483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7c45e-a881-490c-bcee-44f961009663 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:51.708411 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 551/1107] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:51.713987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ced0-c0dd-4e5b-96d7-bbabd8b079bd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:51.714537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ced0-c0dd-4e5b-96d7-bbabd8b079bd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:51.714537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ced0-c0dd-4e5b-96d7-bbabd8b079bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:51.732249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-73d4ced0-c0dd-4e5b-96d7-bbabd8b079bd None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:51.733466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-73d4ced0-c0dd-4e5b-96d7-bbabd8b079bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:51.804155 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 557/1108] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:51.829142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7c45e-a881-490c-bcee-44f961009663 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:51.928530 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7c45e-a881-490c-bcee-44f961009663 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:51.962373 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e93c47-32a3-4a63-9ebd-d085ff53e8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:51.963081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93c47-32a3-4a63-9ebd-d085ff53e8de None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:51.963366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93c47-32a3-4a63-9ebd-d085ff53e8de None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:51.963969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93c47-32a3-4a63-9ebd-d085ff53e8de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:51.965173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e93c47-32a3-4a63-9ebd-d085ff53e8de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:51.966602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e93c47-32a3-4a63-9ebd-d085ff53e8de None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:51.968255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 552/1109] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:51.974000 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ced0-c0dd-4e5b-96d7-bbabd8b079bd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:52.061120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:52.071479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ced0-c0dd-4e5b-96d7-bbabd8b079bd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:52.104969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832929b-c933-474d-acc7-cd2422ff8fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:52.105644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832929b-c933-474d-acc7-cd2422ff8fb7 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:52.105932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832929b-c933-474d-acc7-cd2422ff8fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:52.106212 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832929b-c933-474d-acc7-cd2422ff8fb7 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:52.106918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832929b-c933-474d-acc7-cd2422ff8fb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:52.108383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832929b-c933-474d-acc7-cd2422ff8fb7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:52.127264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 558/1110] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:11:51 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:11:54.209087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d519e-b20c-4b81-9d0b-eefd7f4d0938 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:54.209649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d519e-b20c-4b81-9d0b-eefd7f4d0938 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:54.209649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d519e-b20c-4b81-9d0b-eefd7f4d0938 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:54.210989 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 553/1111] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:54.216145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6177c-5cfc-48f7-b7a4-8c37036c0542 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:54.216541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6177c-5cfc-48f7-b7a4-8c37036c0542 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:54.216719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6177c-5cfc-48f7-b7a4-8c37036c0542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:54.233573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3de6177c-5cfc-48f7-b7a4-8c37036c0542 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:54.234762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3de6177c-5cfc-48f7-b7a4-8c37036c0542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:54.300502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 559/1112] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:54.324658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d519e-b20c-4b81-9d0b-eefd7f4d0938 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:54.343481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:54.427228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d519e-b20c-4b81-9d0b-eefd7f4d0938 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:54.461237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5077d5-c9b5-4c07-9fa4-c13e3a272940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:54.462014 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5077d5-c9b5-4c07-9fa4-c13e3a272940 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:54.462304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5077d5-c9b5-4c07-9fa4-c13e3a272940 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:54.462585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5077d5-c9b5-4c07-9fa4-c13e3a272940 None admin] PATH_INFO: `/v3/roles/0ec7b267a5724203a4845cf7da3a6ab8` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:54.464080 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5077d5-c9b5-4c07-9fa4-c13e3a272940 None admin] RBAC: Authorizing `identity:get_role(role_id=0ec7b267a5724203a4845cf7da3a6ab8)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:54.465452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5077d5-c9b5-4c07-9fa4-c13e3a272940 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:54.466840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 554/1113] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:11:54 2022] GET /identity/v3/roles/0ec7b267a5724203a4845cf7da3a6ab8 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:54.473494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6177c-5cfc-48f7-b7a4-8c37036c0542 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:54.548266 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:54.571657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6177c-5cfc-48f7-b7a4-8c37036c0542 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:54.605453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c64af-f748-4b38-aed3-84301c11b41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:54.606312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c64af-f748-4b38-aed3-84301c11b41c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:54.606594 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c64af-f748-4b38-aed3-84301c11b41c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:54.606862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c64af-f748-4b38-aed3-84301c11b41c None admin] PATH_INFO: `/v3/users/7d2b25a5c08e4d63b5e00497a59b4d67` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:54.628072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c64af-f748-4b38-aed3-84301c11b41c None admin] RBAC: Authorizing `identity:get_user(user_id=7d2b25a5c08e4d63b5e00497a59b4d67)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:54.629538 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c64af-f748-4b38-aed3-84301c11b41c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:54.631240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 560/1114] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:11:54 2022] GET /identity/v3/users/7d2b25a5c08e4d63b5e00497a59b4d67 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:54.637042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5077d5-c9b5-4c07-9fa4-c13e3a272940 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:54.721040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:54.735694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5077d5-c9b5-4c07-9fa4-c13e3a272940 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:54.770123 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ee2c-393f-4698-8302-ba43eb7570dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:54.770751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ee2c-393f-4698-8302-ba43eb7570dd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:54.771036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ee2c-393f-4698-8302-ba43eb7570dd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:54.771313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206ee2c-393f-4698-8302-ba43eb7570dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:54.837600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206ee2c-393f-4698-8302-ba43eb7570dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:54.839204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206ee2c-393f-4698-8302-ba43eb7570dd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:54.919201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:54.934314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 555/1115] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:11:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:11:54.940198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c64af-f748-4b38-aed3-84301c11b41c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:55.037848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c64af-f748-4b38-aed3-84301c11b41c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:55.070601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413acb5-fd5b-4112-a18b-81d49152baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:55.071440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413acb5-fd5b-4112-a18b-81d49152baa3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:55.071719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413acb5-fd5b-4112-a18b-81d49152baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:55.071990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413acb5-fd5b-4112-a18b-81d49152baa3 None admin] PATH_INFO: `/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:55.073174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413acb5-fd5b-4112-a18b-81d49152baa3 None admin] RBAC: Authorizing `identity:get_project(project_id=758fdbf8fa7943efb1cbead7d55f6db9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:55.074600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413acb5-fd5b-4112-a18b-81d49152baa3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:55.076369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 561/1116] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:11:54 2022] GET /identity/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:55.083015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ee2c-393f-4698-8302-ba43eb7570dd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:55.185507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206ee2c-393f-4698-8302-ba43eb7570dd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:55.220169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4b86e-2cac-4db3-ae50-aee62d6e8fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:55.220858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b86e-2cac-4db3-ae50-aee62d6e8fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:55.221100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b86e-2cac-4db3-ae50-aee62d6e8fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:55.221382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b86e-2cac-4db3-ae50-aee62d6e8fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:55.222217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4b86e-2cac-4db3-ae50-aee62d6e8fb9 None admin] RBAC: Adding query filter params (role.id=0ec7b267a5724203a4845cf7da3a6ab8, scope.project.id=758fdbf8fa7943efb1cbead7d55f6db9, user.id=7d2b25a5c08e4d63b5e00497a59b4d67) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:11:55.222563 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4b86e-2cac-4db3-ae50-aee62d6e8fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:55.223994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4b86e-2cac-4db3-ae50-aee62d6e8fb9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:55.229537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 556/1117] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:11:55 2022] GET /identity/v3/role_assignments?user.id=7d2b25a5c08e4d63b5e00497a59b4d67&scope.project.id=758fdbf8fa7943efb1cbead7d55f6db9&role.id=0ec7b267a5724203a4845cf7da3a6ab8 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:57.255608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d1f1-0546-41af-a409-0ac8bae60853 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:57.256165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d1f1-0546-41af-a409-0ac8bae60853 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:57.256165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d1f1-0546-41af-a409-0ac8bae60853 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:57.257557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 562/1118] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:57.262696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a2af-5dfb-46f4-831f-065d6a952f3a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:57.263086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a2af-5dfb-46f4-831f-065d6a952f3a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:57.263258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3a2af-5dfb-46f4-831f-065d6a952f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:57.280406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a9f3a2af-5dfb-46f4-831f-065d6a952f3a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:57.281583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a9f3a2af-5dfb-46f4-831f-065d6a952f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:11:57.325897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:57.347231 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 557/1119] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:11:57.369650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5d1f1-0546-41af-a409-0ac8bae60853 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:57.372618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:57.469400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5d1f1-0546-41af-a409-0ac8bae60853 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:57.504980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388e484-0fcf-4200-950a-b2473677bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:57.505880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e484-0fcf-4200-950a-b2473677bbae None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:57.506124 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e484-0fcf-4200-950a-b2473677bbae None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:57.506403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e484-0fcf-4200-950a-b2473677bbae None admin] PATH_INFO: `/v3/roles/0ec7b267a5724203a4845cf7da3a6ab8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:57.507880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388e484-0fcf-4200-950a-b2473677bbae None admin] RBAC: Authorizing `identity:get_role(role_id=0ec7b267a5724203a4845cf7da3a6ab8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:57.509294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388e484-0fcf-4200-950a-b2473677bbae None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:57.510689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 563/1120] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:11:57 2022] GET /identity/v3/roles/0ec7b267a5724203a4845cf7da3a6ab8 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:57.516926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3a2af-5dfb-46f4-831f-065d6a952f3a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:57.616531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3a2af-5dfb-46f4-831f-065d6a952f3a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:57.649814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e58d-d7b1-4345-886d-f45eca13cd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:57.650677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e58d-d7b1-4345-886d-f45eca13cd14 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:57.650966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e58d-d7b1-4345-886d-f45eca13cd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:57.651248 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e58d-d7b1-4345-886d-f45eca13cd14 None admin] PATH_INFO: `/v3/users/7d2b25a5c08e4d63b5e00497a59b4d67` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:57.652462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e58d-d7b1-4345-886d-f45eca13cd14 None admin] RBAC: Authorizing `identity:get_user(user_id=7d2b25a5c08e4d63b5e00497a59b4d67)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:57.653904 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e58d-d7b1-4345-886d-f45eca13cd14 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:57.655556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 558/1121] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:11:57 2022] GET /identity/v3/users/7d2b25a5c08e4d63b5e00497a59b4d67 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:57.663206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388e484-0fcf-4200-950a-b2473677bbae None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:57.731037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:57.762068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388e484-0fcf-4200-950a-b2473677bbae None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:57.794649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba31164-c22b-436d-ada6-cf78578a90c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:57.795494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba31164-c22b-436d-ada6-cf78578a90c4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:57.795780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba31164-c22b-436d-ada6-cf78578a90c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:57.796081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba31164-c22b-436d-ada6-cf78578a90c4 None admin] PATH_INFO: `/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:57.797389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba31164-c22b-436d-ada6-cf78578a90c4 None admin] RBAC: Authorizing `identity:get_project(project_id=758fdbf8fa7943efb1cbead7d55f6db9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:57.798816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba31164-c22b-436d-ada6-cf78578a90c4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:57.801074 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 564/1122] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:11:57 2022] GET /identity/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:11:57.807150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e58d-d7b1-4345-886d-f45eca13cd14 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:11:57.855404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:11:57.906130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e58d-d7b1-4345-886d-f45eca13cd14 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:11:57.939959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2ae39-1375-475a-abf3-9c6e9205021f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:11:57.940882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2ae39-1375-475a-abf3-9c6e9205021f None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:57.941177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2ae39-1375-475a-abf3-9c6e9205021f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:57.941459 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2ae39-1375-475a-abf3-9c6e9205021f None admin] PATH_INFO: `/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9/users/7d2b25a5c08e4d63b5e00497a59b4d67/roles/0ec7b267a5724203a4845cf7da3a6ab8` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:57.943669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2ae39-1375-475a-abf3-9c6e9205021f None admin] RBAC: Authorizing `identity:create_grant(project_id=758fdbf8fa7943efb1cbead7d55f6db9, user_id=7d2b25a5c08e4d63b5e00497a59b4d67, role_id=0ec7b267a5724203a4845cf7da3a6ab8)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:11:57.945159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2ae39-1375-475a-abf3-9c6e9205021f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:11:57.958582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 559/1123] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:11:57 2022] PUT /identity/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9/users/7d2b25a5c08e4d63b5e00497a59b4d67/roles/0ec7b267a5724203a4845cf7da3a6ab8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:11:59.958340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf37561-dee2-46de-a157-8157f87b44e4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:59.958858 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf37561-dee2-46de-a157-8157f87b44e4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:59.958974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf37561-dee2-46de-a157-8157f87b44e4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:59.960304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 565/1124] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:11:59.965525 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994476c3-8801-41cb-b418-17fea72fb51d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:11:59.965928 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994476c3-8801-41cb-b418-17fea72fb51d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:11:59.966090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994476c3-8801-41cb-b418-17fea72fb51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:11:59.983203 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-994476c3-8801-41cb-b418-17fea72fb51d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:11:59.984446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-994476c3-8801-41cb-b418-17fea72fb51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:00.051078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 560/1125] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:11:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:00.074840 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf37561-dee2-46de-a157-8157f87b44e4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:00.175658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf37561-dee2-46de-a157-8157f87b44e4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:00.208620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010f1c3-2d2b-47d2-b679-59152833b86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:00.209455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010f1c3-2d2b-47d2-b679-59152833b86b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:00.209728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010f1c3-2d2b-47d2-b679-59152833b86b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:00.210003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010f1c3-2d2b-47d2-b679-59152833b86b None admin] PATH_INFO: `/v3/roles/0ec7b267a5724203a4845cf7da3a6ab8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:00.211427 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010f1c3-2d2b-47d2-b679-59152833b86b None admin] RBAC: Authorizing `identity:get_role(role_id=0ec7b267a5724203a4845cf7da3a6ab8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:00.212824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010f1c3-2d2b-47d2-b679-59152833b86b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:00.214189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 566/1126] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:12:00 2022] GET /identity/v3/roles/0ec7b267a5724203a4845cf7da3a6ab8 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:00.219999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994476c3-8801-41cb-b418-17fea72fb51d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:00.257447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:00.315293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994476c3-8801-41cb-b418-17fea72fb51d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:00.350648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9834-acd1-42aa-9c79-76e2c8c23b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:00.351503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9834-acd1-42aa-9c79-76e2c8c23b8d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:00.351783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9834-acd1-42aa-9c79-76e2c8c23b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:00.352079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9834-acd1-42aa-9c79-76e2c8c23b8d None admin] PATH_INFO: `/v3/users/7d2b25a5c08e4d63b5e00497a59b4d67` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:00.353248 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab9834-acd1-42aa-9c79-76e2c8c23b8d None admin] RBAC: Authorizing `identity:get_user(user_id=7d2b25a5c08e4d63b5e00497a59b4d67)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:00.354668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab9834-acd1-42aa-9c79-76e2c8c23b8d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:00.356327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 561/1127] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:12:00 2022] GET /identity/v3/users/7d2b25a5c08e4d63b5e00497a59b4d67 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:00.362082 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010f1c3-2d2b-47d2-b679-59152833b86b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:00.370744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:00.461718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010f1c3-2d2b-47d2-b679-59152833b86b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:00.493890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb79e1-98aa-4be4-b164-eef0c6f9b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:00.494533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb79e1-98aa-4be4-b164-eef0c6f9b464 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:00.494818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb79e1-98aa-4be4-b164-eef0c6f9b464 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:00.495095 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb79e1-98aa-4be4-b164-eef0c6f9b464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:00.560378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb79e1-98aa-4be4-b164-eef0c6f9b464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:00.561817 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb79e1-98aa-4be4-b164-eef0c6f9b464 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:00.570003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:00.658451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 567/1128] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:12:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:12:00.664305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9834-acd1-42aa-9c79-76e2c8c23b8d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:00.760630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9834-acd1-42aa-9c79-76e2c8c23b8d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:00.767907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:00.794365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8e68f-5202-4dc7-8d2d-4ddc381cec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:00.795209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8e68f-5202-4dc7-8d2d-4ddc381cec58 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:00.795491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8e68f-5202-4dc7-8d2d-4ddc381cec58 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:00.795765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8e68f-5202-4dc7-8d2d-4ddc381cec58 None admin] PATH_INFO: `/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:00.796947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8e68f-5202-4dc7-8d2d-4ddc381cec58 None admin] RBAC: Authorizing `identity:get_project(project_id=758fdbf8fa7943efb1cbead7d55f6db9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:00.798360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8e68f-5202-4dc7-8d2d-4ddc381cec58 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:00.800066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 562/1129] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:12:00 2022] GET /identity/v3/projects/758fdbf8fa7943efb1cbead7d55f6db9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:00.806675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb79e1-98aa-4be4-b164-eef0c6f9b464 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:00.903910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb79e1-98aa-4be4-b164-eef0c6f9b464 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:00.911800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:00.938754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4167a-ee0c-462d-b175-bc4891168c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:00.939403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4167a-ee0c-462d-b175-bc4891168c61 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:00.939691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4167a-ee0c-462d-b175-bc4891168c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:00.939974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4167a-ee0c-462d-b175-bc4891168c61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:00.940878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4167a-ee0c-462d-b175-bc4891168c61 None admin] RBAC: Adding query filter params (role.id=0ec7b267a5724203a4845cf7da3a6ab8, scope.project.id=758fdbf8fa7943efb1cbead7d55f6db9, user.id=7d2b25a5c08e4d63b5e00497a59b4d67) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:00.941200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4167a-ee0c-462d-b175-bc4891168c61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:00.942641 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4167a-ee0c-462d-b175-bc4891168c61 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:00.948415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 568/1130] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:12:00 2022] GET /identity/v3/role_assignments?user.id=7d2b25a5c08e4d63b5e00497a59b4d67&scope.project.id=758fdbf8fa7943efb1cbead7d55f6db9&role.id=0ec7b267a5724203a4845cf7da3a6ab8 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:02.976036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e97ec-c688-4686-9638-021765bcbb8e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:02.976580 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e97ec-c688-4686-9638-021765bcbb8e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:02.976676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e97ec-c688-4686-9638-021765bcbb8e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:02.977977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 563/1131] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:02.983091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064500b7-736b-4493-bad4-fba998deacfa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:02.983472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064500b7-736b-4493-bad4-fba998deacfa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:02.983656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064500b7-736b-4493-bad4-fba998deacfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:03.000858 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-064500b7-736b-4493-bad4-fba998deacfa None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:03.002071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-064500b7-736b-4493-bad4-fba998deacfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:03.069664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 569/1132] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:03.093090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e97ec-c688-4686-9638-021765bcbb8e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:03.193210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e97ec-c688-4686-9638-021765bcbb8e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:03.225778 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dbdb7-ebde-412f-9bd1-a37ef1af3d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:03.226552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbdb7-ebde-412f-9bd1-a37ef1af3d79 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:03.226841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbdb7-ebde-412f-9bd1-a37ef1af3d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:03.227120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbdb7-ebde-412f-9bd1-a37ef1af3d79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:03.228320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dbdb7-ebde-412f-9bd1-a37ef1af3d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:03.229760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dbdb7-ebde-412f-9bd1-a37ef1af3d79 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:03.231399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 564/1133] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:12:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:03.237371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064500b7-736b-4493-bad4-fba998deacfa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:03.332010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:03.335183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064500b7-736b-4493-bad4-fba998deacfa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:03.368076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82262e50-35b1-40fe-ac8e-4c792fcb5117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:03.368676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82262e50-35b1-40fe-ac8e-4c792fcb5117 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:03.368961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82262e50-35b1-40fe-ac8e-4c792fcb5117 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:03.369236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82262e50-35b1-40fe-ac8e-4c792fcb5117 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:03.369954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82262e50-35b1-40fe-ac8e-4c792fcb5117 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:03.371378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82262e50-35b1-40fe-ac8e-4c792fcb5117 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:03.396529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 570/1134] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:12:03 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:12:05.439313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92c3fb-9ce8-4b1c-9894-0656aec2d758 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:05.439877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92c3fb-9ce8-4b1c-9894-0656aec2d758 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:05.439877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92c3fb-9ce8-4b1c-9894-0656aec2d758 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:05.441759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 565/1135] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:05.446855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609abf81-8cd9-4ae4-8d5e-2c3e5aedaf20 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:05.447285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609abf81-8cd9-4ae4-8d5e-2c3e5aedaf20 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:05.447467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609abf81-8cd9-4ae4-8d5e-2c3e5aedaf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:05.464498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-609abf81-8cd9-4ae4-8d5e-2c3e5aedaf20 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:05.465694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-609abf81-8cd9-4ae4-8d5e-2c3e5aedaf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:05.532765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 571/1136] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:05.557674 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92c3fb-9ce8-4b1c-9894-0656aec2d758 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:05.602229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:05.659037 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92c3fb-9ce8-4b1c-9894-0656aec2d758 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:05.693143 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f83ab-2c22-4f53-9d19-d1c726d4c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:05.693851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f83ab-2c22-4f53-9d19-d1c726d4c090 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:05.694140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f83ab-2c22-4f53-9d19-d1c726d4c090 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:05.694419 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f83ab-2c22-4f53-9d19-d1c726d4c090 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:05.695589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f83ab-2c22-4f53-9d19-d1c726d4c090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:05.697052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f83ab-2c22-4f53-9d19-d1c726d4c090 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:05.698678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 566/1137] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:12:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:05.704492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609abf81-8cd9-4ae4-8d5e-2c3e5aedaf20 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:05.782016 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:05.801060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609abf81-8cd9-4ae4-8d5e-2c3e5aedaf20 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:05.834323 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08063385-ce2c-47f9-b3fe-54c8924301d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:05.834990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08063385-ce2c-47f9-b3fe-54c8924301d4 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:05.835271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08063385-ce2c-47f9-b3fe-54c8924301d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:05.835545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08063385-ce2c-47f9-b3fe-54c8924301d4 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:05.836289 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08063385-ce2c-47f9-b3fe-54c8924301d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:05.837753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08063385-ce2c-47f9-b3fe-54c8924301d4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:05.857871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 572/1138] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:12:05 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:12:07.907945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b9a9d-e1e7-4b77-9d66-6b3b15d0486e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:07.908559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b9a9d-e1e7-4b77-9d66-6b3b15d0486e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:07.908559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b9a9d-e1e7-4b77-9d66-6b3b15d0486e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:07.910381 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 567/1139] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:07.915546 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5c651-e49b-4289-9e53-23055ca50875 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:07.915941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5c651-e49b-4289-9e53-23055ca50875 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:07.916135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5c651-e49b-4289-9e53-23055ca50875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:07.932931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0ad5c651-e49b-4289-9e53-23055ca50875 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:07.934102 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0ad5c651-e49b-4289-9e53-23055ca50875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:07.999336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 573/1140] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:08.023310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b9a9d-e1e7-4b77-9d66-6b3b15d0486e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:08.121143 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b9a9d-e1e7-4b77-9d66-6b3b15d0486e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:08.131285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:08.154648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4836e-f088-414d-865c-a3395fe2e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:08.155427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4836e-f088-414d-865c-a3395fe2e02c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:08.155710 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4836e-f088-414d-865c-a3395fe2e02c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:08.155984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4836e-f088-414d-865c-a3395fe2e02c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:08.166497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4836e-f088-414d-865c-a3395fe2e02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-5dd4836e-f088-414d-865c-a3395fe2e02c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:12:08.174120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:12:08.175258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:12:08.176495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 568/1141] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:12:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:12:08.181263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5c651-e49b-4289-9e53-23055ca50875 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:08.245153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:08.279033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5c651-e49b-4289-9e53-23055ca50875 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:08.311885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1beac12-adb3-46f2-9a91-f9d55bbda78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:08.312567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beac12-adb3-46f2-9a91-f9d55bbda78b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:08.312855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beac12-adb3-46f2-9a91-f9d55bbda78b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:08.313136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beac12-adb3-46f2-9a91-f9d55bbda78b None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:08.313882 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1beac12-adb3-46f2-9a91-f9d55bbda78b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:08.314189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1beac12-adb3-46f2-9a91-f9d55bbda78b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:08.316118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1beac12-adb3-46f2-9a91-f9d55bbda78b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:08.324000 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 574/1142] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:12:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:08.329748 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4836e-f088-414d-865c-a3395fe2e02c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:08.428907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4836e-f088-414d-865c-a3395fe2e02c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:08.460543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412dca5-28f1-4166-bb53-41d0599df607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:08.461398 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412dca5-28f1-4166-bb53-41d0599df607 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:08.461679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412dca5-28f1-4166-bb53-41d0599df607 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:08.461954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412dca5-28f1-4166-bb53-41d0599df607 None admin] PATH_INFO: `/v3/users/8acbabac01ed4516a6ac28b5a552f9d1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:08.475301 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412dca5-28f1-4166-bb53-41d0599df607 None admin] RBAC: Authorizing `identity:get_user(user_id=8acbabac01ed4516a6ac28b5a552f9d1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:08.477089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412dca5-28f1-4166-bb53-41d0599df607 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:08.479071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 569/1143] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:12:08 2022] GET /identity/v3/users/8acbabac01ed4516a6ac28b5a552f9d1 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:08.484968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1beac12-adb3-46f2-9a91-f9d55bbda78b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:08.581156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1beac12-adb3-46f2-9a91-f9d55bbda78b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:08.608131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:08.614690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2b9d-c74d-440f-8b5c-e84f79968148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:08.615335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2b9d-c74d-440f-8b5c-e84f79968148 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:08.615622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2b9d-c74d-440f-8b5c-e84f79968148 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:08.615898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2b9d-c74d-440f-8b5c-e84f79968148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:08.683952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e2b9d-c74d-440f-8b5c-e84f79968148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:08.685360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e2b9d-c74d-440f-8b5c-e84f79968148 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:08.780229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 575/1144] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:12:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:12:08.786688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412dca5-28f1-4166-bb53-41d0599df607 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:08.814499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:08.884692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412dca5-28f1-4166-bb53-41d0599df607 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:08.916829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135f41a-c09a-4fd5-8f1f-ae300aa315d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:08.917669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135f41a-c09a-4fd5-8f1f-ae300aa315d4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:08.917948 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135f41a-c09a-4fd5-8f1f-ae300aa315d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:08.918218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135f41a-c09a-4fd5-8f1f-ae300aa315d4 None admin] PATH_INFO: `/v3/projects/cc8dd65b892c4b2b984a6b2c14944404` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:08.919378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135f41a-c09a-4fd5-8f1f-ae300aa315d4 None admin] RBAC: Authorizing `identity:get_project(project_id=cc8dd65b892c4b2b984a6b2c14944404)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:08.920817 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135f41a-c09a-4fd5-8f1f-ae300aa315d4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:08.922506 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 570/1145] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:12:08 2022] GET /identity/v3/projects/cc8dd65b892c4b2b984a6b2c14944404 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:08.929106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2b9d-c74d-440f-8b5c-e84f79968148 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:08.959354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:09.030040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2b9d-c74d-440f-8b5c-e84f79968148 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:09.063113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602672dc-be22-491b-bfcf-aa1d8ae0e760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:09.063754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602672dc-be22-491b-bfcf-aa1d8ae0e760 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:09.064059 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602672dc-be22-491b-bfcf-aa1d8ae0e760 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:09.064346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602672dc-be22-491b-bfcf-aa1d8ae0e760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:09.065649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602672dc-be22-491b-bfcf-aa1d8ae0e760 None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=cc8dd65b892c4b2b984a6b2c14944404, user.id=8acbabac01ed4516a6ac28b5a552f9d1) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:09.065649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602672dc-be22-491b-bfcf-aa1d8ae0e760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:09.066954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602672dc-be22-491b-bfcf-aa1d8ae0e760 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:09.072346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 576/1146] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:12:08 2022] GET /identity/v3/role_assignments?user.id=8acbabac01ed4516a6ac28b5a552f9d1&scope.project.id=cc8dd65b892c4b2b984a6b2c14944404&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:11.074721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3616562-fb00-47dd-96d8-01260db3d279 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:11.075241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3616562-fb00-47dd-96d8-01260db3d279 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:11.075241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3616562-fb00-47dd-96d8-01260db3d279 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:11.076656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 571/1147] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:11.082430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7d83-5e98-40b0-849c-57dba76e5967 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:11.082852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7d83-5e98-40b0-849c-57dba76e5967 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:11.082945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7d83-5e98-40b0-849c-57dba76e5967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:11.100331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-347e7d83-5e98-40b0-849c-57dba76e5967 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:11.101505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-347e7d83-5e98-40b0-849c-57dba76e5967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:11.167576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 577/1148] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:11.190421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3616562-fb00-47dd-96d8-01260db3d279 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:11.284842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:11.292095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3616562-fb00-47dd-96d8-01260db3d279 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:11.325723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de00f6-76dd-4c4b-80fa-e93343ba09a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:11.326515 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de00f6-76dd-4c4b-80fa-e93343ba09a8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:11.326800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de00f6-76dd-4c4b-80fa-e93343ba09a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:11.327076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de00f6-76dd-4c4b-80fa-e93343ba09a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:11.337874 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de00f6-76dd-4c4b-80fa-e93343ba09a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-09de00f6-76dd-4c4b-80fa-e93343ba09a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:12:11.345410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:12:11.346495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:12:11.347973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 572/1149] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:12:11.353519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7d83-5e98-40b0-849c-57dba76e5967 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:11.378319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:11.458035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7d83-5e98-40b0-849c-57dba76e5967 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:11.491430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411b5b4-af5c-487a-9d92-ff41c08fd984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:11.492116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411b5b4-af5c-487a-9d92-ff41c08fd984 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:11.492404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411b5b4-af5c-487a-9d92-ff41c08fd984 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:11.492675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411b5b4-af5c-487a-9d92-ff41c08fd984 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:11.493411 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411b5b4-af5c-487a-9d92-ff41c08fd984 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:11.493717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411b5b4-af5c-487a-9d92-ff41c08fd984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:11.495090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411b5b4-af5c-487a-9d92-ff41c08fd984 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:11.503828 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 578/1150] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:12:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:11.510155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de00f6-76dd-4c4b-80fa-e93343ba09a8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:11.612051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de00f6-76dd-4c4b-80fa-e93343ba09a8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:11.646963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f12b5-f14b-40e6-8f0d-1b53f5615f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:11.647836 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f12b5-f14b-40e6-8f0d-1b53f5615f1f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:11.648151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f12b5-f14b-40e6-8f0d-1b53f5615f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:11.648430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f12b5-f14b-40e6-8f0d-1b53f5615f1f None admin] PATH_INFO: `/v3/users/8acbabac01ed4516a6ac28b5a552f9d1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:11.649637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f12b5-f14b-40e6-8f0d-1b53f5615f1f None admin] RBAC: Authorizing `identity:get_user(user_id=8acbabac01ed4516a6ac28b5a552f9d1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:11.651082 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f12b5-f14b-40e6-8f0d-1b53f5615f1f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:11.652782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 573/1151] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:12:11 2022] GET /identity/v3/users/8acbabac01ed4516a6ac28b5a552f9d1 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:11.658749 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411b5b4-af5c-487a-9d92-ff41c08fd984 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:11.742064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:11.757942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411b5b4-af5c-487a-9d92-ff41c08fd984 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:11.791109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920d1c5-6d0e-4efa-b0c4-26c32516632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:11.791961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d1c5-6d0e-4efa-b0c4-26c32516632d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:11.792269 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d1c5-6d0e-4efa-b0c4-26c32516632d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:11.792545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d1c5-6d0e-4efa-b0c4-26c32516632d None admin] PATH_INFO: `/v3/projects/cc8dd65b892c4b2b984a6b2c14944404` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:11.793719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920d1c5-6d0e-4efa-b0c4-26c32516632d None admin] RBAC: Authorizing `identity:get_project(project_id=cc8dd65b892c4b2b984a6b2c14944404)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:11.795145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920d1c5-6d0e-4efa-b0c4-26c32516632d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:11.796891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 579/1152] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:12:11 2022] GET /identity/v3/projects/cc8dd65b892c4b2b984a6b2c14944404 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:11.803693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f12b5-f14b-40e6-8f0d-1b53f5615f1f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:11.831198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:11.903636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f12b5-f14b-40e6-8f0d-1b53f5615f1f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:11.936340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c90787-b25c-45d4-b820-fb3d06ef0a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:11.937228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c90787-b25c-45d4-b820-fb3d06ef0a31 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:11.937514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c90787-b25c-45d4-b820-fb3d06ef0a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:11.937822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c90787-b25c-45d4-b820-fb3d06ef0a31 None admin] PATH_INFO: `/v3/projects/cc8dd65b892c4b2b984a6b2c14944404/users/8acbabac01ed4516a6ac28b5a552f9d1/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:11.939771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c90787-b25c-45d4-b820-fb3d06ef0a31 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc8dd65b892c4b2b984a6b2c14944404, user_id=8acbabac01ed4516a6ac28b5a552f9d1, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:11.941776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c90787-b25c-45d4-b820-fb3d06ef0a31 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:11.954508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 574/1153] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:12:11 2022] PUT /identity/v3/projects/cc8dd65b892c4b2b984a6b2c14944404/users/8acbabac01ed4516a6ac28b5a552f9d1/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:12:13.988709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca72fb-9629-48f9-9bcf-67637485cedc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:13.989227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca72fb-9629-48f9-9bcf-67637485cedc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:13.989316 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca72fb-9629-48f9-9bcf-67637485cedc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:13.990647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 580/1154] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:13.995945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906a74-e4c0-40d6-87f6-273fcfd4d077 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:13.996386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906a74-e4c0-40d6-87f6-273fcfd4d077 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:13.996601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906a74-e4c0-40d6-87f6-273fcfd4d077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:14.013859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-66906a74-e4c0-40d6-87f6-273fcfd4d077 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:14.015316 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-66906a74-e4c0-40d6-87f6-273fcfd4d077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:14.082044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 575/1155] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:14.105632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca72fb-9629-48f9-9bcf-67637485cedc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:14.208235 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca72fb-9629-48f9-9bcf-67637485cedc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:14.245247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1755e5-9413-40dc-ba1c-214a266eb72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:14.246047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1755e5-9413-40dc-ba1c-214a266eb72a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:14.246338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1755e5-9413-40dc-ba1c-214a266eb72a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:14.246713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1755e5-9413-40dc-ba1c-214a266eb72a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:14.257967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1755e5-9413-40dc-ba1c-214a266eb72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-1f1755e5-9413-40dc-ba1c-214a266eb72a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:12:14.265915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:12:14.267045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:14.268120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:12:14.273439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 581/1156] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:12:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:12:14.273855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66906a74-e4c0-40d6-87f6-273fcfd4d077 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:14.289207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:14.375476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66906a74-e4c0-40d6-87f6-273fcfd4d077 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:14.411549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b3215-6d23-45e0-99ce-fbd289b18575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:14.412237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3215-6d23-45e0-99ce-fbd289b18575 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:14.412519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3215-6d23-45e0-99ce-fbd289b18575 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:14.412792 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3215-6d23-45e0-99ce-fbd289b18575 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:14.413541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b3215-6d23-45e0-99ce-fbd289b18575 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:14.413845 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b3215-6d23-45e0-99ce-fbd289b18575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:14.415200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b3215-6d23-45e0-99ce-fbd289b18575 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:14.424432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 576/1157] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:12:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:14.430441 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1755e5-9413-40dc-ba1c-214a266eb72a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:14.446753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:14.532141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1755e5-9413-40dc-ba1c-214a266eb72a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:14.563855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348861d7-48a2-461d-85c2-a8195e7b5857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:14.564743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348861d7-48a2-461d-85c2-a8195e7b5857 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:14.565026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348861d7-48a2-461d-85c2-a8195e7b5857 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:14.565838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348861d7-48a2-461d-85c2-a8195e7b5857 None admin] PATH_INFO: `/v3/users/8acbabac01ed4516a6ac28b5a552f9d1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:14.567020 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348861d7-48a2-461d-85c2-a8195e7b5857 None admin] RBAC: Authorizing `identity:get_user(user_id=8acbabac01ed4516a6ac28b5a552f9d1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:14.568490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348861d7-48a2-461d-85c2-a8195e7b5857 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:14.570131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 582/1158] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:12:14 2022] GET /identity/v3/users/8acbabac01ed4516a6ac28b5a552f9d1 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:14.575886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b3215-6d23-45e0-99ce-fbd289b18575 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:14.651294 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:14.673849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b3215-6d23-45e0-99ce-fbd289b18575 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:14.706139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a593e-c65e-4287-bb7e-1bab4ba60fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:14.706821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a593e-c65e-4287-bb7e-1bab4ba60fea None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:14.707106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a593e-c65e-4287-bb7e-1bab4ba60fea None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:14.707386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a593e-c65e-4287-bb7e-1bab4ba60fea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:14.773276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a593e-c65e-4287-bb7e-1bab4ba60fea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:14.774723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a593e-c65e-4287-bb7e-1bab4ba60fea None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:14.846934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:14.870570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 577/1159] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:12:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:12:14.876614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348861d7-48a2-461d-85c2-a8195e7b5857 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:14.955891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:14.974043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348861d7-48a2-461d-85c2-a8195e7b5857 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:15.008340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eba298-ea12-4b9c-acca-69be0b282495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:15.009194 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba298-ea12-4b9c-acca-69be0b282495 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:15.009479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba298-ea12-4b9c-acca-69be0b282495 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:15.009756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba298-ea12-4b9c-acca-69be0b282495 None admin] PATH_INFO: `/v3/projects/cc8dd65b892c4b2b984a6b2c14944404` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:15.010941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eba298-ea12-4b9c-acca-69be0b282495 None admin] RBAC: Authorizing `identity:get_project(project_id=cc8dd65b892c4b2b984a6b2c14944404)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:15.012400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eba298-ea12-4b9c-acca-69be0b282495 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:15.014121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 583/1160] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:12:14 2022] GET /identity/v3/projects/cc8dd65b892c4b2b984a6b2c14944404 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:15.020778 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a593e-c65e-4287-bb7e-1bab4ba60fea None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:15.117665 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a593e-c65e-4287-bb7e-1bab4ba60fea None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:15.153692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d543fa6-8768-4197-a587-470f511b99b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:15.154337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d543fa6-8768-4197-a587-470f511b99b7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:15.154625 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d543fa6-8768-4197-a587-470f511b99b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:15.154915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d543fa6-8768-4197-a587-470f511b99b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:15.155750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d543fa6-8768-4197-a587-470f511b99b7 None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=cc8dd65b892c4b2b984a6b2c14944404, user.id=8acbabac01ed4516a6ac28b5a552f9d1) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:15.156090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d543fa6-8768-4197-a587-470f511b99b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:15.157529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d543fa6-8768-4197-a587-470f511b99b7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:15.163945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 578/1161] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:12:15 2022] GET /identity/v3/role_assignments?user.id=8acbabac01ed4516a6ac28b5a552f9d1&scope.project.id=cc8dd65b892c4b2b984a6b2c14944404&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:17.204588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9aee-1096-49b2-ad9b-d95a3279b46e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:17.205104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9aee-1096-49b2-ad9b-d95a3279b46e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:17.205217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9aee-1096-49b2-ad9b-d95a3279b46e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:17.206653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 584/1162] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:17.211763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d4435-940d-449d-9bcd-831d8ed8e528 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:17.212198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d4435-940d-449d-9bcd-831d8ed8e528 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:17.212366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d4435-940d-449d-9bcd-831d8ed8e528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:17.229674 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-be2d4435-940d-449d-9bcd-831d8ed8e528 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:17.230877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-be2d4435-940d-449d-9bcd-831d8ed8e528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:17.264449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:17.298127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 579/1163] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:17.321208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a9aee-1096-49b2-ad9b-d95a3279b46e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:17.418186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a9aee-1096-49b2-ad9b-d95a3279b46e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:17.450268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263710c-ac29-4839-852a-14b0a2b3ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:17.450901 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263710c-ac29-4839-852a-14b0a2b3ec7d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:17.451180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263710c-ac29-4839-852a-14b0a2b3ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:17.451456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263710c-ac29-4839-852a-14b0a2b3ec7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:17.469027 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:17.517776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263710c-ac29-4839-852a-14b0a2b3ec7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:17.519237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263710c-ac29-4839-852a-14b0a2b3ec7d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:17.615095 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 585/1164] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:12:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:12:17.621287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d4435-940d-449d-9bcd-831d8ed8e528 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:17.718989 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d4435-940d-449d-9bcd-831d8ed8e528 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:17.751911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a07c42-80ef-474c-9c58-1484f3322f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:17.753192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a07c42-80ef-474c-9c58-1484f3322f1e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:17.753481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a07c42-80ef-474c-9c58-1484f3322f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:17.753798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a07c42-80ef-474c-9c58-1484f3322f1e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:17.760445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a07c42-80ef-474c-9c58-1484f3322f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:17.761882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a07c42-80ef-474c-9c58-1484f3322f1e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-77a07c42-80ef-474c-9c58-1484f3322f1e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:12:17.777197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:12:17.778535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:12:17.779435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 580/1165] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 12:12:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:12:17.784707 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263710c-ac29-4839-852a-14b0a2b3ec7d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:17.835576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:17.884327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263710c-ac29-4839-852a-14b0a2b3ec7d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:17.917925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ef833-7d20-4853-a4d7-0fe36fd4fd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:17.918576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ef833-7d20-4853-a4d7-0fe36fd4fd8b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:17.918889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ef833-7d20-4853-a4d7-0fe36fd4fd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:17.919170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ef833-7d20-4853-a4d7-0fe36fd4fd8b None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:17.919885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ef833-7d20-4853-a4d7-0fe36fd4fd8b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:17.920223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ef833-7d20-4853-a4d7-0fe36fd4fd8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:17.921591 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ef833-7d20-4853-a4d7-0fe36fd4fd8b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:17.928582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 586/1166] 10.222.0.66 () {56 vars in 1115 bytes} [Wed Jun 22 12:12:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:19.999374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa03f05-e797-410d-b7e2-e494d697cfe4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:19.999958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa03f05-e797-410d-b7e2-e494d697cfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:19.999958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa03f05-e797-410d-b7e2-e494d697cfe4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:20.001373 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 581/1167] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:20.006738 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019b55-b95a-4757-af7a-1bf378705b30 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:20.007195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019b55-b95a-4757-af7a-1bf378705b30 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:20.007304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019b55-b95a-4757-af7a-1bf378705b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:20.024476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a1019b55-b95a-4757-af7a-1bf378705b30 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:20.025652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a1019b55-b95a-4757-af7a-1bf378705b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:20.090341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 587/1168] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:20.113873 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa03f05-e797-410d-b7e2-e494d697cfe4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:20.144733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:20.215295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa03f05-e797-410d-b7e2-e494d697cfe4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:20.247923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294833e-b1fe-4ee4-ac52-57dfd00f5a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:20.248602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294833e-b1fe-4ee4-ac52-57dfd00f5a08 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:20.248888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294833e-b1fe-4ee4-ac52-57dfd00f5a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:20.249167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294833e-b1fe-4ee4-ac52-57dfd00f5a08 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:20.249903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294833e-b1fe-4ee4-ac52-57dfd00f5a08 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:20.251265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294833e-b1fe-4ee4-ac52-57dfd00f5a08 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:20.266469 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 582/1169] 10.222.0.66 () {60 vars in 1138 bytes} [Wed Jun 22 12:12:20 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:12:22.319883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df259ffd-8dbd-43cb-b702-606e5bf325fa None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:22.320456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df259ffd-8dbd-43cb-b702-606e5bf325fa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:22.320456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df259ffd-8dbd-43cb-b702-606e5bf325fa None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:22.321890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 588/1170] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:22.327026 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd0af0-a6e4-4fae-847e-259c07a57cb7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:22.327405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd0af0-a6e4-4fae-847e-259c07a57cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:22.327601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd0af0-a6e4-4fae-847e-259c07a57cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:22.344042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bffd0af0-a6e4-4fae-847e-259c07a57cb7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:22.345245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bffd0af0-a6e4-4fae-847e-259c07a57cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:22.409650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 583/1171] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:22.433558 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df259ffd-8dbd-43cb-b702-606e5bf325fa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:22.485781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:22.541201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df259ffd-8dbd-43cb-b702-606e5bf325fa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:22.575259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac8fd5-8a66-4b96-b3dc-20f7f72b24ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:22.576051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8fd5-8a66-4b96-b3dc-20f7f72b24ee None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:22.576335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8fd5-8a66-4b96-b3dc-20f7f72b24ee None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:22.576607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8fd5-8a66-4b96-b3dc-20f7f72b24ee None admin] PATH_INFO: `/v3/domains/2a525b5c72294e4e95b9d7af37bb3b07` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:22.586822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac8fd5-8a66-4b96-b3dc-20f7f72b24ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=2a525b5c72294e4e95b9d7af37bb3b07)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:22.588305 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac8fd5-8a66-4b96-b3dc-20f7f72b24ee None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:22.590019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 589/1172] 10.222.0.66 () {56 vars in 1183 bytes} [Wed Jun 22 12:12:22 2022] GET /identity/v3/domains/2a525b5c72294e4e95b9d7af37bb3b07 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:22.596330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd0af0-a6e4-4fae-847e-259c07a57cb7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:22.617435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:22.693513 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd0af0-a6e4-4fae-847e-259c07a57cb7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:22.726136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261617e0-3469-47ed-893d-db5050a4c780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:22.726789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261617e0-3469-47ed-893d-db5050a4c780 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:22.727072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261617e0-3469-47ed-893d-db5050a4c780 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:22.727351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261617e0-3469-47ed-893d-db5050a4c780 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:22.728090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261617e0-3469-47ed-893d-db5050a4c780 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:22.729522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261617e0-3469-47ed-893d-db5050a4c780 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:22.754012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 584/1173] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:12:22 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:12:24.794026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef09c4-37a5-4031-8f71-9a8fee2f3f2f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:24.794577 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef09c4-37a5-4031-8f71-9a8fee2f3f2f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:24.794577 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef09c4-37a5-4031-8f71-9a8fee2f3f2f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:24.795923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 590/1174] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:24.801332 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150dad-b05b-4abd-9a5a-dedc17adf5fe None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:24.801765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150dad-b05b-4abd-9a5a-dedc17adf5fe None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:24.801907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150dad-b05b-4abd-9a5a-dedc17adf5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:24.818515 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fa150dad-b05b-4abd-9a5a-dedc17adf5fe None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:24.819699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fa150dad-b05b-4abd-9a5a-dedc17adf5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:24.884427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 585/1175] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:24.910192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef09c4-37a5-4031-8f71-9a8fee2f3f2f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:25.013247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef09c4-37a5-4031-8f71-9a8fee2f3f2f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:25.015746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:25.046801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93922b-f291-4d6f-8f7f-e87468c0682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:25.047575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93922b-f291-4d6f-8f7f-e87468c0682a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:25.047854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93922b-f291-4d6f-8f7f-e87468c0682a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:25.048157 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93922b-f291-4d6f-8f7f-e87468c0682a None admin] PATH_INFO: `/v3/domains/2a525b5c72294e4e95b9d7af37bb3b07` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:25.049380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93922b-f291-4d6f-8f7f-e87468c0682a None admin] RBAC: Authorizing `identity:get_domain(domain_id=2a525b5c72294e4e95b9d7af37bb3b07)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:25.050809 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93922b-f291-4d6f-8f7f-e87468c0682a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:25.052452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 591/1176] 10.222.0.66 () {56 vars in 1183 bytes} [Wed Jun 22 12:12:24 2022] GET /identity/v3/domains/2a525b5c72294e4e95b9d7af37bb3b07 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:25.058270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa150dad-b05b-4abd-9a5a-dedc17adf5fe None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:25.060485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:25.158292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa150dad-b05b-4abd-9a5a-dedc17adf5fe None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:25.191843 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01bb5b-34ab-4fe9-8353-a027e0b44477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:25.192549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01bb5b-34ab-4fe9-8353-a027e0b44477 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:25.192832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01bb5b-34ab-4fe9-8353-a027e0b44477 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:25.193114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01bb5b-34ab-4fe9-8353-a027e0b44477 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:25.193818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01bb5b-34ab-4fe9-8353-a027e0b44477 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:25.195244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01bb5b-34ab-4fe9-8353-a027e0b44477 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:25.214022 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 586/1177] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:12:25 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:12:27.292347 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9587e5-aa9f-45c0-9391-85d5e7bb9f6b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:27.292894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9587e5-aa9f-45c0-9391-85d5e7bb9f6b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:27.292894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9587e5-aa9f-45c0-9391-85d5e7bb9f6b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:27.294256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 592/1178] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:27.299870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f60e-ed72-43bf-a25e-ed3449c34b3a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:27.300319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f60e-ed72-43bf-a25e-ed3449c34b3a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:27.300463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f60e-ed72-43bf-a25e-ed3449c34b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:27.317550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-68c8f60e-ed72-43bf-a25e-ed3449c34b3a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:27.318731 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-68c8f60e-ed72-43bf-a25e-ed3449c34b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:27.371157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:27.385343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 587/1179] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:27.409519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9587e5-aa9f-45c0-9391-85d5e7bb9f6b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:27.510855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9587e5-aa9f-45c0-9391-85d5e7bb9f6b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:27.546080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf05e0-b7a7-4852-b2bf-bf7825e46de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:27.546780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf05e0-b7a7-4852-b2bf-bf7825e46de8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:27.547063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf05e0-b7a7-4852-b2bf-bf7825e46de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:27.547337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf05e0-b7a7-4852-b2bf-bf7825e46de8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:27.557698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf05e0-b7a7-4852-b2bf-bf7825e46de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c4cf05e0-b7a7-4852-b2bf-bf7825e46de8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:12:27.565872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:12:27.567046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:12:27.568191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 593/1180] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:12:27.573018 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8f60e-ed72-43bf-a25e-ed3449c34b3a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:27.667398 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8f60e-ed72-43bf-a25e-ed3449c34b3a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:27.700919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a12204-aeb9-484b-bbb0-fe1f793b04a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:27.701582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a12204-aeb9-484b-bbb0-fe1f793b04a8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:27.701868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a12204-aeb9-484b-bbb0-fe1f793b04a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:27.702148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a12204-aeb9-484b-bbb0-fe1f793b04a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:27.702891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a12204-aeb9-484b-bbb0-fe1f793b04a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:27.703198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a12204-aeb9-484b-bbb0-fe1f793b04a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:27.704593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a12204-aeb9-484b-bbb0-fe1f793b04a8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:27.712455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 588/1181] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:12:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:12:27.718228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf05e0-b7a7-4852-b2bf-bf7825e46de8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:27.748965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:27.816878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf05e0-b7a7-4852-b2bf-bf7825e46de8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:27.849871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b4106-a160-4b7f-861f-3a05e1448974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:27.850732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b4106-a160-4b7f-861f-3a05e1448974 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:27.851015 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b4106-a160-4b7f-861f-3a05e1448974 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:27.851285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b4106-a160-4b7f-861f-3a05e1448974 None admin] PATH_INFO: `/v3/users/9931f18aae154f028ce9319eefe28709` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:27.863898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b4106-a160-4b7f-861f-3a05e1448974 None admin] RBAC: Authorizing `identity:get_user(user_id=9931f18aae154f028ce9319eefe28709)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:27.865359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b4106-a160-4b7f-861f-3a05e1448974 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:27.867032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 594/1182] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:12:27 2022] GET /identity/v3/users/9931f18aae154f028ce9319eefe28709 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:27.872801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a12204-aeb9-484b-bbb0-fe1f793b04a8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:27.921767 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:27.971510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a12204-aeb9-484b-bbb0-fe1f793b04a8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:28.004693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6ca98-02a8-4bc3-817a-c146da0470f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:28.005525 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6ca98-02a8-4bc3-817a-c146da0470f8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:28.005805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6ca98-02a8-4bc3-817a-c146da0470f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:28.006078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6ca98-02a8-4bc3-817a-c146da0470f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:28.072765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6ca98-02a8-4bc3-817a-c146da0470f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:28.074136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6ca98-02a8-4bc3-817a-c146da0470f8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:28.120510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:28.170487 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 589/1183] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:12:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:12:28.176884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b4106-a160-4b7f-861f-3a05e1448974 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:28.263131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:28.273518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b4106-a160-4b7f-861f-3a05e1448974 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:28.307062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e1be5-cd37-44dc-b7a8-859272fc1106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:28.307911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1be5-cd37-44dc-b7a8-859272fc1106 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:28.308219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1be5-cd37-44dc-b7a8-859272fc1106 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:28.308502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e1be5-cd37-44dc-b7a8-859272fc1106 None admin] PATH_INFO: `/v3/projects/8def8309076f44d19dcec4687c323f7d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:28.309664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e1be5-cd37-44dc-b7a8-859272fc1106 None admin] RBAC: Authorizing `identity:get_project(project_id=8def8309076f44d19dcec4687c323f7d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:28.311108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e1be5-cd37-44dc-b7a8-859272fc1106 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:28.312841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 595/1184] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:12:28 2022] GET /identity/v3/projects/8def8309076f44d19dcec4687c323f7d => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:28.319164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6ca98-02a8-4bc3-817a-c146da0470f8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:28.416599 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6ca98-02a8-4bc3-817a-c146da0470f8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:28.449394 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f398a9-5aa8-436a-81bf-78e7ee4dae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:28.450039 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f398a9-5aa8-436a-81bf-78e7ee4dae24 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:28.450325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f398a9-5aa8-436a-81bf-78e7ee4dae24 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:28.450607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f398a9-5aa8-436a-81bf-78e7ee4dae24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:28.451438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f398a9-5aa8-436a-81bf-78e7ee4dae24 None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=8def8309076f44d19dcec4687c323f7d, user.id=9931f18aae154f028ce9319eefe28709) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:28.451755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f398a9-5aa8-436a-81bf-78e7ee4dae24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:28.453235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f398a9-5aa8-436a-81bf-78e7ee4dae24 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:28.459136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 590/1185] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:12:28 2022] GET /identity/v3/role_assignments?user.id=9931f18aae154f028ce9319eefe28709&scope.project.id=8def8309076f44d19dcec4687c323f7d&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:30.474374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9ceae-ec40-42a2-b275-edbcae31dead None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:30.474937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9ceae-ec40-42a2-b275-edbcae31dead None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:30.474937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9ceae-ec40-42a2-b275-edbcae31dead None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:30.476324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 596/1186] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:30.481725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91933-a97c-4ad8-aa19-970a055c8a48 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:30.482129 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91933-a97c-4ad8-aa19-970a055c8a48 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:30.482287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91933-a97c-4ad8-aa19-970a055c8a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:30.499177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6bc91933-a97c-4ad8-aa19-970a055c8a48 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:30.500386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6bc91933-a97c-4ad8-aa19-970a055c8a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:30.509552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:30.567189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 591/1187] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:12:30.591924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9ceae-ec40-42a2-b275-edbcae31dead None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:30.691655 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9ceae-ec40-42a2-b275-edbcae31dead None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:30.729808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff0a70-1d3a-45e4-a092-447b46adeb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:30.730532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff0a70-1d3a-45e4-a092-447b46adeb06 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:30.730822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff0a70-1d3a-45e4-a092-447b46adeb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:30.731097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff0a70-1d3a-45e4-a092-447b46adeb06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:30.741541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff0a70-1d3a-45e4-a092-447b46adeb06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-afff0a70-1d3a-45e4-a092-447b46adeb06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:12:30.749087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:12:30.750204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:12:30.751115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 597/1188] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:12:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:12:30.757059 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc91933-a97c-4ad8-aa19-970a055c8a48 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:30.852232 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc91933-a97c-4ad8-aa19-970a055c8a48 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:30.885434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42153ea4-6f14-4bc8-8e4e-4ccb9d78ce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:30.886090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42153ea4-6f14-4bc8-8e4e-4ccb9d78ce1e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:30.886375 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42153ea4-6f14-4bc8-8e4e-4ccb9d78ce1e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:30.886653 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42153ea4-6f14-4bc8-8e4e-4ccb9d78ce1e None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:30.887394 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42153ea4-6f14-4bc8-8e4e-4ccb9d78ce1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:30.887703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42153ea4-6f14-4bc8-8e4e-4ccb9d78ce1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:30.889098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42153ea4-6f14-4bc8-8e4e-4ccb9d78ce1e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:30.897755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 592/1189] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:12:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:30.903591 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff0a70-1d3a-45e4-a092-447b46adeb06 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:30.923127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:31.004734 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff0a70-1d3a-45e4-a092-447b46adeb06 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:31.038385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a24dff-d581-4083-9ede-04dfc9ebc785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:31.039249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24dff-d581-4083-9ede-04dfc9ebc785 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:31.039526 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24dff-d581-4083-9ede-04dfc9ebc785 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:31.039798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24dff-d581-4083-9ede-04dfc9ebc785 None admin] PATH_INFO: `/v3/users/9931f18aae154f028ce9319eefe28709` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:31.041002 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a24dff-d581-4083-9ede-04dfc9ebc785 None admin] RBAC: Authorizing `identity:get_user(user_id=9931f18aae154f028ce9319eefe28709)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:31.042428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a24dff-d581-4083-9ede-04dfc9ebc785 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:31.044071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 598/1190] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:12:30 2022] GET /identity/v3/users/9931f18aae154f028ce9319eefe28709 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:31.050550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42153ea4-6f14-4bc8-8e4e-4ccb9d78ce1e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:31.060217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:31.150862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42153ea4-6f14-4bc8-8e4e-4ccb9d78ce1e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:31.182544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06839117-9764-4d95-9dfb-f51946776deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:31.183390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839117-9764-4d95-9dfb-f51946776deb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:31.183679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839117-9764-4d95-9dfb-f51946776deb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:31.183952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839117-9764-4d95-9dfb-f51946776deb None admin] PATH_INFO: `/v3/projects/8def8309076f44d19dcec4687c323f7d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:31.185163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06839117-9764-4d95-9dfb-f51946776deb None admin] RBAC: Authorizing `identity:get_project(project_id=8def8309076f44d19dcec4687c323f7d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:31.186593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06839117-9764-4d95-9dfb-f51946776deb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:31.188337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 593/1191] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:12:31 2022] GET /identity/v3/projects/8def8309076f44d19dcec4687c323f7d => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:12:31.194732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a24dff-d581-4083-9ede-04dfc9ebc785 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:31.278325 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:31.292620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a24dff-d581-4083-9ede-04dfc9ebc785 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:31.325038 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0d1a5-78f3-4f69-a64c-b49d73ed4f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:31.325908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0d1a5-78f3-4f69-a64c-b49d73ed4f15 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:31.326187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0d1a5-78f3-4f69-a64c-b49d73ed4f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:31.326459 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0d1a5-78f3-4f69-a64c-b49d73ed4f15 None admin] PATH_INFO: `/v3/projects/8def8309076f44d19dcec4687c323f7d/users/9931f18aae154f028ce9319eefe28709/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:31.328386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0d1a5-78f3-4f69-a64c-b49d73ed4f15 None admin] RBAC: Authorizing `identity:create_grant(project_id=8def8309076f44d19dcec4687c323f7d, user_id=9931f18aae154f028ce9319eefe28709, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:31.329806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0d1a5-78f3-4f69-a64c-b49d73ed4f15 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:31.342568 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 599/1192] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:12:31 2022] PUT /identity/v3/projects/8def8309076f44d19dcec4687c323f7d/users/9931f18aae154f028ce9319eefe28709/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:12:33.353277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e3e06-a2fd-4e60-934c-c33f735e0b35 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:33.353831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e3e06-a2fd-4e60-934c-c33f735e0b35 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:33.353831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e3e06-a2fd-4e60-934c-c33f735e0b35 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:33.355332 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 594/1193] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:12:33.360510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8612-729d-415d-9480-c4a2ffdead80 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:33.360901 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8612-729d-415d-9480-c4a2ffdead80 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:33.361080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8612-729d-415d-9480-c4a2ffdead80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:33.377994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ef4e8612-729d-415d-9480-c4a2ffdead80 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:12:33.379183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ef4e8612-729d-415d-9480-c4a2ffdead80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:12:33.444707 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 600/1194] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:12:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:12:33.468492 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e3e06-a2fd-4e60-934c-c33f735e0b35 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:33.544207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:33.571283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e3e06-a2fd-4e60-934c-c33f735e0b35 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:33.605140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b56ec-d955-41c7-8d02-c1e1dad36778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:33.605849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b56ec-d955-41c7-8d02-c1e1dad36778 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:33.606131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b56ec-d955-41c7-8d02-c1e1dad36778 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:33.606407 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b56ec-d955-41c7-8d02-c1e1dad36778 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:33.616660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b56ec-d955-41c7-8d02-c1e1dad36778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-130b56ec-d955-41c7-8d02-c1e1dad36778 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:12:33.624188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:12:33.625360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:12:33.626238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 595/1195] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:12:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:12:33.631376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e8612-729d-415d-9480-c4a2ffdead80 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:33.708274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:33.731545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e8612-729d-415d-9480-c4a2ffdead80 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:33.764847 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69af97-1d85-4314-b31c-54e02d4f9b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:33.765514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69af97-1d85-4314-b31c-54e02d4f9b90 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:33.765801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69af97-1d85-4314-b31c-54e02d4f9b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:33.766080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69af97-1d85-4314-b31c-54e02d4f9b90 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:33.766831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69af97-1d85-4314-b31c-54e02d4f9b90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:33.767147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69af97-1d85-4314-b31c-54e02d4f9b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:33.769097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69af97-1d85-4314-b31c-54e02d4f9b90 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:33.777134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 601/1196] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:12:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:33.783040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b56ec-d955-41c7-8d02-c1e1dad36778 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:33.879942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b56ec-d955-41c7-8d02-c1e1dad36778 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:33.913303 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b89ae-f8da-455e-8a9d-09d5b626f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:33.914158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b89ae-f8da-455e-8a9d-09d5b626f00c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:33.914444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b89ae-f8da-455e-8a9d-09d5b626f00c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:33.914721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b89ae-f8da-455e-8a9d-09d5b626f00c None admin] PATH_INFO: `/v3/users/9931f18aae154f028ce9319eefe28709` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:33.915922 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b89ae-f8da-455e-8a9d-09d5b626f00c None admin] RBAC: Authorizing `identity:get_user(user_id=9931f18aae154f028ce9319eefe28709)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:33.917509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b89ae-f8da-455e-8a9d-09d5b626f00c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:33.919144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 596/1197] 10.222.0.66 () {56 vars in 1177 bytes} [Wed Jun 22 12:12:33 2022] GET /identity/v3/users/9931f18aae154f028ce9319eefe28709 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:33.924922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69af97-1d85-4314-b31c-54e02d4f9b90 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:34.023244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69af97-1d85-4314-b31c-54e02d4f9b90 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:34.055732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c65762-07e3-4d57-bc9d-c24f7266b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:34.056396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c65762-07e3-4d57-bc9d-c24f7266b856 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:34.056678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c65762-07e3-4d57-bc9d-c24f7266b856 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:34.056950 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c65762-07e3-4d57-bc9d-c24f7266b856 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:34.065132 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:34.122273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c65762-07e3-4d57-bc9d-c24f7266b856 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:34.123707 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c65762-07e3-4d57-bc9d-c24f7266b856 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:34.217330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 602/1198] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:12:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:12:34.223734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b89ae-f8da-455e-8a9d-09d5b626f00c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:34.226614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:34.322281 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b89ae-f8da-455e-8a9d-09d5b626f00c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:34.355005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fbd1d-e9d0-45d0-87cb-321197e4df6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:34.355855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fbd1d-e9d0-45d0-87cb-321197e4df6d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:34.356172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fbd1d-e9d0-45d0-87cb-321197e4df6d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:34.356455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fbd1d-e9d0-45d0-87cb-321197e4df6d None admin] PATH_INFO: `/v3/projects/8def8309076f44d19dcec4687c323f7d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:34.357631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fbd1d-e9d0-45d0-87cb-321197e4df6d None admin] RBAC: Authorizing `identity:get_project(project_id=8def8309076f44d19dcec4687c323f7d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:34.359050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fbd1d-e9d0-45d0-87cb-321197e4df6d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:34.360787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 597/1199] 10.222.0.66 () {56 vars in 1186 bytes} [Wed Jun 22 12:12:34 2022] GET /identity/v3/projects/8def8309076f44d19dcec4687c323f7d => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:34.367344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c65762-07e3-4d57-bc9d-c24f7266b856 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:12:34.405955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:34.466625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c65762-07e3-4d57-bc9d-c24f7266b856 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:12:34.500952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16864a55-6147-4680-9fa3-8aa6ff9e71d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:12:34.501525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16864a55-6147-4680-9fa3-8aa6ff9e71d7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:12:34.501868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16864a55-6147-4680-9fa3-8aa6ff9e71d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:12:34.502651 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16864a55-6147-4680-9fa3-8aa6ff9e71d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:12:34.503482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16864a55-6147-4680-9fa3-8aa6ff9e71d7 None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=8def8309076f44d19dcec4687c323f7d, user.id=9931f18aae154f028ce9319eefe28709) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:12:34.503799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16864a55-6147-4680-9fa3-8aa6ff9e71d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:12:34.505303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16864a55-6147-4680-9fa3-8aa6ff9e71d7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:12:34.511143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 603/1200] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:12:34 2022] GET /identity/v3/role_assignments?user.id=9931f18aae154f028ce9319eefe28709&scope.project.id=8def8309076f44d19dcec4687c323f7d&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:12:44.350907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=65 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:12:44.508460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=49 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:30.986486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34097f4e-172d-4661-9a63-408c0a2a79ed None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:30.986486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34097f4e-172d-4661-9a63-408c0a2a79ed None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:30.986486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34097f4e-172d-4661-9a63-408c0a2a79ed None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:30.987603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 598/1201] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:13:30.995384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d80956-0368-465e-ad56-931e435ba0d8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:30.995966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d80956-0368-465e-ad56-931e435ba0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:30.996185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d80956-0368-465e-ad56-931e435ba0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:31.019169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-05d80956-0368-465e-ad56-931e435ba0d8 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:13:31.020838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-05d80956-0368-465e-ad56-931e435ba0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:13:31.133287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 604/1202] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:13:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 12:13:31.158862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34097f4e-172d-4661-9a63-408c0a2a79ed None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:31.310122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34097f4e-172d-4661-9a63-408c0a2a79ed None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:31.366493 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c69d42-09a4-44b8-99d0-56a341ac81ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:31.367723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c69d42-09a4-44b8-99d0-56a341ac81ed None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:31.367993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c69d42-09a4-44b8-99d0-56a341ac81ed None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:31.368468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c69d42-09a4-44b8-99d0-56a341ac81ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:31.381491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c69d42-09a4-44b8-99d0-56a341ac81ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:31.383479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c69d42-09a4-44b8-99d0-56a341ac81ed None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-b9c69d42-09a4-44b8-99d0-56a341ac81ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:31.403686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:31.405029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:31.406473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:31.406473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:31.406473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:31.406473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:31.413632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 599/1203] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:31.419707 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d80956-0368-465e-ad56-931e435ba0d8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:31.608262 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d80956-0368-465e-ad56-931e435ba0d8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:31.658916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:31.670788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e96de-00f5-472d-b0e8-55ce039a14ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:31.672178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e96de-00f5-472d-b0e8-55ce039a14ba None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:31.672665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e96de-00f5-472d-b0e8-55ce039a14ba None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:31.673149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e96de-00f5-472d-b0e8-55ce039a14ba None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:31.674530 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e96de-00f5-472d-b0e8-55ce039a14ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:31.674905 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e96de-00f5-472d-b0e8-55ce039a14ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:31.676947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e96de-00f5-472d-b0e8-55ce039a14ba None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:31.693554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 605/1204] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:31.699108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c69d42-09a4-44b8-99d0-56a341ac81ed None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:31.771814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:31.830377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c69d42-09a4-44b8-99d0-56a341ac81ed None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:31.871212 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c6982-492d-492c-a1f4-17d40257f610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:31.872134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c6982-492d-492c-a1f4-17d40257f610 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:31.872438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c6982-492d-492c-a1f4-17d40257f610 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:31.872752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c6982-492d-492c-a1f4-17d40257f610 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:31.873614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c6982-492d-492c-a1f4-17d40257f610 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:31.878214 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c6982-492d-492c-a1f4-17d40257f610 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:31.904070 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 600/1205] 10.222.0.66 () {60 vars in 1132 bytes} [Wed Jun 22 12:13:31 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:13:34.521376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169106b-902e-4f89-8501-86e11b525381 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:34.521997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169106b-902e-4f89-8501-86e11b525381 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:34.521997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169106b-902e-4f89-8501-86e11b525381 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:34.523342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 606/1206] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:13:34.530985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ca133-3da7-4bec-b09a-13c8c21367bb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:34.530985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ca133-3da7-4bec-b09a-13c8c21367bb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:34.530985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ca133-3da7-4bec-b09a-13c8c21367bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:34.552692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-831ca133-3da7-4bec-b09a-13c8c21367bb None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:13:34.554203 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-831ca133-3da7-4bec-b09a-13c8c21367bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:13:34.657168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 601/1207] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:13:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:13:34.685131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169106b-902e-4f89-8501-86e11b525381 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:34.861409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169106b-902e-4f89-8501-86e11b525381 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:34.922788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb45b5d-54b3-4f20-8ce0-c54416a81103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:34.924091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb45b5d-54b3-4f20-8ce0-c54416a81103 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:34.924582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb45b5d-54b3-4f20-8ce0-c54416a81103 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:34.925152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb45b5d-54b3-4f20-8ce0-c54416a81103 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:34.946794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb45b5d-54b3-4f20-8ce0-c54416a81103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9eb45b5d-54b3-4f20-8ce0-c54416a81103 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:13:34.963236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:34.964377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:13:34.965233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:34.965904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 607/1208] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:13:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:34.976036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ca133-3da7-4bec-b09a-13c8c21367bb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:35.055075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:35.181234 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ca133-3da7-4bec-b09a-13c8c21367bb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:35.238497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942e82-70e0-4f5a-98a9-7794acfc9ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:35.239707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942e82-70e0-4f5a-98a9-7794acfc9ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:35.240079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942e82-70e0-4f5a-98a9-7794acfc9ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:35.240368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942e82-70e0-4f5a-98a9-7794acfc9ff8 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:35.241226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49942e82-70e0-4f5a-98a9-7794acfc9ff8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:35.241606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49942e82-70e0-4f5a-98a9-7794acfc9ff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:35.243154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49942e82-70e0-4f5a-98a9-7794acfc9ff8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:35.254536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 602/1209] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:13:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:35.266090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb45b5d-54b3-4f20-8ce0-c54416a81103 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:35.366664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:35.433678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb45b5d-54b3-4f20-8ce0-c54416a81103 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:35.472866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd8d33-2280-41ed-aa0c-acfc638dbab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:35.474006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd8d33-2280-41ed-aa0c-acfc638dbab3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:35.474006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd8d33-2280-41ed-aa0c-acfc638dbab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:35.474323 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd8d33-2280-41ed-aa0c-acfc638dbab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:35.487645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd8d33-2280-41ed-aa0c-acfc638dbab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:35.489370 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd8d33-2280-41ed-aa0c-acfc638dbab3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-bcbd8d33-2280-41ed-aa0c-acfc638dbab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:35.512572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:35.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:35.520541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:35.520541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:35.520541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:35.520541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:35.520541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 608/1210] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:13:35.525315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942e82-70e0-4f5a-98a9-7794acfc9ff8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:35.648049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:35.651817 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942e82-70e0-4f5a-98a9-7794acfc9ff8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:35.693847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b65a-bca6-412c-b29b-260c89f43cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:35.694428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b65a-bca6-412c-b29b-260c89f43cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:35.694715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b65a-bca6-412c-b29b-260c89f43cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:35.694990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b65a-bca6-412c-b29b-260c89f43cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:35.695721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81b65a-bca6-412c-b29b-260c89f43cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:35.696047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81b65a-bca6-412c-b29b-260c89f43cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:35.697443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81b65a-bca6-412c-b29b-260c89f43cc2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:35.712466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 603/1211] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:35.719772 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd8d33-2280-41ed-aa0c-acfc638dbab3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:35.849389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd8d33-2280-41ed-aa0c-acfc638dbab3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:35.851712 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:35.895405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89415a-8d16-410c-a590-84f6c2ab5eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:35.896373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89415a-8d16-410c-a590-84f6c2ab5eea None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:35.896839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89415a-8d16-410c-a590-84f6c2ab5eea None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:35.897018 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89415a-8d16-410c-a590-84f6c2ab5eea None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:35.908035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89415a-8d16-410c-a590-84f6c2ab5eea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:35.909621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89415a-8d16-410c-a590-84f6c2ab5eea None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0f89415a-8d16-410c-a590-84f6c2ab5eea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:13:35.927145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:35.928555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:35.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:35.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:35.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:13:35.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:13:35.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:13:35.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:13:35.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:13:35.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:13:35.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:35.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:35.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 609/1212] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:35.934654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b65a-bca6-412c-b29b-260c89f43cc2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:36.077601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b65a-bca6-412c-b29b-260c89f43cc2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:36.119637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1e9bd-965f-4877-ad0d-50a17b1de13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:36.120343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1e9bd-965f-4877-ad0d-50a17b1de13c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:36.121382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1e9bd-965f-4877-ad0d-50a17b1de13c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:36.121382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1e9bd-965f-4877-ad0d-50a17b1de13c None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:36.121745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1e9bd-965f-4877-ad0d-50a17b1de13c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:36.122368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1e9bd-965f-4877-ad0d-50a17b1de13c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:36.123460 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1e9bd-965f-4877-ad0d-50a17b1de13c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:36.144035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 604/1213] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 12:13:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:36.149879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89415a-8d16-410c-a590-84f6c2ab5eea None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:36.275365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89415a-8d16-410c-a590-84f6c2ab5eea None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:36.343428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e83d24-7fad-4644-b3de-8847e3b6f887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:36.344532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e83d24-7fad-4644-b3de-8847e3b6f887 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:36.345115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e83d24-7fad-4644-b3de-8847e3b6f887 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:36.345752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e83d24-7fad-4644-b3de-8847e3b6f887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:36.404748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:36.459070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e83d24-7fad-4644-b3de-8847e3b6f887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:36.460867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e83d24-7fad-4644-b3de-8847e3b6f887 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:36.629719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 610/1214] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:13:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:13:36.633066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1e9bd-965f-4877-ad0d-50a17b1de13c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:36.660680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:36.783950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1e9bd-965f-4877-ad0d-50a17b1de13c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:36.854098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e902691-a14a-43c9-9797-b5b29064cf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:36.855509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e902691-a14a-43c9-9797-b5b29064cf24 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:36.856060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e902691-a14a-43c9-9797-b5b29064cf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:36.856573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e902691-a14a-43c9-9797-b5b29064cf24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:36.876981 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e902691-a14a-43c9-9797-b5b29064cf24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:36.880288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e902691-a14a-43c9-9797-b5b29064cf24 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-0e902691-a14a-43c9-9797-b5b29064cf24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:36.915669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:36.916903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:36.918189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:36.918189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:36.918189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:36.918189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:36.918189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 605/1215] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:36.924385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e83d24-7fad-4644-b3de-8847e3b6f887 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:37.000322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:37.048543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e83d24-7fad-4644-b3de-8847e3b6f887 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:37.097217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437f0e2-8cc3-4ffd-ba77-ae820e278c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:37.098333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437f0e2-8cc3-4ffd-ba77-ae820e278c8c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:37.098749 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437f0e2-8cc3-4ffd-ba77-ae820e278c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:37.099267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437f0e2-8cc3-4ffd-ba77-ae820e278c8c None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:37.100732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437f0e2-8cc3-4ffd-ba77-ae820e278c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:37.101439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437f0e2-8cc3-4ffd-ba77-ae820e278c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:37.103811 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437f0e2-8cc3-4ffd-ba77-ae820e278c8c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:37.121058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 611/1216] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:37.128640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e902691-a14a-43c9-9797-b5b29064cf24 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:37.220195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:37.258181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e902691-a14a-43c9-9797-b5b29064cf24 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:37.314007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368e110-4383-4d49-aab8-900685d70551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:37.315688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368e110-4383-4d49-aab8-900685d70551 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:37.316246 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368e110-4383-4d49-aab8-900685d70551 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:37.316756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368e110-4383-4d49-aab8-900685d70551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:37.330318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368e110-4383-4d49-aab8-900685d70551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:37.333075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368e110-4383-4d49-aab8-900685d70551 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-b368e110-4383-4d49-aab8-900685d70551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:13:37.360806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:37.362292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:37.368153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:13:37.368153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:13:37.368153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:13:37.368153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:13:37.368153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:13:37.368153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:13:37.368153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:13:37.368153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:37.368153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 606/1217] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:13:37.368852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437f0e2-8cc3-4ffd-ba77-ae820e278c8c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:37.489928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437f0e2-8cc3-4ffd-ba77-ae820e278c8c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:37.534084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:37.551687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff759e-076b-4917-b5f8-63c156189ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:37.552809 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff759e-076b-4917-b5f8-63c156189ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:37.553365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff759e-076b-4917-b5f8-63c156189ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:37.553878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff759e-076b-4917-b5f8-63c156189ba4 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:37.554647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff759e-076b-4917-b5f8-63c156189ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:37.555008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff759e-076b-4917-b5f8-63c156189ba4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:37.557033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff759e-076b-4917-b5f8-63c156189ba4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:37.577913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 612/1218] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:37.584361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368e110-4383-4d49-aab8-900685d70551 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:37.712501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368e110-4383-4d49-aab8-900685d70551 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:37.745601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:37.752842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c40b8b-a4c7-4fca-a42d-3bde1940538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:37.753510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c40b8b-a4c7-4fca-a42d-3bde1940538b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:37.753958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c40b8b-a4c7-4fca-a42d-3bde1940538b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:37.754246 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c40b8b-a4c7-4fca-a42d-3bde1940538b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:37.755206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c40b8b-a4c7-4fca-a42d-3bde1940538b None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=c89ae81d49214b75a747a6cfa3ddf0ba) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:37.755581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c40b8b-a4c7-4fca-a42d-3bde1940538b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:37.757279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c40b8b-a4c7-4fca-a42d-3bde1940538b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:37.776331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 607/1219] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:13:37 2022] GET /identity/v3/role_assignments?user.id=c89ae81d49214b75a747a6cfa3ddf0ba&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:39.956799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b735e-4ae7-4965-aa7e-415a39c34bd2 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:39.957415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b735e-4ae7-4965-aa7e-415a39c34bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:39.957415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b735e-4ae7-4965-aa7e-415a39c34bd2 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:39.959094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 613/1220] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:13:39.965687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3515ce-9a4b-486d-bc8e-a299d39d9fcb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:39.966236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3515ce-9a4b-486d-bc8e-a299d39d9fcb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:39.966461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3515ce-9a4b-486d-bc8e-a299d39d9fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:39.989638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ad3515ce-9a4b-486d-bc8e-a299d39d9fcb None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:13:39.990930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ad3515ce-9a4b-486d-bc8e-a299d39d9fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:13:40.072514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 608/1221] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:13:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:13:40.099458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b735e-4ae7-4965-aa7e-415a39c34bd2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:40.219891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b735e-4ae7-4965-aa7e-415a39c34bd2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:40.263654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526e0d8-984b-4604-9a2d-2f5757604386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:40.264850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526e0d8-984b-4604-9a2d-2f5757604386 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:40.265162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526e0d8-984b-4604-9a2d-2f5757604386 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:40.265471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526e0d8-984b-4604-9a2d-2f5757604386 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:40.277373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526e0d8-984b-4604-9a2d-2f5757604386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9526e0d8-984b-4604-9a2d-2f5757604386 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:13:40.285404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:40.286750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:40.287779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 614/1222] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:40.293167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3515ce-9a4b-486d-bc8e-a299d39d9fcb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:40.407993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3515ce-9a4b-486d-bc8e-a299d39d9fcb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:40.439357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:40.462303 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833f6da-4cb7-4972-bd42-7cd13384f06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:40.463415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833f6da-4cb7-4972-bd42-7cd13384f06c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:40.463927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833f6da-4cb7-4972-bd42-7cd13384f06c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:40.464456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833f6da-4cb7-4972-bd42-7cd13384f06c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:40.465891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833f6da-4cb7-4972-bd42-7cd13384f06c None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:40.466438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833f6da-4cb7-4972-bd42-7cd13384f06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:40.469686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833f6da-4cb7-4972-bd42-7cd13384f06c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:40.485215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 609/1223] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:40.491610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526e0d8-984b-4604-9a2d-2f5757604386 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:40.552691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:40.622183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526e0d8-984b-4604-9a2d-2f5757604386 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:40.664195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514d2f5-fa04-4749-8dc4-a1353105e11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:40.664979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514d2f5-fa04-4749-8dc4-a1353105e11b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:40.665264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514d2f5-fa04-4749-8dc4-a1353105e11b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:40.665538 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514d2f5-fa04-4749-8dc4-a1353105e11b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:40.679061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514d2f5-fa04-4749-8dc4-a1353105e11b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:40.680707 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514d2f5-fa04-4749-8dc4-a1353105e11b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f514d2f5-fa04-4749-8dc4-a1353105e11b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:40.699660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:40.700722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:40.701826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:40.701826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:40.701826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:40.701826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:40.701826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 615/1224] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:40.707816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833f6da-4cb7-4972-bd42-7cd13384f06c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:40.822747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833f6da-4cb7-4972-bd42-7cd13384f06c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:40.868266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048f575-6531-44b8-8619-6e71b81b0613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:40.868971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048f575-6531-44b8-8619-6e71b81b0613 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:40.869232 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048f575-6531-44b8-8619-6e71b81b0613 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:40.869535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048f575-6531-44b8-8619-6e71b81b0613 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:40.870269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048f575-6531-44b8-8619-6e71b81b0613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:40.870572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048f575-6531-44b8-8619-6e71b81b0613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:40.872065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048f575-6531-44b8-8619-6e71b81b0613 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:40.891121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 610/1225] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:40.897139 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514d2f5-fa04-4749-8dc4-a1353105e11b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:41.024777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:41.032747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514d2f5-fa04-4749-8dc4-a1353105e11b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:41.080930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559b1de-4136-46b4-921e-777cc3ac5119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:41.081753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559b1de-4136-46b4-921e-777cc3ac5119 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:41.082031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559b1de-4136-46b4-921e-777cc3ac5119 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:41.082306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559b1de-4136-46b4-921e-777cc3ac5119 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:41.091842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559b1de-4136-46b4-921e-777cc3ac5119 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:41.094053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559b1de-4136-46b4-921e-777cc3ac5119 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0559b1de-4136-46b4-921e-777cc3ac5119 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:13:41.109989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:41.111100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:41.112467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:41.112467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:41.112467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:13:41.112467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:13:41.112467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:13:41.112467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:13:41.112467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:13:41.112467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:13:41.112467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:41.112467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:41.112467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 616/1226] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:13:41.117365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048f575-6531-44b8-8619-6e71b81b0613 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:41.174316 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:41.230508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048f575-6531-44b8-8619-6e71b81b0613 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:41.268701 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06357fb-4d1d-459b-bffe-3970486c63ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:41.269372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06357fb-4d1d-459b-bffe-3970486c63ed None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:41.269657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06357fb-4d1d-459b-bffe-3970486c63ed None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:41.269936 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06357fb-4d1d-459b-bffe-3970486c63ed None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:41.270776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06357fb-4d1d-459b-bffe-3970486c63ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:41.271084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06357fb-4d1d-459b-bffe-3970486c63ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:41.272928 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06357fb-4d1d-459b-bffe-3970486c63ed None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:41.294090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 611/1227] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 12:13:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:41.300634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559b1de-4136-46b4-921e-777cc3ac5119 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:41.432003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559b1de-4136-46b4-921e-777cc3ac5119 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:41.477807 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3897cea-d933-4af0-bcdf-5f3c6acd6351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:41.479112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3897cea-d933-4af0-bcdf-5f3c6acd6351 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:41.479565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3897cea-d933-4af0-bcdf-5f3c6acd6351 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:41.479982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3897cea-d933-4af0-bcdf-5f3c6acd6351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:41.497991 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3897cea-d933-4af0-bcdf-5f3c6acd6351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:41.500953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3897cea-d933-4af0-bcdf-5f3c6acd6351 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e3897cea-d933-4af0-bcdf-5f3c6acd6351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:41.532482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:41.533685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:41.535135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:41.535135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:41.535135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:41.535135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:41.535135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 617/1228] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:41.543565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06357fb-4d1d-459b-bffe-3970486c63ed None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:41.678811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06357fb-4d1d-459b-bffe-3970486c63ed None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:41.683120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:41.721254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d535-bd8e-4a36-b723-3e8d7a7ba2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:41.721932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d535-bd8e-4a36-b723-3e8d7a7ba2fa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:41.722222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d535-bd8e-4a36-b723-3e8d7a7ba2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:41.722501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d535-bd8e-4a36-b723-3e8d7a7ba2fa None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:41.723291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d535-bd8e-4a36-b723-3e8d7a7ba2fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:41.723548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d535-bd8e-4a36-b723-3e8d7a7ba2fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:41.725028 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d535-bd8e-4a36-b723-3e8d7a7ba2fa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:41.737604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 612/1229] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:41.744508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3897cea-d933-4af0-bcdf-5f3c6acd6351 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:41.762449 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:41.886974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3897cea-d933-4af0-bcdf-5f3c6acd6351 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:41.942957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fabc8-b0cb-4139-aa86-92dd784d7929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:41.944117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fabc8-b0cb-4139-aa86-92dd784d7929 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:41.944683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fabc8-b0cb-4139-aa86-92dd784d7929 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:41.945096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fabc8-b0cb-4139-aa86-92dd784d7929 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:41.958899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fabc8-b0cb-4139-aa86-92dd784d7929 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:41.961174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fabc8-b0cb-4139-aa86-92dd784d7929 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3a1fabc8-b0cb-4139-aa86-92dd784d7929 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:13:41.979391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:41.981032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:41.982907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:13:41.982907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:13:41.982907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:13:41.982907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:13:41.982907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:13:41.982907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:13:41.982907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:13:41.982907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:41.982907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 618/1230] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:13:41.988678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d535-bd8e-4a36-b723-3e8d7a7ba2fa None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:42.124860 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d535-bd8e-4a36-b723-3e8d7a7ba2fa None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:42.181184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3865fc-03eb-49b7-836a-85ae85b30f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:42.182616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3865fc-03eb-49b7-836a-85ae85b30f39 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:42.183086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3865fc-03eb-49b7-836a-85ae85b30f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:42.183768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3865fc-03eb-49b7-836a-85ae85b30f39 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:42.185653 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3865fc-03eb-49b7-836a-85ae85b30f39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:42.186903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3865fc-03eb-49b7-836a-85ae85b30f39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:42.189562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3865fc-03eb-49b7-836a-85ae85b30f39 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:42.206520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 613/1231] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:42.212898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fabc8-b0cb-4139-aa86-92dd784d7929 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:42.290160 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:42.347186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fabc8-b0cb-4139-aa86-92dd784d7929 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:42.389862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292ffbe-bfea-4f7b-bbe5-c1dbe31038b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:42.390802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292ffbe-bfea-4f7b-bbe5-c1dbe31038b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:42.391137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292ffbe-bfea-4f7b-bbe5-c1dbe31038b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:42.391368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292ffbe-bfea-4f7b-bbe5-c1dbe31038b0 None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/c89ae81d49214b75a747a6cfa3ddf0ba/roles/14d046a572664f94934f225e9a3f3b64` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:42.407378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292ffbe-bfea-4f7b-bbe5-c1dbe31038b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=c89ae81d49214b75a747a6cfa3ddf0ba, role_id=14d046a572664f94934f225e9a3f3b64)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:42.408877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292ffbe-bfea-4f7b-bbe5-c1dbe31038b0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:42.425346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 619/1232] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:13:42 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/c89ae81d49214b75a747a6cfa3ddf0ba/roles/14d046a572664f94934f225e9a3f3b64 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:13:44.590874 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb42f11-27ed-4048-9aae-5f81d4a64e09 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:44.590874 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb42f11-27ed-4048-9aae-5f81d4a64e09 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:44.590874 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb42f11-27ed-4048-9aae-5f81d4a64e09 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:44.592054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 614/1233] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:13:44.597608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e125fd-d9c2-4b9c-82a0-7442443f835d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:44.598605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e125fd-d9c2-4b9c-82a0-7442443f835d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:44.598605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e125fd-d9c2-4b9c-82a0-7442443f835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:44.626895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-67e125fd-d9c2-4b9c-82a0-7442443f835d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:13:44.629072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-67e125fd-d9c2-4b9c-82a0-7442443f835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:13:44.745499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 620/1234] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:13:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:13:44.782107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb42f11-27ed-4048-9aae-5f81d4a64e09 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:44.813274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:44.924706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb42f11-27ed-4048-9aae-5f81d4a64e09 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:44.963969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9993b5-60b9-4932-8a4e-797b8349bba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:44.964807 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9993b5-60b9-4932-8a4e-797b8349bba8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:44.965106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9993b5-60b9-4932-8a4e-797b8349bba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:44.965364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9993b5-60b9-4932-8a4e-797b8349bba8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:44.978751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9993b5-60b9-4932-8a4e-797b8349bba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-4b9993b5-60b9-4932-8a4e-797b8349bba8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:13:44.986994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:44.989096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:44.990557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 615/1235] 10.222.0.66 () {56 vars in 1102 bytes} [Wed Jun 22 12:13:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:44.996637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e125fd-d9c2-4b9c-82a0-7442443f835d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:45.052881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:45.118097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e125fd-d9c2-4b9c-82a0-7442443f835d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:45.162944 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a0faa-1d2d-4a59-be2d-49eb2e33c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:45.163668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a0faa-1d2d-4a59-be2d-49eb2e33c446 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:45.163949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a0faa-1d2d-4a59-be2d-49eb2e33c446 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:45.164259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a0faa-1d2d-4a59-be2d-49eb2e33c446 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:45.165033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a0faa-1d2d-4a59-be2d-49eb2e33c446 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:45.165387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a0faa-1d2d-4a59-be2d-49eb2e33c446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:45.166781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a0faa-1d2d-4a59-be2d-49eb2e33c446 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:45.177565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 621/1236] 10.222.0.66 () {56 vars in 1103 bytes} [Wed Jun 22 12:13:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:45.183398 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9993b5-60b9-4932-8a4e-797b8349bba8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:45.275962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:45.300839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9993b5-60b9-4932-8a4e-797b8349bba8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:45.353157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b2991-40c3-4c03-8702-4c5c9ca68115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:45.354003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b2991-40c3-4c03-8702-4c5c9ca68115 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:45.354300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b2991-40c3-4c03-8702-4c5c9ca68115 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:45.354608 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b2991-40c3-4c03-8702-4c5c9ca68115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:45.368993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b2991-40c3-4c03-8702-4c5c9ca68115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:45.371484 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b2991-40c3-4c03-8702-4c5c9ca68115 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-1c1b2991-40c3-4c03-8702-4c5c9ca68115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:45.400251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:45.401559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:45.402798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:45.402798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:45.402798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:45.402798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:45.402798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 616/1237] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:45.407935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a0faa-1d2d-4a59-be2d-49eb2e33c446 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:45.543257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a0faa-1d2d-4a59-be2d-49eb2e33c446 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:45.556196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:45.586772 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173fb0a-5e42-4330-b027-cff434b82df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:45.587512 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173fb0a-5e42-4330-b027-cff434b82df7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:45.587838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173fb0a-5e42-4330-b027-cff434b82df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:45.588233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173fb0a-5e42-4330-b027-cff434b82df7 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:45.589060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173fb0a-5e42-4330-b027-cff434b82df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:45.589487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173fb0a-5e42-4330-b027-cff434b82df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:45.591284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173fb0a-5e42-4330-b027-cff434b82df7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:45.611660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 622/1238] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:45.612866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b2991-40c3-4c03-8702-4c5c9ca68115 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:45.732517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b2991-40c3-4c03-8702-4c5c9ca68115 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:45.772270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64327386-e3d0-482d-8833-bb7ad24d915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:45.773089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64327386-e3d0-482d-8833-bb7ad24d915e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:45.773376 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64327386-e3d0-482d-8833-bb7ad24d915e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:45.773655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64327386-e3d0-482d-8833-bb7ad24d915e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:45.776844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:45.783216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64327386-e3d0-482d-8833-bb7ad24d915e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:45.786291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64327386-e3d0-482d-8833-bb7ad24d915e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-64327386-e3d0-482d-8833-bb7ad24d915e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:13:45.807890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:45.808970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:45.809920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:45.809920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:45.809920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:13:45.809920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:13:45.809920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:13:45.809920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:13:45.809920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:13:45.809920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:13:45.809920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:45.809920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:45.814294 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 617/1239] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:13:45.816400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173fb0a-5e42-4330-b027-cff434b82df7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:45.962449 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173fb0a-5e42-4330-b027-cff434b82df7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:46.010797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d48c3b-257b-4dc2-890f-5bbd1f802ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:46.011655 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d48c3b-257b-4dc2-890f-5bbd1f802ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:46.012071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d48c3b-257b-4dc2-890f-5bbd1f802ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:46.012463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d48c3b-257b-4dc2-890f-5bbd1f802ed3 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:46.014194 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d48c3b-257b-4dc2-890f-5bbd1f802ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:46.014585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d48c3b-257b-4dc2-890f-5bbd1f802ed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:46.016259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d48c3b-257b-4dc2-890f-5bbd1f802ed3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:46.037817 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 623/1240] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 12:13:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:46.048119 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64327386-e3d0-482d-8833-bb7ad24d915e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:46.169316 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64327386-e3d0-482d-8833-bb7ad24d915e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:46.210802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0b035-f643-49a8-a440-9079beb016d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:46.211502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0b035-f643-49a8-a440-9079beb016d5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:46.211788 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0b035-f643-49a8-a440-9079beb016d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:46.212102 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0b035-f643-49a8-a440-9079beb016d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:46.322343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:46.331444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0b035-f643-49a8-a440-9079beb016d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:46.332975 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0b035-f643-49a8-a440-9079beb016d5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:46.477210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 618/1241] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:13:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 12:13:46.484092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d48c3b-257b-4dc2-890f-5bbd1f802ed3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:46.519302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:46.610314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d48c3b-257b-4dc2-890f-5bbd1f802ed3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:46.653062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ef478-1659-43a7-a0f6-97766ab22d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:46.654223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef478-1659-43a7-a0f6-97766ab22d02 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:46.654223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef478-1659-43a7-a0f6-97766ab22d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:46.655551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ef478-1659-43a7-a0f6-97766ab22d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:46.666200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ef478-1659-43a7-a0f6-97766ab22d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:46.667704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ef478-1659-43a7-a0f6-97766ab22d02 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f04ef478-1659-43a7-a0f6-97766ab22d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:46.687968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:46.693646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:46.694758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:46.694758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:46.694758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:46.694758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:46.694758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 624/1242] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:13:46.695111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0b035-f643-49a8-a440-9079beb016d5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:46.818847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:46.829606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0b035-f643-49a8-a440-9079beb016d5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:46.886331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1de44-6253-46bd-bf4c-5860913dad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:46.887054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1de44-6253-46bd-bf4c-5860913dad2b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:46.887367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1de44-6253-46bd-bf4c-5860913dad2b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:46.887668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1de44-6253-46bd-bf4c-5860913dad2b None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:46.888475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1de44-6253-46bd-bf4c-5860913dad2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:46.889168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1de44-6253-46bd-bf4c-5860913dad2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:46.890532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1de44-6253-46bd-bf4c-5860913dad2b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:46.905735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 619/1243] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:46.912178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ef478-1659-43a7-a0f6-97766ab22d02 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:47.007904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:47.035769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ef478-1659-43a7-a0f6-97766ab22d02 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:47.085688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aa629-b828-4ab1-9bb3-6cdbdf1e6711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:47.086595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa629-b828-4ab1-9bb3-6cdbdf1e6711 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:47.086971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa629-b828-4ab1-9bb3-6cdbdf1e6711 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:47.087380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa629-b828-4ab1-9bb3-6cdbdf1e6711 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:47.097204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aa629-b828-4ab1-9bb3-6cdbdf1e6711 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:47.098891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180aa629-b828-4ab1-9bb3-6cdbdf1e6711 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-180aa629-b828-4ab1-9bb3-6cdbdf1e6711 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:13:47.113935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:47.115907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:47.118094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:13:47.118094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:13:47.118094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:13:47.118094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:13:47.118094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:13:47.118094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:13:47.118094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:13:47.118094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:47.118094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 625/1244] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:13:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:47.121670 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1de44-6253-46bd-bf4c-5860913dad2b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:47.251013 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1de44-6253-46bd-bf4c-5860913dad2b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:47.291668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8734aa-a5c5-4130-81f6-3b04213fa8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:47.292366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8734aa-a5c5-4130-81f6-3b04213fa8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:47.292651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8734aa-a5c5-4130-81f6-3b04213fa8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:47.292936 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8734aa-a5c5-4130-81f6-3b04213fa8a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:47.293763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8734aa-a5c5-4130-81f6-3b04213fa8a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:47.294155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8734aa-a5c5-4130-81f6-3b04213fa8a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:47.295652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8734aa-a5c5-4130-81f6-3b04213fa8a1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:47.312135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 620/1245] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:13:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:47.318717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aa629-b828-4ab1-9bb3-6cdbdf1e6711 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:47.440384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aa629-b828-4ab1-9bb3-6cdbdf1e6711 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:47.481360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f912e6-3f98-48b6-8eb2-01b13499b7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:47.482078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f912e6-3f98-48b6-8eb2-01b13499b7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:47.482315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f912e6-3f98-48b6-8eb2-01b13499b7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:47.482609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f912e6-3f98-48b6-8eb2-01b13499b7c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:47.483988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f912e6-3f98-48b6-8eb2-01b13499b7c1 None admin] RBAC: Adding query filter params (role.id=14d046a572664f94934f225e9a3f3b64, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=c89ae81d49214b75a747a6cfa3ddf0ba) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:47.484454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f912e6-3f98-48b6-8eb2-01b13499b7c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:47.486463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f912e6-3f98-48b6-8eb2-01b13499b7c1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:47.495439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 626/1246] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:13:47 2022] GET /identity/v3/role_assignments?user.id=c89ae81d49214b75a747a6cfa3ddf0ba&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=14d046a572664f94934f225e9a3f3b64 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:49.840770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aa7b9-2523-4268-9cd4-766066fd1fba None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:49.841679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aa7b9-2523-4268-9cd4-766066fd1fba None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:49.841679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aa7b9-2523-4268-9cd4-766066fd1fba None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:49.843694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 621/1247] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:13:49.849485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf665-a2e5-4a30-b767-03726b618696 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:49.850143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf665-a2e5-4a30-b767-03726b618696 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:49.850143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf665-a2e5-4a30-b767-03726b618696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:49.856960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:49.871405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-507bf665-a2e5-4a30-b767-03726b618696 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:13:49.872740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-507bf665-a2e5-4a30-b767-03726b618696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:13:49.954654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 627/1248] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:13:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:13:49.982079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aa7b9-2523-4268-9cd4-766066fd1fba None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:50.006571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:50.112361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aa7b9-2523-4268-9cd4-766066fd1fba None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:50.155548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb457cb-28d9-47eb-afba-b0a5d14941bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:50.156440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb457cb-28d9-47eb-afba-b0a5d14941bb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:50.156825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb457cb-28d9-47eb-afba-b0a5d14941bb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:50.157145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb457cb-28d9-47eb-afba-b0a5d14941bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:50.169379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb457cb-28d9-47eb-afba-b0a5d14941bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-5bb457cb-28d9-47eb-afba-b0a5d14941bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:13:50.178147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:50.179328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:50.180502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 622/1249] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:50.187679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf665-a2e5-4a30-b767-03726b618696 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:50.325071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf665-a2e5-4a30-b767-03726b618696 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:50.364951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:50.371397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132bda5-9489-4605-a615-8e14b52f9a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:50.372328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132bda5-9489-4605-a615-8e14b52f9a6b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:50.372685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132bda5-9489-4605-a615-8e14b52f9a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:50.373070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132bda5-9489-4605-a615-8e14b52f9a6b None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:50.374618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132bda5-9489-4605-a615-8e14b52f9a6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:50.374937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132bda5-9489-4605-a615-8e14b52f9a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:50.377093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132bda5-9489-4605-a615-8e14b52f9a6b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:50.387653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 628/1250] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:13:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:50.394609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb457cb-28d9-47eb-afba-b0a5d14941bb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:50.511686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:50.554053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb457cb-28d9-47eb-afba-b0a5d14941bb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:50.598117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dd014-18cc-459b-8d69-75a5c634fb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:50.599055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dd014-18cc-459b-8d69-75a5c634fb49 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:50.599340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dd014-18cc-459b-8d69-75a5c634fb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:50.599627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dd014-18cc-459b-8d69-75a5c634fb49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:50.613108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dd014-18cc-459b-8d69-75a5c634fb49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:50.614913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dd014-18cc-459b-8d69-75a5c634fb49 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-247dd014-18cc-459b-8d69-75a5c634fb49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:50.642619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:50.643687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:50.650491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:50.650491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:50.650491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:50.650491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:50.650491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 623/1251] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:50.650972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132bda5-9489-4605-a615-8e14b52f9a6b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:50.777964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132bda5-9489-4605-a615-8e14b52f9a6b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:50.818960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a168c30-bc20-48ec-b568-bf19b40b9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:50.819743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a168c30-bc20-48ec-b568-bf19b40b9c0b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:50.820123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a168c30-bc20-48ec-b568-bf19b40b9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:50.820413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a168c30-bc20-48ec-b568-bf19b40b9c0b None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:50.821270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a168c30-bc20-48ec-b568-bf19b40b9c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:50.822381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a168c30-bc20-48ec-b568-bf19b40b9c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:50.824163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a168c30-bc20-48ec-b568-bf19b40b9c0b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:50.840539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 629/1252] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:50.846811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dd014-18cc-459b-8d69-75a5c634fb49 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:50.968419 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dd014-18cc-459b-8d69-75a5c634fb49 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:51.002427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:51.012660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed08c9-1952-4af7-b027-ac0f21720b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:51.013999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed08c9-1952-4af7-b027-ac0f21720b82 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:51.014810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed08c9-1952-4af7-b027-ac0f21720b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:51.015149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed08c9-1952-4af7-b027-ac0f21720b82 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:51.024421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed08c9-1952-4af7-b027-ac0f21720b82 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:51.026142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed08c9-1952-4af7-b027-ac0f21720b82 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-baed08c9-1952-4af7-b027-ac0f21720b82 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:13:51.045098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:51.046390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:51.047337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:51.047337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:51.047337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:13:51.047337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:13:51.047337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:13:51.047337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:13:51.047337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:13:51.047337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:13:51.047337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:51.047337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:51.047337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 624/1253] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:51.052455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a168c30-bc20-48ec-b568-bf19b40b9c0b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:51.125898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:51.186426 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a168c30-bc20-48ec-b568-bf19b40b9c0b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:51.226283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e450-b570-4fbf-b86d-21906690ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:51.227066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e450-b570-4fbf-b86d-21906690ae5e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:51.227359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e450-b570-4fbf-b86d-21906690ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:51.227645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e450-b570-4fbf-b86d-21906690ae5e None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:51.228608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118e450-b570-4fbf-b86d-21906690ae5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:51.229022 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118e450-b570-4fbf-b86d-21906690ae5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:51.230879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118e450-b570-4fbf-b86d-21906690ae5e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:51.257678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 630/1254] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 12:13:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:51.259074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed08c9-1952-4af7-b027-ac0f21720b82 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:51.381074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed08c9-1952-4af7-b027-ac0f21720b82 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:51.417826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f96fe-2586-4f97-8061-7229f7e8bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:51.418572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f96fe-2586-4f97-8061-7229f7e8bd8c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:51.418866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f96fe-2586-4f97-8061-7229f7e8bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:51.419166 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f96fe-2586-4f97-8061-7229f7e8bd8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:51.495852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:51.513411 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f96fe-2586-4f97-8061-7229f7e8bd8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:51.515771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f96fe-2586-4f97-8061-7229f7e8bd8c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:51.642234 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 625/1255] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:13:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:13:51.648277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e450-b570-4fbf-b86d-21906690ae5e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:51.755750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e450-b570-4fbf-b86d-21906690ae5e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:51.773432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:51.798977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03893e0e-4100-470e-8690-12f6a4ebc929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:51.799808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893e0e-4100-470e-8690-12f6a4ebc929 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:51.800142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893e0e-4100-470e-8690-12f6a4ebc929 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:51.800415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893e0e-4100-470e-8690-12f6a4ebc929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:51.812664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03893e0e-4100-470e-8690-12f6a4ebc929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:51.814261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03893e0e-4100-470e-8690-12f6a4ebc929 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-03893e0e-4100-470e-8690-12f6a4ebc929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:51.835633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:51.836890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:51.838025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:51.838025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:51.838025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:51.838025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:51.838025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 631/1256] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:51.842628 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f96fe-2586-4f97-8061-7229f7e8bd8c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:51.941435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:51.955683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f96fe-2586-4f97-8061-7229f7e8bd8c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:52.000747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0b64e-8bf5-49e8-a44e-aab6d3036139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:52.001424 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0b64e-8bf5-49e8-a44e-aab6d3036139 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:52.001714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0b64e-8bf5-49e8-a44e-aab6d3036139 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:52.002001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0b64e-8bf5-49e8-a44e-aab6d3036139 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:52.002753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0b64e-8bf5-49e8-a44e-aab6d3036139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:52.003059 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0b64e-8bf5-49e8-a44e-aab6d3036139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:52.004481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0b64e-8bf5-49e8-a44e-aab6d3036139 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:52.017084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 626/1257] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:52.023889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03893e0e-4100-470e-8690-12f6a4ebc929 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:52.148168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03893e0e-4100-470e-8690-12f6a4ebc929 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:52.185343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6295f16-58a2-43a4-8861-edd7a70e9cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:52.186531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6295f16-58a2-43a4-8861-edd7a70e9cdc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:52.186823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6295f16-58a2-43a4-8861-edd7a70e9cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:52.187112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6295f16-58a2-43a4-8861-edd7a70e9cdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:52.194072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6295f16-58a2-43a4-8861-edd7a70e9cdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:52.195816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6295f16-58a2-43a4-8861-edd7a70e9cdc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c6295f16-58a2-43a4-8861-edd7a70e9cdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:13:52.213635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:52.214742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:52.215669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:13:52.215669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:13:52.215669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:13:52.215669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:13:52.215669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:13:52.215669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:13:52.215669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:13:52.215669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:52.215669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 632/1258] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:52.221634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0b64e-8bf5-49e8-a44e-aab6d3036139 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:52.336964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0b64e-8bf5-49e8-a44e-aab6d3036139 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:52.376557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c96a77-fec4-4ad7-bd4b-4da636f7b4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:52.377288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c96a77-fec4-4ad7-bd4b-4da636f7b4bc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:52.377570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c96a77-fec4-4ad7-bd4b-4da636f7b4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:52.377850 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c96a77-fec4-4ad7-bd4b-4da636f7b4bc None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:52.378719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c96a77-fec4-4ad7-bd4b-4da636f7b4bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:52.379087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c96a77-fec4-4ad7-bd4b-4da636f7b4bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:52.380632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c96a77-fec4-4ad7-bd4b-4da636f7b4bc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:52.396747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 627/1259] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:52.402910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6295f16-58a2-43a4-8861-edd7a70e9cdc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:52.434004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:52.541498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6295f16-58a2-43a4-8861-edd7a70e9cdc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:52.584582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d524596-2190-4ace-ad8f-d70f2ee8e44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:52.585415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524596-2190-4ace-ad8f-d70f2ee8e44f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:52.585714 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524596-2190-4ace-ad8f-d70f2ee8e44f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:52.586008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524596-2190-4ace-ad8f-d70f2ee8e44f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:52.587021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d524596-2190-4ace-ad8f-d70f2ee8e44f None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=c89ae81d49214b75a747a6cfa3ddf0ba) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:52.587301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d524596-2190-4ace-ad8f-d70f2ee8e44f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:52.589065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d524596-2190-4ace-ad8f-d70f2ee8e44f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:52.596423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 633/1260] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:13:52 2022] GET /identity/v3/role_assignments?user.id=c89ae81d49214b75a747a6cfa3ddf0ba&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:54.626528 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd894cd0-6265-43c1-8742-f3cfe4fc49dc None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:54.627088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd894cd0-6265-43c1-8742-f3cfe4fc49dc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:54.627088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd894cd0-6265-43c1-8742-f3cfe4fc49dc None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:54.628486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 628/1261] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:13:54.633613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5b2a0-205e-487b-9e28-999a786365ff None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:54.634050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5b2a0-205e-487b-9e28-999a786365ff None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:54.634175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5b2a0-205e-487b-9e28-999a786365ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:54.650947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c3f5b2a0-205e-487b-9e28-999a786365ff None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:13:54.652183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c3f5b2a0-205e-487b-9e28-999a786365ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:13:54.717974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 634/1262] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:13:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:13:54.741444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd894cd0-6265-43c1-8742-f3cfe4fc49dc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:54.753180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:54.843357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd894cd0-6265-43c1-8742-f3cfe4fc49dc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:54.876446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0677a-ae3f-4b67-b04c-b8639048fb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:54.877274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0677a-ae3f-4b67-b04c-b8639048fb36 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:54.877505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0677a-ae3f-4b67-b04c-b8639048fb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:54.877779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0677a-ae3f-4b67-b04c-b8639048fb36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:54.887605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0677a-ae3f-4b67-b04c-b8639048fb36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-55a0677a-ae3f-4b67-b04c-b8639048fb36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:13:54.895865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:54.897002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:54.898149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 629/1263] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:54.903322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5b2a0-205e-487b-9e28-999a786365ff None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:54.921845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:55.004332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5b2a0-205e-487b-9e28-999a786365ff None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:55.038115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01486b43-cb06-4d6f-9dd4-90ea2bee539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:55.038808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01486b43-cb06-4d6f-9dd4-90ea2bee539c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:55.039097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01486b43-cb06-4d6f-9dd4-90ea2bee539c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:55.039379 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01486b43-cb06-4d6f-9dd4-90ea2bee539c None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:55.040153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01486b43-cb06-4d6f-9dd4-90ea2bee539c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:55.040466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01486b43-cb06-4d6f-9dd4-90ea2bee539c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:55.041832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01486b43-cb06-4d6f-9dd4-90ea2bee539c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:55.050244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 635/1264] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:13:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:55.057844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0677a-ae3f-4b67-b04c-b8639048fb36 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:55.122695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:55.157878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0677a-ae3f-4b67-b04c-b8639048fb36 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:55.191257 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ae7cf-aab7-42f0-bca7-30c74f24507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:55.192068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ae7cf-aab7-42f0-bca7-30c74f24507d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:55.192362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ae7cf-aab7-42f0-bca7-30c74f24507d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:55.192637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ae7cf-aab7-42f0-bca7-30c74f24507d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:55.203219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ae7cf-aab7-42f0-bca7-30c74f24507d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:55.204702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ae7cf-aab7-42f0-bca7-30c74f24507d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-137ae7cf-aab7-42f0-bca7-30c74f24507d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:55.221573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:55.222666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:55.223592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:55.223592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:55.223592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:55.223592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:55.223592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 630/1265] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:55.228735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01486b43-cb06-4d6f-9dd4-90ea2bee539c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:55.310092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:55.329118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01486b43-cb06-4d6f-9dd4-90ea2bee539c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:55.362985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7138ab7-ea97-4830-b0b6-8e40e6298367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:55.363637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7138ab7-ea97-4830-b0b6-8e40e6298367 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:55.363918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7138ab7-ea97-4830-b0b6-8e40e6298367 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:55.364227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7138ab7-ea97-4830-b0b6-8e40e6298367 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:55.364947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7138ab7-ea97-4830-b0b6-8e40e6298367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:55.365255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7138ab7-ea97-4830-b0b6-8e40e6298367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:55.366628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7138ab7-ea97-4830-b0b6-8e40e6298367 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:55.378306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 636/1266] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:55.383970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ae7cf-aab7-42f0-bca7-30c74f24507d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:55.482054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ae7cf-aab7-42f0-bca7-30c74f24507d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:55.503261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:55.519368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ceed4d-bc38-417e-8dec-f0f980caa3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:55.520283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceed4d-bc38-417e-8dec-f0f980caa3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:55.520570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceed4d-bc38-417e-8dec-f0f980caa3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:55.520852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceed4d-bc38-417e-8dec-f0f980caa3e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:55.528867 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ceed4d-bc38-417e-8dec-f0f980caa3e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:55.530947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ceed4d-bc38-417e-8dec-f0f980caa3e4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-38ceed4d-bc38-417e-8dec-f0f980caa3e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:13:55.547455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:55.549130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:55.550117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:55.550117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:55.550117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:13:55.550117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:13:55.550117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:13:55.550117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:13:55.550117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:13:55.550117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:13:55.550117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:55.550117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:55.550117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 631/1267] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:55.555553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7138ab7-ea97-4830-b0b6-8e40e6298367 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:55.671926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7138ab7-ea97-4830-b0b6-8e40e6298367 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:55.723301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f4fc2-76d1-47f8-be79-b197817dfe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:55.724417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f4fc2-76d1-47f8-be79-b197817dfe47 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:55.724880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f4fc2-76d1-47f8-be79-b197817dfe47 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:55.725339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f4fc2-76d1-47f8-be79-b197817dfe47 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:55.726863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f4fc2-76d1-47f8-be79-b197817dfe47 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:55.727367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f4fc2-76d1-47f8-be79-b197817dfe47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:55.729926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f4fc2-76d1-47f8-be79-b197817dfe47 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:55.743069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:55.754966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 637/1268] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 12:13:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:55.760619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ceed4d-bc38-417e-8dec-f0f980caa3e4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:55.860649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ceed4d-bc38-417e-8dec-f0f980caa3e4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:55.894255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de932079-9414-4731-ab83-683e3cfe3921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:55.895040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932079-9414-4731-ab83-683e3cfe3921 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:55.895330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932079-9414-4731-ab83-683e3cfe3921 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:55.895612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932079-9414-4731-ab83-683e3cfe3921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:55.906336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de932079-9414-4731-ab83-683e3cfe3921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:55.907776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de932079-9414-4731-ab83-683e3cfe3921 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-de932079-9414-4731-ab83-683e3cfe3921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:55.924955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:55.926011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:55.927306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:55.927306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:55.927306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:55.927306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:55.927306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 632/1269] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:55.931870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f4fc2-76d1-47f8-be79-b197817dfe47 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:56.030624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f4fc2-76d1-47f8-be79-b197817dfe47 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:56.063310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c37e22-1bff-4e76-8448-0f18ea3a037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:56.063966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c37e22-1bff-4e76-8448-0f18ea3a037f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:56.064280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c37e22-1bff-4e76-8448-0f18ea3a037f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:56.064560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c37e22-1bff-4e76-8448-0f18ea3a037f None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:56.065278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c37e22-1bff-4e76-8448-0f18ea3a037f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:56.065587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c37e22-1bff-4e76-8448-0f18ea3a037f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:56.066951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c37e22-1bff-4e76-8448-0f18ea3a037f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:56.077856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 638/1270] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:56.083814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de932079-9414-4731-ab83-683e3cfe3921 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:56.116895 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:56.184415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de932079-9414-4731-ab83-683e3cfe3921 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:56.217355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64f83-803c-443e-930f-335513b721d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:56.218132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64f83-803c-443e-930f-335513b721d8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:56.218417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64f83-803c-443e-930f-335513b721d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:56.218695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64f83-803c-443e-930f-335513b721d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:56.225340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db64f83-803c-443e-930f-335513b721d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:56.226777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db64f83-803c-443e-930f-335513b721d8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-2db64f83-803c-443e-930f-335513b721d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:13:56.241183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:56.242220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:56.243573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:13:56.243573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:13:56.243573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:13:56.243573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:13:56.243573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:13:56.243573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:13:56.243573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:13:56.243573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:13:56.243573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 633/1271] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:13:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 12:13:56.248241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c37e22-1bff-4e76-8448-0f18ea3a037f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:56.304862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:56.344878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c37e22-1bff-4e76-8448-0f18ea3a037f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:56.378821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df7c93-b01f-40c3-86fd-7da35120f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:56.379486 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7c93-b01f-40c3-86fd-7da35120f010 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:56.379781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7c93-b01f-40c3-86fd-7da35120f010 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:56.380109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7c93-b01f-40c3-86fd-7da35120f010 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:56.380895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df7c93-b01f-40c3-86fd-7da35120f010 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:56.381208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df7c93-b01f-40c3-86fd-7da35120f010 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:56.382641 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df7c93-b01f-40c3-86fd-7da35120f010 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:56.397352 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 639/1272] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:13:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:56.403336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64f83-803c-443e-930f-335513b721d8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:56.492554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:56.502381 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64f83-803c-443e-930f-335513b721d8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:56.538401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc922f28-691d-4c76-97e5-3a3722d7edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:56.539280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922f28-691d-4c76-97e5-3a3722d7edfd None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:56.539566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922f28-691d-4c76-97e5-3a3722d7edfd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:56.539846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc922f28-691d-4c76-97e5-3a3722d7edfd None admin] PATH_INFO: `/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/c89ae81d49214b75a747a6cfa3ddf0ba/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:56.541824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc922f28-691d-4c76-97e5-3a3722d7edfd None admin] RBAC: Authorizing `identity:create_grant(project_id=9d3618da0c7548a7ac417bcccc7219d0, user_id=c89ae81d49214b75a747a6cfa3ddf0ba, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:56.543259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc922f28-691d-4c76-97e5-3a3722d7edfd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:56.555731 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 634/1273] 10.222.0.66 () {58 vars in 1439 bytes} [Wed Jun 22 12:13:56 2022] PUT /identity/v3/projects/9d3618da0c7548a7ac417bcccc7219d0/users/c89ae81d49214b75a747a6cfa3ddf0ba/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:13:58.544403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d669cd-badd-4e19-9a7c-81c74cfb4f28 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:58.544968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d669cd-badd-4e19-9a7c-81c74cfb4f28 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:58.544968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d669cd-badd-4e19-9a7c-81c74cfb4f28 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:58.546349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 640/1274] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:13:58.551651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7783aa8-ea26-4cb3-aad7-5ebdfe7d179b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:58.552093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7783aa8-ea26-4cb3-aad7-5ebdfe7d179b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:58.552244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7783aa8-ea26-4cb3-aad7-5ebdfe7d179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:58.569133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d7783aa8-ea26-4cb3-aad7-5ebdfe7d179b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:13:58.570313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d7783aa8-ea26-4cb3-aad7-5ebdfe7d179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:13:58.635077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 635/1275] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:13:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:13:58.658794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d669cd-badd-4e19-9a7c-81c74cfb4f28 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:58.757297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d669cd-badd-4e19-9a7c-81c74cfb4f28 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:58.775247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:58.791532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec73e53-f283-4f90-a32f-cd0fa062a2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:58.792330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73e53-f283-4f90-a32f-cd0fa062a2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:58.792612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73e53-f283-4f90-a32f-cd0fa062a2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:58.792883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73e53-f283-4f90-a32f-cd0fa062a2d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:58.803118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec73e53-f283-4f90-a32f-cd0fa062a2d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3ec73e53-f283-4f90-a32f-cd0fa062a2d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 12:13:58.810680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:58.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:58.813049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 641/1276] 10.222.0.66 () {56 vars in 1096 bytes} [Wed Jun 22 12:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:58.817765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7783aa8-ea26-4cb3-aad7-5ebdfe7d179b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:58.896440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:58.915236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7783aa8-ea26-4cb3-aad7-5ebdfe7d179b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:58.947519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de71e9e-890a-46d0-8c2a-c9fb4cb60b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:58.948215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de71e9e-890a-46d0-8c2a-c9fb4cb60b0c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:58.948504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de71e9e-890a-46d0-8c2a-c9fb4cb60b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:58.948785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de71e9e-890a-46d0-8c2a-c9fb4cb60b0c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:58.949531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de71e9e-890a-46d0-8c2a-c9fb4cb60b0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:58.949840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de71e9e-890a-46d0-8c2a-c9fb4cb60b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:58.951735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de71e9e-890a-46d0-8c2a-c9fb4cb60b0c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:58.959574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 636/1277] 10.222.0.66 () {56 vars in 1099 bytes} [Wed Jun 22 12:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:58.965272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec73e53-f283-4f90-a32f-cd0fa062a2d4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:59.067239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec73e53-f283-4f90-a32f-cd0fa062a2d4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:59.100843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1a66e-f64b-45bf-a170-371600e776d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:59.101616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1a66e-f64b-45bf-a170-371600e776d0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:59.101900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1a66e-f64b-45bf-a170-371600e776d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:59.102181 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1a66e-f64b-45bf-a170-371600e776d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:59.112408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1a66e-f64b-45bf-a170-371600e776d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:59.113876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1a66e-f64b-45bf-a170-371600e776d0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3bb1a66e-f64b-45bf-a170-371600e776d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:13:59.130740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:59.131789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:59.132803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:13:59.132803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:13:59.132803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:13:59.132803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:59.132803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 642/1278] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:59.137630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de71e9e-890a-46d0-8c2a-c9fb4cb60b0c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:59.238851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de71e9e-890a-46d0-8c2a-c9fb4cb60b0c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:59.272872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcde65-da4f-4af4-9876-41d8a565fc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:59.273532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcde65-da4f-4af4-9876-41d8a565fc50 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:59.273821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcde65-da4f-4af4-9876-41d8a565fc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:59.274104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcde65-da4f-4af4-9876-41d8a565fc50 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:59.274835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcde65-da4f-4af4-9876-41d8a565fc50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:59.275151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcde65-da4f-4af4-9876-41d8a565fc50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:59.276634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcde65-da4f-4af4-9876-41d8a565fc50 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:59.289521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 637/1279] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:59.295210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1a66e-f64b-45bf-a170-371600e776d0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:59.326902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:59.394868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1a66e-f64b-45bf-a170-371600e776d0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:59.427649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80dce5-0560-4fe8-8744-1ca74cc0c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:59.428465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80dce5-0560-4fe8-8744-1ca74cc0c74e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:59.428751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80dce5-0560-4fe8-8744-1ca74cc0c74e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:59.429029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80dce5-0560-4fe8-8744-1ca74cc0c74e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:59.436311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80dce5-0560-4fe8-8744-1ca74cc0c74e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:59.437744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80dce5-0560-4fe8-8744-1ca74cc0c74e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0c80dce5-0560-4fe8-8744-1ca74cc0c74e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 12:13:59.452311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:13:59.453429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:13:59.454431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:13:59.454431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:13:59.454431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 12:13:59.454431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 12:13:59.454431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 12:13:59.454431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 12:13:59.454431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 12:13:59.454431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 12:13:59.454431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 12:13:59.454431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:13:59.454431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 643/1280] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:13:59.459259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcde65-da4f-4af4-9876-41d8a565fc50 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:59.462992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:59.567241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcde65-da4f-4af4-9876-41d8a565fc50 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:59.602058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c674f-0861-474a-ace0-697aa4523678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:59.602670 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c674f-0861-474a-ace0-697aa4523678 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:59.603024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c674f-0861-474a-ace0-697aa4523678 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:59.603227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c674f-0861-474a-ace0-697aa4523678 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:59.604079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c674f-0861-474a-ace0-697aa4523678 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:13:59.604391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c674f-0861-474a-ace0-697aa4523678 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:59.605833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c674f-0861-474a-ace0-697aa4523678 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:59.622434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 638/1281] 10.222.0.66 () {56 vars in 1143 bytes} [Wed Jun 22 12:13:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:13:59.628212 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80dce5-0560-4fe8-8744-1ca74cc0c74e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:13:59.718041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:59.727682 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80dce5-0560-4fe8-8744-1ca74cc0c74e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:13:59.760270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f133a-8ae8-4207-a5a0-271c0ef99469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:13:59.760904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f133a-8ae8-4207-a5a0-271c0ef99469 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:13:59.761195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f133a-8ae8-4207-a5a0-271c0ef99469 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:13:59.761464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f133a-8ae8-4207-a5a0-271c0ef99469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:13:59.834959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f133a-8ae8-4207-a5a0-271c0ef99469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:13:59.836467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f133a-8ae8-4207-a5a0-271c0ef99469 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:13:59.923898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:13:59.934198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 644/1282] 10.222.0.66 () {58 vars in 1282 bytes} [Wed Jun 22 12:13:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 12:13:59.939996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c674f-0861-474a-ace0-697aa4523678 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:00.000531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:00.038400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c674f-0861-474a-ace0-697aa4523678 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:00.071056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974632e-2e3e-4676-9fc0-438b3f2c0fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:00.071833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974632e-2e3e-4676-9fc0-438b3f2c0fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:00.072143 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974632e-2e3e-4676-9fc0-438b3f2c0fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:00.072418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974632e-2e3e-4676-9fc0-438b3f2c0fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:00.084979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974632e-2e3e-4676-9fc0-438b3f2c0fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:00.086410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974632e-2e3e-4676-9fc0-438b3f2c0fc1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-0974632e-2e3e-4676-9fc0-438b3f2c0fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 12:14:00.103256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:14:00.104331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:14:00.105409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 12:14:00.105409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 12:14:00.105409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 12:14:00.105409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:14:00.105409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 639/1283] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:14:00.110232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f133a-8ae8-4207-a5a0-271c0ef99469 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:00.214150 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f133a-8ae8-4207-a5a0-271c0ef99469 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:00.248252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1306830-5b77-4d50-94e9-b3c103806c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:00.248915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1306830-5b77-4d50-94e9-b3c103806c38 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:00.249197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1306830-5b77-4d50-94e9-b3c103806c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:00.249474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1306830-5b77-4d50-94e9-b3c103806c38 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:00.250193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1306830-5b77-4d50-94e9-b3c103806c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:14:00.250503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1306830-5b77-4d50-94e9-b3c103806c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:00.251869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1306830-5b77-4d50-94e9-b3c103806c38 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:00.262866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 645/1284] 10.222.0.66 () {56 vars in 1109 bytes} [Wed Jun 22 12:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:14:00.269077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974632e-2e3e-4676-9fc0-438b3f2c0fc1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:00.367209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974632e-2e3e-4676-9fc0-438b3f2c0fc1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:00.381609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:00.401866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d14031-bba1-4dc7-a6ed-48b45193e822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:00.402683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d14031-bba1-4dc7-a6ed-48b45193e822 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:00.402970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d14031-bba1-4dc7-a6ed-48b45193e822 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:00.403253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d14031-bba1-4dc7-a6ed-48b45193e822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:00.409880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d14031-bba1-4dc7-a6ed-48b45193e822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:00.411318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d14031-bba1-4dc7-a6ed-48b45193e822 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-d6d14031-bba1-4dc7-a6ed-48b45193e822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 12:14:00.425405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:14:00.426479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:14:00.427610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 12:14:00.427610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 12:14:00.427610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 12:14:00.427610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 12:14:00.427610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 12:14:00.427610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 12:14:00.427610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 12:14:00.427610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 22 12:14:00.427610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 640/1285] 10.222.0.66 () {56 vars in 1111 bytes} [Wed Jun 22 12:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:14:00.432706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1306830-5b77-4d50-94e9-b3c103806c38 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:00.481382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:00.540913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1306830-5b77-4d50-94e9-b3c103806c38 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:00.573450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67f5a4-aa60-4b2a-b34c-b48a5e843430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:00.574101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f5a4-aa60-4b2a-b34c-b48a5e843430 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:00.574384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f5a4-aa60-4b2a-b34c-b48a5e843430 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:00.574659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f5a4-aa60-4b2a-b34c-b48a5e843430 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:00.575442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67f5a4-aa60-4b2a-b34c-b48a5e843430 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:14:00.575789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67f5a4-aa60-4b2a-b34c-b48a5e843430 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:00.577270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67f5a4-aa60-4b2a-b34c-b48a5e843430 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:00.588900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 646/1286] 10.222.0.66 () {56 vars in 1148 bytes} [Wed Jun 22 12:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:14:00.595551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d14031-bba1-4dc7-a6ed-48b45193e822 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:00.691189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d14031-bba1-4dc7-a6ed-48b45193e822 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:00.723827 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81f474-eeb1-4a26-9bcc-0d0431abaa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:00.724512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81f474-eeb1-4a26-9bcc-0d0431abaa7d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:00.724799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81f474-eeb1-4a26-9bcc-0d0431abaa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:00.725081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81f474-eeb1-4a26-9bcc-0d0431abaa7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:00.725915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81f474-eeb1-4a26-9bcc-0d0431abaa7d None admin] RBAC: Adding query filter params (role.id=26d3e243af384e9bbee85bcefbb9a7c0, scope.project.id=9d3618da0c7548a7ac417bcccc7219d0, user.id=c89ae81d49214b75a747a6cfa3ddf0ba) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:14:00.726233 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81f474-eeb1-4a26-9bcc-0d0431abaa7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:00.727667 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81f474-eeb1-4a26-9bcc-0d0431abaa7d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:00.734176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 641/1287] 10.222.0.66 () {56 vars in 1374 bytes} [Wed Jun 22 12:14:00 2022] GET /identity/v3/role_assignments?user.id=c89ae81d49214b75a747a6cfa3ddf0ba&scope.project.id=9d3618da0c7548a7ac417bcccc7219d0&role.id=26d3e243af384e9bbee85bcefbb9a7c0 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:14:02.770692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c0c52-0e45-4691-abbb-02e7fd9cedf5 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:02.771223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c0c52-0e45-4691-abbb-02e7fd9cedf5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:02.771341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c0c52-0e45-4691-abbb-02e7fd9cedf5 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:02.772667 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 647/1288] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:14:02.777648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c051-4b11-4e49-a756-8f163bdb5b30 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:02.778081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c051-4b11-4e49-a756-8f163bdb5b30 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:02.778211 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c051-4b11-4e49-a756-8f163bdb5b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:02.795202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5f91c051-4b11-4e49-a756-8f163bdb5b30 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:14:02.796430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5f91c051-4b11-4e49-a756-8f163bdb5b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:14:02.825502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:02.864323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 642/1289] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:14:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:14:02.886799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c0c52-0e45-4691-abbb-02e7fd9cedf5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:02.985258 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c0c52-0e45-4691-abbb-02e7fd9cedf5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:02.995984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:03.020404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c76d2-ac7c-4637-8379-9bcebec1c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:03.021251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c76d2-ac7c-4637-8379-9bcebec1c5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:03.021487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c76d2-ac7c-4637-8379-9bcebec1c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:03.021765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c76d2-ac7c-4637-8379-9bcebec1c5b0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:03.022415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c76d2-ac7c-4637-8379-9bcebec1c5b0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:03.023786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c76d2-ac7c-4637-8379-9bcebec1c5b0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-054c76d2-ac7c-4637-8379-9bcebec1c5b0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:14:03.035945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:14:03.037206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:14:03.038321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 648/1290] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 12:14:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:14:03.043091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c051-4b11-4e49-a756-8f163bdb5b30 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:03.140009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c051-4b11-4e49-a756-8f163bdb5b30 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:03.172938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca1636-1d36-402c-97c9-39baa88c5e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:03.173594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca1636-1d36-402c-97c9-39baa88c5e86 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:03.173876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca1636-1d36-402c-97c9-39baa88c5e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:03.174152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca1636-1d36-402c-97c9-39baa88c5e86 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:03.174851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca1636-1d36-402c-97c9-39baa88c5e86 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:14:03.175160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca1636-1d36-402c-97c9-39baa88c5e86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:03.176672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca1636-1d36-402c-97c9-39baa88c5e86 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:03.181420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 643/1291] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Jun 22 12:14:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:14:03.187264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c76d2-ac7c-4637-8379-9bcebec1c5b0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:03.283836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c76d2-ac7c-4637-8379-9bcebec1c5b0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:03.315659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2560e-91c2-4857-94b7-e8c5f848cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:03.316338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2560e-91c2-4857-94b7-e8c5f848cd5c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:03.316626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2560e-91c2-4857-94b7-e8c5f848cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:03.316904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2560e-91c2-4857-94b7-e8c5f848cd5c None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:03.317604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2560e-91c2-4857-94b7-e8c5f848cd5c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:14:03.317912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2560e-91c2-4857-94b7-e8c5f848cd5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:03.319284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2560e-91c2-4857-94b7-e8c5f848cd5c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:03.323674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 649/1292] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Jun 22 12:14:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:14:05.305066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374db52-e3f7-46d0-9837-814cd2c749fa None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:05.305619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374db52-e3f7-46d0-9837-814cd2c749fa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:05.305619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374db52-e3f7-46d0-9837-814cd2c749fa None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:05.307122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 644/1293] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:14:05.313072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451a201-ede5-485f-a96d-a91254ac4e18 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:05.313526 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451a201-ede5-485f-a96d-a91254ac4e18 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:05.313632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451a201-ede5-485f-a96d-a91254ac4e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:05.331611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a451a201-ede5-485f-a96d-a91254ac4e18 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:14:05.332847 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a451a201-ede5-485f-a96d-a91254ac4e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:14:05.361139 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:05.398464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 650/1294] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:14:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:14:05.421695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374db52-e3f7-46d0-9837-814cd2c749fa None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:05.451636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:05.527434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374db52-e3f7-46d0-9837-814cd2c749fa None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:05.565452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd810e2-dd3d-41d7-b6e0-834908847e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:05.566008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd810e2-dd3d-41d7-b6e0-834908847e4b None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:05.566293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd810e2-dd3d-41d7-b6e0-834908847e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:05.566572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd810e2-dd3d-41d7-b6e0-834908847e4b None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:05.567292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd810e2-dd3d-41d7-b6e0-834908847e4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:05.568889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd810e2-dd3d-41d7-b6e0-834908847e4b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:05.582007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 645/1295] 10.222.0.66 () {60 vars in 1141 bytes} [Wed Jun 22 12:14:05 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:14:07.594942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053655a-98a1-4560-823c-c35a941d62d6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:07.595531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053655a-98a1-4560-823c-c35a941d62d6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:07.595531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053655a-98a1-4560-823c-c35a941d62d6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:07.596896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 651/1296] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:14:07.601898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e385e-02f6-411a-b8a9-7f1dc6b2a15e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:07.602311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e385e-02f6-411a-b8a9-7f1dc6b2a15e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:07.602454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e385e-02f6-411a-b8a9-7f1dc6b2a15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:07.618895 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-be7e385e-02f6-411a-b8a9-7f1dc6b2a15e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:14:07.620103 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-be7e385e-02f6-411a-b8a9-7f1dc6b2a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:14:07.692289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 646/1297] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:14:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:14:07.715199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053655a-98a1-4560-823c-c35a941d62d6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:07.815135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053655a-98a1-4560-823c-c35a941d62d6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:07.850869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba532-c2e3-443b-8afe-9e3410ed7f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:07.851599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba532-c2e3-443b-8afe-9e3410ed7f2f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:07.851884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba532-c2e3-443b-8afe-9e3410ed7f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:07.852192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba532-c2e3-443b-8afe-9e3410ed7f2f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:07.852842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ba532-c2e3-443b-8afe-9e3410ed7f2f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:07.854218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ba532-c2e3-443b-8afe-9e3410ed7f2f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b47ba532-c2e3-443b-8afe-9e3410ed7f2f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:14:07.865795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:14:07.866941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:14:07.867960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 652/1298] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 12:14:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:14:07.873641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e385e-02f6-411a-b8a9-7f1dc6b2a15e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:07.892422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:07.971192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e385e-02f6-411a-b8a9-7f1dc6b2a15e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:08.003629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaee8f-c3fa-4aed-867e-37d0b5efc704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:08.004328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaee8f-c3fa-4aed-867e-37d0b5efc704 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:08.004618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaee8f-c3fa-4aed-867e-37d0b5efc704 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:08.004896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaee8f-c3fa-4aed-867e-37d0b5efc704 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:08.005610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaee8f-c3fa-4aed-867e-37d0b5efc704 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:14:08.005917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaee8f-c3fa-4aed-867e-37d0b5efc704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:08.007374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaee8f-c3fa-4aed-867e-37d0b5efc704 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:08.012536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 647/1299] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Jun 22 12:14:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:14:08.019210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba532-c2e3-443b-8afe-9e3410ed7f2f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:08.050064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:08.118677 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba532-c2e3-443b-8afe-9e3410ed7f2f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:08.151604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964446da-9ee4-4296-8b62-1f1014d00781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:08.152286 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964446da-9ee4-4296-8b62-1f1014d00781 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:08.152576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964446da-9ee4-4296-8b62-1f1014d00781 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:08.152858 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964446da-9ee4-4296-8b62-1f1014d00781 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:08.154169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964446da-9ee4-4296-8b62-1f1014d00781 None admin] RBAC: Adding query filter params (interface=public, service_id=376242614e49420c84f9e327b51a53d4, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:14:08.154485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964446da-9ee4-4296-8b62-1f1014d00781 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:08.155940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964446da-9ee4-4296-8b62-1f1014d00781 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:08.161575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 653/1300] 10.222.0.66 () {56 vars in 1251 bytes} [Wed Jun 22 12:14:08 2022] GET /identity/v3/endpoints?service_id=376242614e49420c84f9e327b51a53d4&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:14:08.167199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaee8f-c3fa-4aed-867e-37d0b5efc704 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:08.248905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:08.267258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaee8f-c3fa-4aed-867e-37d0b5efc704 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:08.300622 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f012e0f-7f3c-4c18-a8ba-5691947bd6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:08.301286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012e0f-7f3c-4c18-a8ba-5691947bd6bf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:08.301565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012e0f-7f3c-4c18-a8ba-5691947bd6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:08.301848 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012e0f-7f3c-4c18-a8ba-5691947bd6bf None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:08.302531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f012e0f-7f3c-4c18-a8ba-5691947bd6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:08.303931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f012e0f-7f3c-4c18-a8ba-5691947bd6bf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:08.310737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 648/1301] 10.222.0.66 () {56 vars in 1087 bytes} [Wed Jun 22 12:14:08 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:14:10.323064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad889e6-9255-4006-a737-352c62de43e2 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:10.323615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad889e6-9255-4006-a737-352c62de43e2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:10.323615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad889e6-9255-4006-a737-352c62de43e2 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:10.325025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 654/1302] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:14:10.330218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a0bf-5822-416e-8a5f-1a6c52e7c807 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:10.330590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a0bf-5822-416e-8a5f-1a6c52e7c807 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:10.330776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a0bf-5822-416e-8a5f-1a6c52e7c807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:10.347684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1944a0bf-5822-416e-8a5f-1a6c52e7c807 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:14:10.348921 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1944a0bf-5822-416e-8a5f-1a6c52e7c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:14:10.418547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 649/1303] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:14:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 12:14:10.442119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad889e6-9255-4006-a737-352c62de43e2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:10.548261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:10.555400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad889e6-9255-4006-a737-352c62de43e2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:10.587988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc462db-0451-4dde-9957-d987bdf976c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:10.588733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc462db-0451-4dde-9957-d987bdf976c5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:10.589019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc462db-0451-4dde-9957-d987bdf976c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:10.589297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc462db-0451-4dde-9957-d987bdf976c5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:10.589945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc462db-0451-4dde-9957-d987bdf976c5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:10.591871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc462db-0451-4dde-9957-d987bdf976c5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-1dc462db-0451-4dde-9957-d987bdf976c5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 12:14:10.603455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 12:14:10.604696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 22 12:14:10.605763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 655/1304] 10.222.0.66 () {56 vars in 1117 bytes} [Wed Jun 22 12:14:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 12:14:10.611353 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a0bf-5822-416e-8a5f-1a6c52e7c807 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:10.685027 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:10.707539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a0bf-5822-416e-8a5f-1a6c52e7c807 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:10.740617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f05ee6-cc9e-4b51-9dda-ddcdbbfbfcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:10.741269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f05ee6-cc9e-4b51-9dda-ddcdbbfbfcbc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:10.741553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f05ee6-cc9e-4b51-9dda-ddcdbbfbfcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:10.741832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f05ee6-cc9e-4b51-9dda-ddcdbbfbfcbc None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:10.742535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f05ee6-cc9e-4b51-9dda-ddcdbbfbfcbc None admin] RBAC: Adding query filter params (name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:14:10.742841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f05ee6-cc9e-4b51-9dda-ddcdbbfbfcbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:10.744230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f05ee6-cc9e-4b51-9dda-ddcdbbfbfcbc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:10.749331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 650/1305] 10.222.0.66 () {56 vars in 1116 bytes} [Wed Jun 22 12:14:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:14:10.755150 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc462db-0451-4dde-9957-d987bdf976c5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:14:10.854208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc462db-0451-4dde-9957-d987bdf976c5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:14:10.889324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e811c-f1a4-4df3-8451-8825db06737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:14:10.889974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e811c-f1a4-4df3-8451-8825db06737b None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:14:10.890257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e811c-f1a4-4df3-8451-8825db06737b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:14:10.890532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e811c-f1a4-4df3-8451-8825db06737b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:14:10.891259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e811c-f1a4-4df3-8451-8825db06737b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:14:10.892665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e811c-f1a4-4df3-8451-8825db06737b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:14:10.911331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 656/1306] 10.222.0.66 () {60 vars in 1144 bytes} [Wed Jun 22 12:14:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:14:20.747235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=30 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:14:20.906710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:13.841309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae1045-ea3a-45bc-b6f2-460f033cb997 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:13.841907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae1045-ea3a-45bc-b6f2-460f033cb997 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:13.841907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae1045-ea3a-45bc-b6f2-460f033cb997 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:13.849123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bea5c0-f6e2-429f-876d-3a536f051565 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:13.849663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bea5c0-f6e2-429f-876d-3a536f051565 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:13.849663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bea5c0-f6e2-429f-876d-3a536f051565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:13.853293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 651/1307] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:13 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:15:13.932997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c2bea5c0-f6e2-429f-876d-3a536f051565 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:13.934139 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c2bea5c0-f6e2-429f-876d-3a536f051565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:14.069212 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 657/1308] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:15:14.114356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931051c-6dc4-4cfc-91e4-86bf5851f1c7 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:14.114957 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931051c-6dc4-4cfc-91e4-86bf5851f1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:14.115422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931051c-6dc4-4cfc-91e4-86bf5851f1c7 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:14.117280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 652/1309] 10.222.0.66 () {54 vars in 964 bytes} [Wed Jun 22 12:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:14.123670 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796387c1-b9c8-4b3c-8c33-5e6cadd07fd3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:14.124348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796387c1-b9c8-4b3c-8c33-5e6cadd07fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:14.124813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796387c1-b9c8-4b3c-8c33-5e6cadd07fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:14.355632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-796387c1-b9c8-4b3c-8c33-5e6cadd07fd3 None None] MFA Rules not processed for user `b37002ecc6384dc08fca3ddf6ca2f9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:14.358628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-796387c1-b9c8-4b3c-8c33-5e6cadd07fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:14.417924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:14.502729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 658/1310] 10.222.0.66 () {58 vars in 1061 bytes} [Wed Jun 22 12:15:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:14.511703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931051c-6dc4-4cfc-91e4-86bf5851f1c7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:14.513769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6931051c-6dc4-4cfc-91e4-86bf5851f1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:14.667706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931051c-6dc4-4cfc-91e4-86bf5851f1c7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:14.755487 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153243c-405c-4519-aaea-89ff684544f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:14.756524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153243c-405c-4519-aaea-89ff684544f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:14.757005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153243c-405c-4519-aaea-89ff684544f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:14.757454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153243c-405c-4519-aaea-89ff684544f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:14.759605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a153243c-405c-4519-aaea-89ff684544f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:14.828247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:14.896859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153243c-405c-4519-aaea-89ff684544f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:14.899135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153243c-405c-4519-aaea-89ff684544f9 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:14.925291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 653/1311] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:17.383380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe20664-d9b5-4f78-99a1-6702286cdb82 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:17.384249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe20664-d9b5-4f78-99a1-6702286cdb82 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:17.384249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe20664-d9b5-4f78-99a1-6702286cdb82 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:17.385461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 659/1312] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:17.391864 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6938b-a579-4523-a14e-d32309ef4b96 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:17.392349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6938b-a579-4523-a14e-d32309ef4b96 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:17.392470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6938b-a579-4523-a14e-d32309ef4b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:17.478810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-eea6938b-a579-4523-a14e-d32309ef4b96 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:17.480323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-eea6938b-a579-4523-a14e-d32309ef4b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:17.591424 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 654/1313] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:17.629968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe20664-d9b5-4f78-99a1-6702286cdb82 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:17.631560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bbe20664-d9b5-4f78-99a1-6702286cdb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:17.740900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe20664-d9b5-4f78-99a1-6702286cdb82 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:17.818985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:17.821961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c3341-de32-4787-a7e2-f995ada7147c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:17.822632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c3341-de32-4787-a7e2-f995ada7147c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:17.823126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c3341-de32-4787-a7e2-f995ada7147c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:17.824417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c3341-de32-4787-a7e2-f995ada7147c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:17.826179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-527c3341-de32-4787-a7e2-f995ada7147c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:17.938334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c3341-de32-4787-a7e2-f995ada7147c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:17.939695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c3341-de32-4787-a7e2-f995ada7147c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:17.958366 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 660/1314] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:20.294825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8581f5-1e4a-4b1f-99c3-838a0391b6fd None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:20.295383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8581f5-1e4a-4b1f-99c3-838a0391b6fd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:20.295383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8581f5-1e4a-4b1f-99c3-838a0391b6fd None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:20.296778 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 655/1315] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:20.301842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6549b-240b-489c-968b-4ab27319d859 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:20.302282 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6549b-240b-489c-968b-4ab27319d859 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:20.302407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6549b-240b-489c-968b-4ab27319d859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:20.366707 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1ca6549b-240b-489c-968b-4ab27319d859 None None] MFA Rules not processed for user `01daecc16ba048b68b7a60751478124e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:20.367928 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1ca6549b-240b-489c-968b-4ab27319d859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:20.421704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:20.466646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 661/1316] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:20.506261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8581f5-1e4a-4b1f-99c3-838a0391b6fd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:20.507897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2d8581f5-1e4a-4b1f-99c3-838a0391b6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:20.518464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:20.612520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8581f5-1e4a-4b1f-99c3-838a0391b6fd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:20.685406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0dcd-d40a-45d1-b839-3bd99d4ad00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:20.686058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0dcd-d40a-45d1-b839-3bd99d4ad00c service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:20.686341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0dcd-d40a-45d1-b839-3bd99d4ad00c service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:20.686619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0dcd-d40a-45d1-b839-3bd99d4ad00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:20.688307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1e6c0dcd-d40a-45d1-b839-3bd99d4ad00c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:20.750200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:20.797154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0dcd-d40a-45d1-b839-3bd99d4ad00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:20.798594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0dcd-d40a-45d1-b839-3bd99d4ad00c service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:20.816791 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 656/1317] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:23.384777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1ab7b-e211-4706-85f4-80532bda1c9a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:23.385414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1ab7b-e211-4706-85f4-80532bda1c9a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:23.385414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1ab7b-e211-4706-85f4-80532bda1c9a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:23.387253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 662/1318] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:23.392947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b62ef-9373-4c52-8bb9-6b12c7c153b3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:23.393381 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b62ef-9373-4c52-8bb9-6b12c7c153b3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:23.393562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b62ef-9373-4c52-8bb9-6b12c7c153b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:23.457141 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0e5b62ef-9373-4c52-8bb9-6b12c7c153b3 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:23.458351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0e5b62ef-9373-4c52-8bb9-6b12c7c153b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:23.561304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 657/1319] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:23.621587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25f1e9-62ed-45eb-8358-51c892e26db6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:23.621898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25f1e9-62ed-45eb-8358-51c892e26db6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:23.622146 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25f1e9-62ed-45eb-8358-51c892e26db6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:23.623535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 663/1320] 10.222.0.66 () {54 vars in 964 bytes} [Wed Jun 22 12:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:23.629544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e37ff-c4a7-4fe6-9b52-02bd33434bc2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:23.629842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e37ff-c4a7-4fe6-9b52-02bd33434bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:23.630125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e37ff-c4a7-4fe6-9b52-02bd33434bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:23.650546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:23.703742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-881e37ff-c4a7-4fe6-9b52-02bd33434bc2 None None] MFA Rules not processed for user `b37002ecc6384dc08fca3ddf6ca2f9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:23.705097 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-881e37ff-c4a7-4fe6-9b52-02bd33434bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:23.779916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 658/1321] 10.222.0.66 () {58 vars in 1061 bytes} [Wed Jun 22 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:23.789004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25f1e9-62ed-45eb-8358-51c892e26db6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:23.790537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cc25f1e9-62ed-45eb-8358-51c892e26db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:23.893303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25f1e9-62ed-45eb-8358-51c892e26db6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:23.966780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336dff1-eb44-4b55-9f8a-5e6599113ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:23.967500 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336dff1-eb44-4b55-9f8a-5e6599113ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:23.967810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336dff1-eb44-4b55-9f8a-5e6599113ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:23.968104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336dff1-eb44-4b55-9f8a-5e6599113ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:23.969765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f336dff1-eb44-4b55-9f8a-5e6599113ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:23.977157 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:24.079764 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336dff1-eb44-4b55-9f8a-5e6599113ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:24.081250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336dff1-eb44-4b55-9f8a-5e6599113ed9 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:24.099517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 664/1322] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:27.252044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65ab6c-cf19-409f-afb2-b50ca3edb830 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:27.252597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65ab6c-cf19-409f-afb2-b50ca3edb830 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:27.252597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65ab6c-cf19-409f-afb2-b50ca3edb830 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:27.254016 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 659/1323] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:27.259234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19a16-0ee7-42ca-8130-8db0ccd3dcce None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:27.259652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19a16-0ee7-42ca-8130-8db0ccd3dcce None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:27.259795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19a16-0ee7-42ca-8130-8db0ccd3dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:27.324793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-dea19a16-0ee7-42ca-8130-8db0ccd3dcce None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:27.326001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dea19a16-0ee7-42ca-8130-8db0ccd3dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:27.387410 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:27.427913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 665/1324] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:27.464823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65ab6c-cf19-409f-afb2-b50ca3edb830 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:27.466382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cf65ab6c-cf19-409f-afb2-b50ca3edb830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:27.583598 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65ab6c-cf19-409f-afb2-b50ca3edb830 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:27.596756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:27.662064 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7b7be-f1ab-4aad-9e39-17ec17c39f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:27.662710 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b7be-f1ab-4aad-9e39-17ec17c39f78 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:27.662995 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b7be-f1ab-4aad-9e39-17ec17c39f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:27.663274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b7be-f1ab-4aad-9e39-17ec17c39f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:27.664986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-adb7b7be-f1ab-4aad-9e39-17ec17c39f78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:27.777491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7b7be-f1ab-4aad-9e39-17ec17c39f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:27.778952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7b7be-f1ab-4aad-9e39-17ec17c39f78 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:27.799564 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 660/1325] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:29.927146 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e45b5-9e3f-4979-a4cd-ee28f9bc349d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:29.927699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e45b5-9e3f-4979-a4cd-ee28f9bc349d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:29.927699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e45b5-9e3f-4979-a4cd-ee28f9bc349d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:29.929107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 666/1326] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:29.934952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21947c56-4466-4ec9-ab03-db5ff0f63ef6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:29.935404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21947c56-4466-4ec9-ab03-db5ff0f63ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:29.935499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21947c56-4466-4ec9-ab03-db5ff0f63ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:29.983074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:30.002619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-21947c56-4466-4ec9-ab03-db5ff0f63ef6 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:30.003834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-21947c56-4466-4ec9-ab03-db5ff0f63ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:30.099222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 661/1327] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:30.135966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e45b5-9e3f-4979-a4cd-ee28f9bc349d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:30.137809 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d43e45b5-9e3f-4979-a4cd-ee28f9bc349d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:30.241770 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e45b5-9e3f-4979-a4cd-ee28f9bc349d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:30.318608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df717b4-9b97-47ca-af68-2a1d5abe02db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:30.319270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df717b4-9b97-47ca-af68-2a1d5abe02db service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:30.319554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df717b4-9b97-47ca-af68-2a1d5abe02db service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:30.319831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df717b4-9b97-47ca-af68-2a1d5abe02db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:30.321611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5df717b4-9b97-47ca-af68-2a1d5abe02db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:30.340104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:30.435514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df717b4-9b97-47ca-af68-2a1d5abe02db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:30.436987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df717b4-9b97-47ca-af68-2a1d5abe02db service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:30.455116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 667/1328] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:32.564439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09426538-55dc-4d57-b565-bc0424ffe883 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:32.564964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09426538-55dc-4d57-b565-bc0424ffe883 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:32.565076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09426538-55dc-4d57-b565-bc0424ffe883 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:32.566412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 662/1329] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:32.571803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d3f13-9e17-4a12-9f83-734e4c75b9b9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:32.572292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d3f13-9e17-4a12-9f83-734e4c75b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:32.572560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d3f13-9e17-4a12-9f83-734e4c75b9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:32.646784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-496d3f13-9e17-4a12-9f83-734e4c75b9b9 None None] MFA Rules not processed for user `01daecc16ba048b68b7a60751478124e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:32.648137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-496d3f13-9e17-4a12-9f83-734e4c75b9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:32.716480 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:32.751601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 668/1330] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:32.789154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09426538-55dc-4d57-b565-bc0424ffe883 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:32.790693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-09426538-55dc-4d57-b565-bc0424ffe883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:32.894348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09426538-55dc-4d57-b565-bc0424ffe883 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:32.915282 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:32.971009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c902b-cf29-412c-9dd7-f93ac9440a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:32.971657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c902b-cf29-412c-9dd7-f93ac9440a1c service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:32.971942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c902b-cf29-412c-9dd7-f93ac9440a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:32.972262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c902b-cf29-412c-9dd7-f93ac9440a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:32.973977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-154c902b-cf29-412c-9dd7-f93ac9440a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:33.095138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c902b-cf29-412c-9dd7-f93ac9440a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:33.096666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c902b-cf29-412c-9dd7-f93ac9440a1c service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:33.121186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 663/1331] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:35.430673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82a9b0-5b14-4f32-b218-71ac5ce14e38 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:35.431247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82a9b0-5b14-4f32-b218-71ac5ce14e38 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:35.431247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82a9b0-5b14-4f32-b218-71ac5ce14e38 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:35.433246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 669/1332] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:35.438429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c452-c6ea-4f62-9caf-2abd87aa5b90 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:35.438855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c452-c6ea-4f62-9caf-2abd87aa5b90 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:35.438978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c452-c6ea-4f62-9caf-2abd87aa5b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:35.500810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:35.503942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c857c452-c6ea-4f62-9caf-2abd87aa5b90 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:35.505787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c857c452-c6ea-4f62-9caf-2abd87aa5b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:35.602369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 664/1333] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:35.638680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82a9b0-5b14-4f32-b218-71ac5ce14e38 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:35.640297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1f82a9b0-5b14-4f32-b218-71ac5ce14e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:35.742496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82a9b0-5b14-4f32-b218-71ac5ce14e38 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:35.815675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33331f35-2dc1-480a-b08e-fad9a9597d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:35.816354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33331f35-2dc1-480a-b08e-fad9a9597d9e service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:35.816637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33331f35-2dc1-480a-b08e-fad9a9597d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:35.816912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33331f35-2dc1-480a-b08e-fad9a9597d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:35.818551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-33331f35-2dc1-480a-b08e-fad9a9597d9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:35.845468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:35.927407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33331f35-2dc1-480a-b08e-fad9a9597d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:35.928899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33331f35-2dc1-480a-b08e-fad9a9597d9e service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:35.948965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 670/1334] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:38.040640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4edc5c-c736-4c02-bf14-0dfdbecc99e6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:38.041734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4edc5c-c736-4c02-bf14-0dfdbecc99e6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:38.041866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4edc5c-c736-4c02-bf14-0dfdbecc99e6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:38.043255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 665/1335] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:38.048578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd56f0-7388-4771-a945-22c506a84a1d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:38.048969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd56f0-7388-4771-a945-22c506a84a1d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:38.049169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd56f0-7388-4771-a945-22c506a84a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:38.113467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-65dd56f0-7388-4771-a945-22c506a84a1d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:38.114602 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-65dd56f0-7388-4771-a945-22c506a84a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:38.188272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:38.210751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 671/1336] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:38.251374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4edc5c-c736-4c02-bf14-0dfdbecc99e6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:38.252954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ba4edc5c-c736-4c02-bf14-0dfdbecc99e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:38.355470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4edc5c-c736-4c02-bf14-0dfdbecc99e6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:38.382821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:38.427224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fe6b1-7bcb-474b-9170-ecc34af8950d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:38.427899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fe6b1-7bcb-474b-9170-ecc34af8950d service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:38.428213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fe6b1-7bcb-474b-9170-ecc34af8950d service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:38.428497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fe6b1-7bcb-474b-9170-ecc34af8950d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:38.430132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d89fe6b1-7bcb-474b-9170-ecc34af8950d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:38.537779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fe6b1-7bcb-474b-9170-ecc34af8950d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:38.539215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fe6b1-7bcb-474b-9170-ecc34af8950d service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:38.557889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 666/1337] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:40.925220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de597f2-4bc8-4946-931d-f20f230e5461 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:40.925744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de597f2-4bc8-4946-931d-f20f230e5461 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:40.925867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de597f2-4bc8-4946-931d-f20f230e5461 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:40.927151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 672/1338] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:40.933089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51faced-6e9d-4962-8006-1d4f1d088c26 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:40.933502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51faced-6e9d-4962-8006-1d4f1d088c26 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:40.933650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51faced-6e9d-4962-8006-1d4f1d088c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:40.998403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d51faced-6e9d-4962-8006-1d4f1d088c26 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:40.999660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d51faced-6e9d-4962-8006-1d4f1d088c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:41.009137 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:41.102744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 667/1339] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:41.139335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de597f2-4bc8-4946-931d-f20f230e5461 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:41.140967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1de597f2-4bc8-4946-931d-f20f230e5461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:41.245491 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de597f2-4bc8-4946-931d-f20f230e5461 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:41.318312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50222789-d977-42fd-9c61-2319fadfaf20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:41.318956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50222789-d977-42fd-9c61-2319fadfaf20 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:41.319242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50222789-d977-42fd-9c61-2319fadfaf20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:41.319519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50222789-d977-42fd-9c61-2319fadfaf20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:41.321225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-50222789-d977-42fd-9c61-2319fadfaf20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:41.356384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:41.430131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50222789-d977-42fd-9c61-2319fadfaf20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:41.432186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50222789-d977-42fd-9c61-2319fadfaf20 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:41.450259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 673/1340] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:45.432885 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab1636-abb7-4db6-aa14-7ecd531b1e43 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:45.433383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab1636-abb7-4db6-aa14-7ecd531b1e43 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:45.433383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab1636-abb7-4db6-aa14-7ecd531b1e43 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:45.434910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 668/1341] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:45.440366 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1757b-0e5b-465a-9653-797edef630c0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:45.440859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1757b-0e5b-465a-9653-797edef630c0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:45.440964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1757b-0e5b-465a-9653-797edef630c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:45.518392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-06b1757b-0e5b-465a-9653-797edef630c0 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:45.519632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-06b1757b-0e5b-465a-9653-797edef630c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:45.611128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:45.625098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 674/1342] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:45.664476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab1636-abb7-4db6-aa14-7ecd531b1e43 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:45.666605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c0ab1636-abb7-4db6-aa14-7ecd531b1e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:45.762119 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab1636-abb7-4db6-aa14-7ecd531b1e43 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:45.765884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159548e-824c-411f-884f-597c2eb0c450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:45.766535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159548e-824c-411f-884f-597c2eb0c450 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:45.766825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159548e-824c-411f-884f-597c2eb0c450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:45.767106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159548e-824c-411f-884f-597c2eb0c450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:45.776288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159548e-824c-411f-884f-597c2eb0c450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:45.777725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159548e-824c-411f-884f-597c2eb0c450 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:45.787132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 669/1343] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:48.612755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f50a7-3e3c-4db9-888b-c7bddddb9b5b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:48.613328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f50a7-3e3c-4db9-888b-c7bddddb9b5b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:48.613328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f50a7-3e3c-4db9-888b-c7bddddb9b5b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:48.614810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 675/1344] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:48.620472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b0e0d-9fb2-4e97-8ea9-d8b1a6620af8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:48.620972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b0e0d-9fb2-4e97-8ea9-d8b1a6620af8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:48.621062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b0e0d-9fb2-4e97-8ea9-d8b1a6620af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:48.651194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-588b0e0d-9fb2-4e97-8ea9-d8b1a6620af8 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:48.652755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-588b0e0d-9fb2-4e97-8ea9-d8b1a6620af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:48.683858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:15:48.736972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 670/1345] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:48.775225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f50a7-3e3c-4db9-888b-c7bddddb9b5b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:48.785901 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f50a7-3e3c-4db9-888b-c7bddddb9b5b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:48.789458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56c3de-0fba-47ab-a461-2843ddf158ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:48.790183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56c3de-0fba-47ab-a461-2843ddf158ff service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:48.790533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56c3de-0fba-47ab-a461-2843ddf158ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:48.790876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56c3de-0fba-47ab-a461-2843ddf158ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:48.800285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56c3de-0fba-47ab-a461-2843ddf158ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:48.801717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56c3de-0fba-47ab-a461-2843ddf158ff service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:48.815053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 676/1346] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:53.112912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0c2a-f9af-41a4-8cf0-482eb48921d3 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:53.113440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0c2a-f9af-41a4-8cf0-482eb48921d3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:53.113440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0c2a-f9af-41a4-8cf0-482eb48921d3 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:53.114796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 671/1347] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:53.120731 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec557f3-6813-4809-bf59-111ca8532d13 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:53.121232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec557f3-6813-4809-bf59-111ca8532d13 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:53.121406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec557f3-6813-4809-bf59-111ca8532d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:53.139318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-aec557f3-6813-4809-bf59-111ca8532d13 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:53.140552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aec557f3-6813-4809-bf59-111ca8532d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:53.148407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 677/1348] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:15:53.186237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab0c2a-f9af-41a4-8cf0-482eb48921d3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:15:53.197436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab0c2a-f9af-41a4-8cf0-482eb48921d3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:15:53.200952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbad4d-c01e-45bc-a113-4f8890cada7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:15:53.201586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbad4d-c01e-45bc-a113-4f8890cada7d service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:53.201866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbad4d-c01e-45bc-a113-4f8890cada7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:53.202139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbad4d-c01e-45bc-a113-4f8890cada7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:53.210994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbad4d-c01e-45bc-a113-4f8890cada7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:15:53.212463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbad4d-c01e-45bc-a113-4f8890cada7d service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:15:53.221954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 672/1349] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:15:58.300212 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4898742-aa61-45bc-9f26-63e823378b21 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:58.301119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4898742-aa61-45bc-9f26-63e823378b21 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:58.301579 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4898742-aa61-45bc-9f26-63e823378b21 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:58.303830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 678/1350] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:15:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:15:58.309524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ffbc7-982e-42bd-9afa-bddb95ce677b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:15:58.310316 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ffbc7-982e-42bd-9afa-bddb95ce677b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:15:58.310831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ffbc7-982e-42bd-9afa-bddb95ce677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:15:58.389216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b26ffbc7-982e-42bd-9afa-bddb95ce677b None None] MFA Rules not processed for user `c89ae81d49214b75a747a6cfa3ddf0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:15:58.390339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b26ffbc7-982e-42bd-9afa-bddb95ce677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:15:58.477374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 673/1351] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:02.649749 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771ce7d-0433-4046-97b4-4c27ee32deb6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:02.650295 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771ce7d-0433-4046-97b4-4c27ee32deb6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:02.650295 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771ce7d-0433-4046-97b4-4c27ee32deb6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:02.651959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 679/1352] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:02.657225 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f910418-bc42-400a-8958-6e5c72b98ff3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:02.657662 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f910418-bc42-400a-8958-6e5c72b98ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:02.657789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f910418-bc42-400a-8958-6e5c72b98ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:02.678230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9f910418-bc42-400a-8958-6e5c72b98ff3 None None] MFA Rules not processed for user `c89ae81d49214b75a747a6cfa3ddf0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:02.679441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9f910418-bc42-400a-8958-6e5c72b98ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:02.690256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 674/1353] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:03.136502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=13 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:16:04.177808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459a86-03d5-42a8-b0b7-12792f14102a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:04.178450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459a86-03d5-42a8-b0b7-12792f14102a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:04.178450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459a86-03d5-42a8-b0b7-12792f14102a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:04.179972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 680/1354] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:04.185189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db924d0-ca7c-4c74-904d-6a0115cb0f2c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:04.185616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db924d0-ca7c-4c74-904d-6a0115cb0f2c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:04.185744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db924d0-ca7c-4c74-904d-6a0115cb0f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:04.204540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9db924d0-ca7c-4c74-904d-6a0115cb0f2c None None] MFA Rules not processed for user `c89ae81d49214b75a747a6cfa3ddf0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:04.205842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9db924d0-ca7c-4c74-904d-6a0115cb0f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:04.215189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 675/1355] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:07.923724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ab52-c9f5-418c-ab84-d76e90325972 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:07.924609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ab52-c9f5-418c-ab84-d76e90325972 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:07.925039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ab52-c9f5-418c-ab84-d76e90325972 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:07.932462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 681/1356] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:07.934430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b992c4-31cb-4744-904e-8b4c73d13834 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:07.935265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b992c4-31cb-4744-904e-8b4c73d13834 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:07.937230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b992c4-31cb-4744-904e-8b4c73d13834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:07.963024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-35b992c4-31cb-4744-904e-8b4c73d13834 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:07.964539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-35b992c4-31cb-4744-904e-8b4c73d13834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:07.973025 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 676/1357] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:08.027614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33992-9ec5-4c2e-9d84-aa65ae7ec599 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:08.028603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33992-9ec5-4c2e-9d84-aa65ae7ec599 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:08.029299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33992-9ec5-4c2e-9d84-aa65ae7ec599 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:08.031314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 682/1358] 10.222.0.66 () {54 vars in 961 bytes} [Wed Jun 22 12:16:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:08.048095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad439e-af35-44d7-a690-263aaf7ab349 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:08.048896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad439e-af35-44d7-a690-263aaf7ab349 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:08.049408 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad439e-af35-44d7-a690-263aaf7ab349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:08.092545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:16:08.102647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-edad439e-af35-44d7-a690-263aaf7ab349 None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:08.103927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-edad439e-af35-44d7-a690-263aaf7ab349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:08.191958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 677/1359] 10.222.0.66 () {58 vars in 1058 bytes} [Wed Jun 22 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:08.200505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33992-9ec5-4c2e-9d84-aa65ae7ec599 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:08.215639 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33992-9ec5-4c2e-9d84-aa65ae7ec599 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:08.221204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bd245-689d-45e3-b72d-3650225a1805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:08.221853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bd245-689d-45e3-b72d-3650225a1805 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:08.222141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bd245-689d-45e3-b72d-3650225a1805 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:08.222424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bd245-689d-45e3-b72d-3650225a1805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:08.231424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bd245-689d-45e3-b72d-3650225a1805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:08.233133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bd245-689d-45e3-b72d-3650225a1805 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:08.244321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 683/1360] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:16:10.480340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00564e-9e70-4c8e-88e6-a4b97fd6b773 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:10.480862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00564e-9e70-4c8e-88e6-a4b97fd6b773 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:10.480975 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00564e-9e70-4c8e-88e6-a4b97fd6b773 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:10.482271 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 678/1361] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:10.487459 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df78a-0607-4f81-9ae0-35cd35b4a430 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:10.487890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df78a-0607-4f81-9ae0-35cd35b4a430 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:10.488011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df78a-0607-4f81-9ae0-35cd35b4a430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:10.508840 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-149df78a-0607-4f81-9ae0-35cd35b4a430 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:10.510073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-149df78a-0607-4f81-9ae0-35cd35b4a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:10.518585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 684/1362] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:10.563555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00564e-9e70-4c8e-88e6-a4b97fd6b773 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:10.578844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00564e-9e70-4c8e-88e6-a4b97fd6b773 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:10.584426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c27980-ec38-4be9-a893-cdcc5d9c03e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:10.585101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c27980-ec38-4be9-a893-cdcc5d9c03e8 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:10.585387 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c27980-ec38-4be9-a893-cdcc5d9c03e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:10.585686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c27980-ec38-4be9-a893-cdcc5d9c03e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:10.595129 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c27980-ec38-4be9-a893-cdcc5d9c03e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:10.596894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c27980-ec38-4be9-a893-cdcc5d9c03e8 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:10.607676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 679/1363] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:12.963641 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e85a57-f458-430c-b599-b50453d347f8 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:12.964195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e85a57-f458-430c-b599-b50453d347f8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:12.964290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e85a57-f458-430c-b599-b50453d347f8 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:12.965605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 685/1364] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:12.971068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb40a6-3d4d-44f7-bf38-e953234e30a2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:12.971459 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb40a6-3d4d-44f7-bf38-e953234e30a2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:12.971549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb40a6-3d4d-44f7-bf38-e953234e30a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:12.990389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-80eb40a6-3d4d-44f7-bf38-e953234e30a2 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:12.991962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-80eb40a6-3d4d-44f7-bf38-e953234e30a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:13.000133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 680/1365] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:13.058401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129570-c293-4d37-839c-1530043d5783 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:13.058685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129570-c293-4d37-839c-1530043d5783 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:13.059141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129570-c293-4d37-839c-1530043d5783 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:13.061054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 686/1366] 10.222.0.66 () {54 vars in 961 bytes} [Wed Jun 22 12:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:13.068715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42b416-9442-4218-a687-c828da5a475a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:13.069226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42b416-9442-4218-a687-c828da5a475a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:13.069625 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42b416-9442-4218-a687-c828da5a475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:13.090649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ef42b416-9442-4218-a687-c828da5a475a None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:13.092000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ef42b416-9442-4218-a687-c828da5a475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:13.101427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 681/1367] 10.222.0.66 () {58 vars in 1058 bytes} [Wed Jun 22 12:16:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:13.109893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f129570-c293-4d37-839c-1530043d5783 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:13.124690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f129570-c293-4d37-839c-1530043d5783 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:13.130157 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a53022-ca16-4bc4-bcb3-ff0ad876b1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:13.130875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53022-ca16-4bc4-bcb3-ff0ad876b1ed service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:13.131228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53022-ca16-4bc4-bcb3-ff0ad876b1ed service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:13.131605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a53022-ca16-4bc4-bcb3-ff0ad876b1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:13.141080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a53022-ca16-4bc4-bcb3-ff0ad876b1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:13.142745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a53022-ca16-4bc4-bcb3-ff0ad876b1ed service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:13.153396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 687/1368] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:15.280337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5fa6-d1c9-47c9-b262-b7deb12f0f37 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:15.280917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5fa6-d1c9-47c9-b262-b7deb12f0f37 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:15.280917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5fa6-d1c9-47c9-b262-b7deb12f0f37 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:15.282269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 682/1369] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:15.287582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d9b5-3973-4b73-bf67-26a99c1f95f9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:15.287982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d9b5-3973-4b73-bf67-26a99c1f95f9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:15.288184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d9b5-3973-4b73-bf67-26a99c1f95f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:15.306360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a381d9b5-3973-4b73-bf67-26a99c1f95f9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:15.307595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a381d9b5-3973-4b73-bf67-26a99c1f95f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:15.316048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 688/1370] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:16:15.361028 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f5fa6-d1c9-47c9-b262-b7deb12f0f37 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:15.375465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f5fa6-d1c9-47c9-b262-b7deb12f0f37 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:15.381015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608fa18-63d8-4e58-9041-296ab100fc02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:15.381658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608fa18-63d8-4e58-9041-296ab100fc02 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:15.381947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608fa18-63d8-4e58-9041-296ab100fc02 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:15.382228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608fa18-63d8-4e58-9041-296ab100fc02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:15.391687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608fa18-63d8-4e58-9041-296ab100fc02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:15.393310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608fa18-63d8-4e58-9041-296ab100fc02 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:15.404058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 683/1371] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:16.069743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d220f9a-b79f-4dee-8f93-09c2b31b2569 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:16.070038 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d220f9a-b79f-4dee-8f93-09c2b31b2569 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:16.072867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d220f9a-b79f-4dee-8f93-09c2b31b2569 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:16.072867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 689/1372] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:16.078449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9283e9c-243d-4966-adba-185c5678ed93 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:16.078735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9283e9c-243d-4966-adba-185c5678ed93 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:16.079014 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9283e9c-243d-4966-adba-185c5678ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:16.100850 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a9283e9c-243d-4966-adba-185c5678ed93 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:16.102056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a9283e9c-243d-4966-adba-185c5678ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:16.115400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 684/1373] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:16.468954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e154d-6d46-466d-b2b4-7203e0db56cc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:16.468954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e154d-6d46-466d-b2b4-7203e0db56cc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:16.468954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e154d-6d46-466d-b2b4-7203e0db56cc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:16.470256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 690/1374] 10.222.0.66 () {54 vars in 963 bytes} [Wed Jun 22 12:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:16.474899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5ecf9-9be2-49aa-8bdc-aaa2cce90451 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:16.475366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5ecf9-9be2-49aa-8bdc-aaa2cce90451 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:16.475510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5ecf9-9be2-49aa-8bdc-aaa2cce90451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:16.527929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4ce5ecf9-9be2-49aa-8bdc-aaa2cce90451 None None] MFA Rules not processed for user `eeb4a8bcbc374f139db9e6e134b6d681`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:16.529186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4ce5ecf9-9be2-49aa-8bdc-aaa2cce90451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:16.595302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 685/1375] 10.222.0.66 () {58 vars in 1060 bytes} [Wed Jun 22 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:16.603288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e154d-6d46-466d-b2b4-7203e0db56cc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:16.614128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e154d-6d46-466d-b2b4-7203e0db56cc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:16.617741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d09a0e-0212-425b-8e45-dc34fd7deafe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:16.618381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09a0e-0212-425b-8e45-dc34fd7deafe service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:16.618666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09a0e-0212-425b-8e45-dc34fd7deafe service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:16.618942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09a0e-0212-425b-8e45-dc34fd7deafe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:16.628784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d09a0e-0212-425b-8e45-dc34fd7deafe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:16.630225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d09a0e-0212-425b-8e45-dc34fd7deafe service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:16.641150 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 691/1376] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:17.499875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8010a-7c10-4c23-953c-b208942f36ce None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:17.500409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8010a-7c10-4c23-953c-b208942f36ce None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:17.500409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8010a-7c10-4c23-953c-b208942f36ce None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:17.504632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 686/1377] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:17.508821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1995c77-52ce-446d-ab25-745c00ea055f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:17.509416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1995c77-52ce-446d-ab25-745c00ea055f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:17.509416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1995c77-52ce-446d-ab25-745c00ea055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:17.528009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a1995c77-52ce-446d-ab25-745c00ea055f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:17.533583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a1995c77-52ce-446d-ab25-745c00ea055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:17.547478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 692/1378] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:17.592396 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8010a-7c10-4c23-953c-b208942f36ce None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:17.606735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8010a-7c10-4c23-953c-b208942f36ce None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:17.612143 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42802e68-f495-49d8-af25-5db536c9c16b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:17.612786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42802e68-f495-49d8-af25-5db536c9c16b service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:17.613071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42802e68-f495-49d8-af25-5db536c9c16b service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:17.613349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42802e68-f495-49d8-af25-5db536c9c16b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:17.621915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42802e68-f495-49d8-af25-5db536c9c16b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:17.623497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42802e68-f495-49d8-af25-5db536c9c16b service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:17.627553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:16:17.635128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 687/1379] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:19.709789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec049e10-3184-4dfa-ab15-d73f6e20a360 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:19.710310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec049e10-3184-4dfa-ab15-d73f6e20a360 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:19.710310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec049e10-3184-4dfa-ab15-d73f6e20a360 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:19.711717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 693/1380] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:19.717208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b1d29-efeb-40f6-8c82-b243e40670b0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:19.717686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b1d29-efeb-40f6-8c82-b243e40670b0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:19.717887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b1d29-efeb-40f6-8c82-b243e40670b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:19.740595 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a29b1d29-efeb-40f6-8c82-b243e40670b0 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:19.741822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a29b1d29-efeb-40f6-8c82-b243e40670b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:19.750518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 688/1381] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:19.794843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec049e10-3184-4dfa-ab15-d73f6e20a360 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:19.810530 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec049e10-3184-4dfa-ab15-d73f6e20a360 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:19.815927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c52f56-e24f-426c-b4a6-72ac422695d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:19.816660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52f56-e24f-426c-b4a6-72ac422695d5 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:19.816878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52f56-e24f-426c-b4a6-72ac422695d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:19.817153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52f56-e24f-426c-b4a6-72ac422695d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:19.825724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c52f56-e24f-426c-b4a6-72ac422695d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:19.827338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c52f56-e24f-426c-b4a6-72ac422695d5 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:19.837133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 694/1382] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:16:21.947677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc6c3f-612c-482e-915b-e4a51b0b38e7 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:21.948504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc6c3f-612c-482e-915b-e4a51b0b38e7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:21.948795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc6c3f-612c-482e-915b-e4a51b0b38e7 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:21.950192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 689/1383] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:21.955781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f214bb-3eda-4103-9e09-eb65b84972e8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:21.956276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f214bb-3eda-4103-9e09-eb65b84972e8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:21.956573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f214bb-3eda-4103-9e09-eb65b84972e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:21.976789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b2f214bb-3eda-4103-9e09-eb65b84972e8 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:21.978165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b2f214bb-3eda-4103-9e09-eb65b84972e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:21.986658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 695/1384] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:22.030757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc6c3f-612c-482e-915b-e4a51b0b38e7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:22.045920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc6c3f-612c-482e-915b-e4a51b0b38e7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:22.051324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15f5a7-3839-4725-ba23-1236c0c5df7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:22.052115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15f5a7-3839-4725-ba23-1236c0c5df7e service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:22.052500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15f5a7-3839-4725-ba23-1236c0c5df7e service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:22.052889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15f5a7-3839-4725-ba23-1236c0c5df7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:22.062017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15f5a7-3839-4725-ba23-1236c0c5df7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:22.063749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15f5a7-3839-4725-ba23-1236c0c5df7e service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:22.074723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 690/1385] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:24.145786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117e45-89e0-4fa1-b622-31b7c8c06374 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:24.146223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117e45-89e0-4fa1-b622-31b7c8c06374 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:24.146535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117e45-89e0-4fa1-b622-31b7c8c06374 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:24.147713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 696/1386] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:24.155546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0c142-28f7-42de-936d-f15e8a0a7868 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:24.155951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0c142-28f7-42de-936d-f15e8a0a7868 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:24.156541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0c142-28f7-42de-936d-f15e8a0a7868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:24.182545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5df0c142-28f7-42de-936d-f15e8a0a7868 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:24.183038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5df0c142-28f7-42de-936d-f15e8a0a7868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:24.193667 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 691/1387] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:24.238912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117e45-89e0-4fa1-b622-31b7c8c06374 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:24.254161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117e45-89e0-4fa1-b622-31b7c8c06374 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:24.259668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6f330-7572-46e1-8960-b5bd8b90100d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:24.260324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f330-7572-46e1-8960-b5bd8b90100d service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:24.260607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f330-7572-46e1-8960-b5bd8b90100d service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:24.260882 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f330-7572-46e1-8960-b5bd8b90100d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:24.269907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6f330-7572-46e1-8960-b5bd8b90100d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:24.271496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6f330-7572-46e1-8960-b5bd8b90100d service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:24.281307 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 697/1388] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:26.619150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5687c-80dd-4779-a53f-56fc6f50a935 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:26.619732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5687c-80dd-4779-a53f-56fc6f50a935 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:26.619968 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5687c-80dd-4779-a53f-56fc6f50a935 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:26.621903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 692/1389] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:26.627379 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce705433-b24a-402e-9392-5f20c036c822 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:26.627891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce705433-b24a-402e-9392-5f20c036c822 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:26.627996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce705433-b24a-402e-9392-5f20c036c822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:26.646572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ce705433-b24a-402e-9392-5f20c036c822 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:26.647791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ce705433-b24a-402e-9392-5f20c036c822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:26.656382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 698/1390] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:16:26.710505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5687c-80dd-4779-a53f-56fc6f50a935 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:26.725825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5687c-80dd-4779-a53f-56fc6f50a935 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:26.731975 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0d5d3-b07a-41ab-8b15-40521e50c5e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:26.732726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0d5d3-b07a-41ab-8b15-40521e50c5e3 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:26.732965 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0d5d3-b07a-41ab-8b15-40521e50c5e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:26.733243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0d5d3-b07a-41ab-8b15-40521e50c5e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:26.741960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0d5d3-b07a-41ab-8b15-40521e50c5e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:26.743594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0d5d3-b07a-41ab-8b15-40521e50c5e3 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:26.754883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 693/1391] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:29.033980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60d117-a2e3-48a5-99ae-e4b53004e89e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:29.034834 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60d117-a2e3-48a5-99ae-e4b53004e89e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:29.035045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60d117-a2e3-48a5-99ae-e4b53004e89e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:29.037385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 699/1392] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:29.045236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666c11a-4cde-4545-b316-c63b25c42ed8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:29.045789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666c11a-4cde-4545-b316-c63b25c42ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:29.046255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666c11a-4cde-4545-b316-c63b25c42ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:29.076750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5666c11a-4cde-4545-b316-c63b25c42ed8 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:29.079008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5666c11a-4cde-4545-b316-c63b25c42ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:29.093447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 694/1393] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:29.140384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60d117-a2e3-48a5-99ae-e4b53004e89e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:29.155862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60d117-a2e3-48a5-99ae-e4b53004e89e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:29.161688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9cd2a-106d-466f-9fec-c4cc3064f755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:29.162436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9cd2a-106d-466f-9fec-c4cc3064f755 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:29.162736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9cd2a-106d-466f-9fec-c4cc3064f755 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:29.163030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9cd2a-106d-466f-9fec-c4cc3064f755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:29.173242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9cd2a-106d-466f-9fec-c4cc3064f755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:29.174865 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9cd2a-106d-466f-9fec-c4cc3064f755 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:29.184968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 700/1394] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:31.279508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bccea-f871-49a3-a89e-47bd73c8c0a1 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:31.280087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bccea-f871-49a3-a89e-47bd73c8c0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:31.280087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bccea-f871-49a3-a89e-47bd73c8c0a1 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:31.281558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 695/1395] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:31.286833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9616a5-30dd-4686-9731-bc370cf5019a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:31.287304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9616a5-30dd-4686-9731-bc370cf5019a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:31.287541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9616a5-30dd-4686-9731-bc370cf5019a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:31.305834 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4b9616a5-30dd-4686-9731-bc370cf5019a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:31.307048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4b9616a5-30dd-4686-9731-bc370cf5019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:31.315353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 701/1396] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:31.359943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bccea-f871-49a3-a89e-47bd73c8c0a1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:31.374966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bccea-f871-49a3-a89e-47bd73c8c0a1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:31.380331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaf254-1641-4d85-b1ed-f9b7ee393436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:31.380965 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaf254-1641-4d85-b1ed-f9b7ee393436 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:31.381246 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaf254-1641-4d85-b1ed-f9b7ee393436 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:31.381526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaf254-1641-4d85-b1ed-f9b7ee393436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:31.390770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aaf254-1641-4d85-b1ed-f9b7ee393436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:31.392391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aaf254-1641-4d85-b1ed-f9b7ee393436 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:31.401786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 696/1397] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:31.823496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5641af-5d84-4b88-bd64-fc050a4ab441 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:31.823933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5641af-5d84-4b88-bd64-fc050a4ab441 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:31.824237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5641af-5d84-4b88-bd64-fc050a4ab441 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:31.825680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 702/1398] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:31.831130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5153b-ae42-4a54-8b80-98d76060924d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:31.831518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5153b-ae42-4a54-8b80-98d76060924d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:31.831866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5153b-ae42-4a54-8b80-98d76060924d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:31.849744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4ec5153b-ae42-4a54-8b80-98d76060924d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:31.850973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4ec5153b-ae42-4a54-8b80-98d76060924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:31.859551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 697/1399] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:31.916377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bf63e-fd31-44a6-ae2e-a3587e2044d2 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:31.916669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bf63e-fd31-44a6-ae2e-a3587e2044d2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:31.916951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bf63e-fd31-44a6-ae2e-a3587e2044d2 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:31.918328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 703/1400] 10.222.0.66 () {54 vars in 962 bytes} [Wed Jun 22 12:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:31.923440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05def636-3e7a-468f-a0ab-6ca2ed545b3c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:31.923743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05def636-3e7a-468f-a0ab-6ca2ed545b3c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:31.924061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05def636-3e7a-468f-a0ab-6ca2ed545b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:31.973710 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-05def636-3e7a-468f-a0ab-6ca2ed545b3c None None] MFA Rules not processed for user `d82125a47ce044b389684b97c7097ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:31.974916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-05def636-3e7a-468f-a0ab-6ca2ed545b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:32.036132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 698/1401] 10.222.0.66 () {58 vars in 1059 bytes} [Wed Jun 22 12:16:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:32.044103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bf63e-fd31-44a6-ae2e-a3587e2044d2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:32.054815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bf63e-fd31-44a6-ae2e-a3587e2044d2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:32.058324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf6af7-edb7-46f3-b536-ae3bb85cc4e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd82125a47ce044b389684b97c7097ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:32.058959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf6af7-edb7-46f3-b536-ae3bb85cc4e9 service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:32.059244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf6af7-edb7-46f3-b536-ae3bb85cc4e9 service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:32.059524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf6af7-edb7-46f3-b536-ae3bb85cc4e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:32.068626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf6af7-edb7-46f3-b536-ae3bb85cc4e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:32.070084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf6af7-edb7-46f3-b536-ae3bb85cc4e9 service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:32.079747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 704/1402] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:32.796242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd80ec-c86f-40c9-aacf-639b906eee16 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:32.796719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd80ec-c86f-40c9-aacf-639b906eee16 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:32.796830 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd80ec-c86f-40c9-aacf-639b906eee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:32.845839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-dddd80ec-c86f-40c9-aacf-639b906eee16 None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:32.847033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dddd80ec-c86f-40c9-aacf-639b906eee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:32.886986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:16:32.910964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 699/1403] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:32.953034 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e959aa-f78d-4f8e-9b44-6e7a418fdc25 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:32.953528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e959aa-f78d-4f8e-9b44-6e7a418fdc25 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:32.953649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e959aa-f78d-4f8e-9b44-6e7a418fdc25 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:32.955010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 705/1404] 10.222.0.66 () {54 vars in 942 bytes} [Wed Jun 22 12:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:32.961671 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8c612-4618-4d38-8bb3-875fd8b0f345 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:32.961963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8c612-4618-4d38-8bb3-875fd8b0f345 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:32.962248 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8c612-4618-4d38-8bb3-875fd8b0f345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:33.013211 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-62f8c612-4618-4d38-8bb3-875fd8b0f345 None None] MFA Rules not processed for user `254b5c1a59e94596bf942192b4a30ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:33.014588 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-62f8c612-4618-4d38-8bb3-875fd8b0f345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:33.088283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 700/1405] 10.222.0.66 () {58 vars in 1039 bytes} [Wed Jun 22 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:33.098289 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e959aa-f78d-4f8e-9b44-6e7a418fdc25 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:33.111601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e959aa-f78d-4f8e-9b44-6e7a418fdc25 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:33.116653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05670534-13fa-4200-9d58-1f0488d81637 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:33.117810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05670534-13fa-4200-9d58-1f0488d81637 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:33.118091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05670534-13fa-4200-9d58-1f0488d81637 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:33.118369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05670534-13fa-4200-9d58-1f0488d81637 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:33.126907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05670534-13fa-4200-9d58-1f0488d81637 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:33.128517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05670534-13fa-4200-9d58-1f0488d81637 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:33.137678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 706/1406] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:16:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:16:33.499185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93868-7ad3-472a-ab24-dc9227ad03da None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:33.499936 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93868-7ad3-472a-ab24-dc9227ad03da None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:33.500419 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93868-7ad3-472a-ab24-dc9227ad03da None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:33.501962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 701/1407] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:33.508399 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499d8f6-9a20-40af-8208-c050f4c33f04 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:33.508855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499d8f6-9a20-40af-8208-c050f4c33f04 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:33.509293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499d8f6-9a20-40af-8208-c050f4c33f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:33.518785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=67 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:16:33.532425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b499d8f6-9a20-40af-8208-c050f4c33f04 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:33.534116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b499d8f6-9a20-40af-8208-c050f4c33f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:33.542580 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 707/1408] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:33.589356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d93868-7ad3-472a-ab24-dc9227ad03da None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:33.608142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d93868-7ad3-472a-ab24-dc9227ad03da None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:33.613857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7664d-240d-4e7f-8c00-c31d00a5f18e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:33.614786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7664d-240d-4e7f-8c00-c31d00a5f18e service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:33.615071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7664d-240d-4e7f-8c00-c31d00a5f18e service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:33.615347 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7664d-240d-4e7f-8c00-c31d00a5f18e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:33.624807 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7664d-240d-4e7f-8c00-c31d00a5f18e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:33.626332 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7664d-240d-4e7f-8c00-c31d00a5f18e service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:33.640354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 702/1409] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:43.526934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:16:43.634142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=59 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:16:55.348973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e0f5-daad-4ffc-adbc-6363efcfcd27 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:55.349545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e0f5-daad-4ffc-adbc-6363efcfcd27 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:55.349545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e0f5-daad-4ffc-adbc-6363efcfcd27 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:55.350943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 708/1410] 10.222.0.66 () {54 vars in 918 bytes} [Wed Jun 22 12:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:55.356154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255aedc-ba63-49c1-914d-bafedac4c3a2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:55.356588 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255aedc-ba63-49c1-914d-bafedac4c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:55.356722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255aedc-ba63-49c1-914d-bafedac4c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:55.375276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6255aedc-ba63-49c1-914d-bafedac4c3a2 None None] MFA Rules not processed for user `c89ae81d49214b75a747a6cfa3ddf0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:55.376509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6255aedc-ba63-49c1-914d-bafedac4c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:55.385652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 703/1411] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Jun 22 12:16:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:55.400068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6b80-c4f8-48c9-bc29-249f7e73461d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:55.400368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6b80-c4f8-48c9-bc29-249f7e73461d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:55.400648 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6b80-c4f8-48c9-bc29-249f7e73461d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:55.402071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 709/1412] 10.222.0.66 () {54 vars in 918 bytes} [Wed Jun 22 12:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:55.406608 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a9d5-efe8-4bd7-bc0c-9a1066b3c246 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:55.406925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a9d5-efe8-4bd7-bc0c-9a1066b3c246 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:55.407202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a9d5-efe8-4bd7-bc0c-9a1066b3c246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:55.424998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bf55a9d5-efe8-4bd7-bc0c-9a1066b3c246 None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:55.426207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bf55a9d5-efe8-4bd7-bc0c-9a1066b3c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:55.435881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 704/1413] 10.222.0.66 () {58 vars in 1015 bytes} [Wed Jun 22 12:16:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:57.946643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d74af9-753d-4d60-a769-81c04ea7bc92 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:57.947193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d74af9-753d-4d60-a769-81c04ea7bc92 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:57.947193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d74af9-753d-4d60-a769-81c04ea7bc92 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:57.948615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:57.953913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066256a2-cd2e-439f-9742-bd2742cea0f0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:57.954354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066256a2-cd2e-439f-9742-bd2742cea0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:57.954499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066256a2-cd2e-439f-9742-bd2742cea0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:57.972844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-066256a2-cd2e-439f-9742-bd2742cea0f0 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:57.974029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-066256a2-cd2e-439f-9742-bd2742cea0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:57.981914 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:58.026524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d74af9-753d-4d60-a769-81c04ea7bc92 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:58.041299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d74af9-753d-4d60-a769-81c04ea7bc92 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:58.047195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bf9ab-82b7-4060-8dd1-809fa5ad921e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:58.047830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bf9ab-82b7-4060-8dd1-809fa5ad921e service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:58.048147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bf9ab-82b7-4060-8dd1-809fa5ad921e service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:58.048424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bf9ab-82b7-4060-8dd1-809fa5ad921e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:58.056971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bf9ab-82b7-4060-8dd1-809fa5ad921e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:58.058620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bf9ab-82b7-4060-8dd1-809fa5ad921e service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:58.068289 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 711/1416] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:16:58.966152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d4f5a-d31d-45c8-a224-b5accbf1af0a None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:58.966706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d4f5a-d31d-45c8-a224-b5accbf1af0a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:58.966809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d4f5a-d31d-45c8-a224-b5accbf1af0a None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:58.968173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:16:58.973236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382c2aa-26e0-40b7-92e9-2b74e280bff9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:58.973658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382c2aa-26e0-40b7-92e9-2b74e280bff9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:58.973804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382c2aa-26e0-40b7-92e9-2b74e280bff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:58.994483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9382c2aa-26e0-40b7-92e9-2b74e280bff9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:16:58.996045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9382c2aa-26e0-40b7-92e9-2b74e280bff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:16:59.004230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:16:59.155573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d4f5a-d31d-45c8-a224-b5accbf1af0a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:16:59.169819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d4f5a-d31d-45c8-a224-b5accbf1af0a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:16:59.175184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c35bd-9217-491f-a0b1-641a584743e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:16:59.175814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c35bd-9217-491f-a0b1-641a584743e5 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:16:59.176139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c35bd-9217-491f-a0b1-641a584743e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:16:59.176427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c35bd-9217-491f-a0b1-641a584743e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:16:59.184980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c35bd-9217-491f-a0b1-641a584743e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:16:59.186594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c35bd-9217-491f-a0b1-641a584743e5 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:16:59.196525 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 707/1419] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:00.076278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef46ee-0975-4a11-91cf-04e597b0716a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:00.076824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef46ee-0975-4a11-91cf-04e597b0716a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:00.076824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef46ee-0975-4a11-91cf-04e597b0716a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:00.078213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:00.083384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546bb4f-6422-40d4-b730-4ef9465b912c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:00.083790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546bb4f-6422-40d4-b730-4ef9465b912c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:00.083922 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546bb4f-6422-40d4-b730-4ef9465b912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:00.103501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d546bb4f-6422-40d4-b730-4ef9465b912c None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:00.104735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d546bb4f-6422-40d4-b730-4ef9465b912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:00.112488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:00.265376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef46ee-0975-4a11-91cf-04e597b0716a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:00.280225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef46ee-0975-4a11-91cf-04e597b0716a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:00.285568 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aa318-1391-410c-83e9-77daa4f5a01e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:00.286200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa318-1391-410c-83e9-77daa4f5a01e service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:00.286488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa318-1391-410c-83e9-77daa4f5a01e service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:00.286772 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa318-1391-410c-83e9-77daa4f5a01e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:00.294912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aa318-1391-410c-83e9-77daa4f5a01e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:00.296527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aa318-1391-410c-83e9-77daa4f5a01e service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:00.306015 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 714/1422] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:01.173065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430209-450e-426d-8685-af9bec43134b None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:01.173647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430209-450e-426d-8685-af9bec43134b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:01.173759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430209-450e-426d-8685-af9bec43134b None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:01.175224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:01.180432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82897e81-46d7-4b05-bf0a-6b73501821de None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:01.180889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82897e81-46d7-4b05-bf0a-6b73501821de None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:01.180995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82897e81-46d7-4b05-bf0a-6b73501821de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:01.199487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-82897e81-46d7-4b05-bf0a-6b73501821de None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:01.200723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-82897e81-46d7-4b05-bf0a-6b73501821de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:01.208359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:17:01.356408 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19430209-450e-426d-8685-af9bec43134b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:01.371766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19430209-450e-426d-8685-af9bec43134b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:01.377113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b86c2-56a6-4abf-bee2-50f25dde0067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:01.377742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b86c2-56a6-4abf-bee2-50f25dde0067 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:01.378019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b86c2-56a6-4abf-bee2-50f25dde0067 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:01.378293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b86c2-56a6-4abf-bee2-50f25dde0067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:01.387108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b86c2-56a6-4abf-bee2-50f25dde0067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:01.388987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b86c2-56a6-4abf-bee2-50f25dde0067 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:01.398244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 710/1425] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:02.266134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2fbd7-7558-4445-af09-c655886a837c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:02.266730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2fbd7-7558-4445-af09-c655886a837c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:02.266730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2fbd7-7558-4445-af09-c655886a837c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:02.268118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:02.273050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c4f65-e60e-4ca6-b78a-0b707c0e5634 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:02.273441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c4f65-e60e-4ca6-b78a-0b707c0e5634 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:02.273613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c4f65-e60e-4ca6-b78a-0b707c0e5634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:02.291072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cd3c4f65-e60e-4ca6-b78a-0b707c0e5634 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:02.292429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cd3c4f65-e60e-4ca6-b78a-0b707c0e5634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:02.300465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:02.450195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2fbd7-7558-4445-af09-c655886a837c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:02.464397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2fbd7-7558-4445-af09-c655886a837c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:02.469811 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1614a-3ecb-4d73-a68f-adbeb3270a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:02.470441 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1614a-3ecb-4d73-a68f-adbeb3270a8f service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:02.470729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1614a-3ecb-4d73-a68f-adbeb3270a8f service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:02.471012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1614a-3ecb-4d73-a68f-adbeb3270a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:02.479848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1614a-3ecb-4d73-a68f-adbeb3270a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:02.481471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1614a-3ecb-4d73-a68f-adbeb3270a8f service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:02.491612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 717/1428] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:03.298385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7184eb-6a15-43f9-9df2-9250c5060050 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:03.298925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7184eb-6a15-43f9-9df2-9250c5060050 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:03.298925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7184eb-6a15-43f9-9df2-9250c5060050 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:03.300434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:03.305894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168a11-6539-4522-bee7-6babf913ff77 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:03.306301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168a11-6539-4522-bee7-6babf913ff77 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:03.306455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168a11-6539-4522-bee7-6babf913ff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:03.324123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-96168a11-6539-4522-bee7-6babf913ff77 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:03.325333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-96168a11-6539-4522-bee7-6babf913ff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:03.333089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:03.484307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7184eb-6a15-43f9-9df2-9250c5060050 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:03.499120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7184eb-6a15-43f9-9df2-9250c5060050 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:03.504466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1545278-58e9-41e1-a086-4cfac74578e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:03.505105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545278-58e9-41e1-a086-4cfac74578e0 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:03.505384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545278-58e9-41e1-a086-4cfac74578e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:03.505659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545278-58e9-41e1-a086-4cfac74578e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:03.514639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1545278-58e9-41e1-a086-4cfac74578e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:03.516265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1545278-58e9-41e1-a086-4cfac74578e0 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:03.526072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 713/1431] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:04.329009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4481425-9c7e-4c43-a4e5-f75dc77abd4c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:04.329552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4481425-9c7e-4c43-a4e5-f75dc77abd4c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:04.329552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4481425-9c7e-4c43-a4e5-f75dc77abd4c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:04.330996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:04.336565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6e59a-f397-48f3-b094-8015f998a010 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:04.337004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6e59a-f397-48f3-b094-8015f998a010 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:04.337144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6e59a-f397-48f3-b094-8015f998a010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:04.355354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c9c6e59a-f397-48f3-b094-8015f998a010 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:04.356564 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c9c6e59a-f397-48f3-b094-8015f998a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:04.364396 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:04.514887 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4481425-9c7e-4c43-a4e5-f75dc77abd4c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:04.530067 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4481425-9c7e-4c43-a4e5-f75dc77abd4c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:04.535842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c74aef-3880-4ffb-9be3-36bb80d36c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:04.536556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74aef-3880-4ffb-9be3-36bb80d36c19 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:04.536780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74aef-3880-4ffb-9be3-36bb80d36c19 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:04.537052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74aef-3880-4ffb-9be3-36bb80d36c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:04.549903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c74aef-3880-4ffb-9be3-36bb80d36c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:04.551481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c74aef-3880-4ffb-9be3-36bb80d36c19 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:04.573888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 720/1434] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:05.377486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06dd93-325b-412d-9047-1b3ef0226ca5 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:05.378056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06dd93-325b-412d-9047-1b3ef0226ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:05.378056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06dd93-325b-412d-9047-1b3ef0226ca5 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:05.379442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:05.384933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c96f-839c-4f71-a663-e76011ae8a9e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:05.385464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c96f-839c-4f71-a663-e76011ae8a9e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:05.385575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c96f-839c-4f71-a663-e76011ae8a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:05.403613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a722c96f-839c-4f71-a663-e76011ae8a9e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:05.404866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a722c96f-839c-4f71-a663-e76011ae8a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:05.412662 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:05.564278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06dd93-325b-412d-9047-1b3ef0226ca5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:05.579017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06dd93-325b-412d-9047-1b3ef0226ca5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:05.584462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d637da-1721-491a-b14f-34faba8759d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:05.585128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d637da-1721-491a-b14f-34faba8759d6 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:05.586055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d637da-1721-491a-b14f-34faba8759d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:05.586359 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d637da-1721-491a-b14f-34faba8759d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:05.594487 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d637da-1721-491a-b14f-34faba8759d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:05.596101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d637da-1721-491a-b14f-34faba8759d6 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:05.605585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 716/1437] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:06.410413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285b79f-b9ab-4f64-b612-26e1efaa9319 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:06.411069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285b79f-b9ab-4f64-b612-26e1efaa9319 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:06.411069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285b79f-b9ab-4f64-b612-26e1efaa9319 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:06.412425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:06.417448 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73acd82-67c3-4288-8339-a74cb2090b63 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:06.417880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73acd82-67c3-4288-8339-a74cb2090b63 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:06.418023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73acd82-67c3-4288-8339-a74cb2090b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:06.436088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a73acd82-67c3-4288-8339-a74cb2090b63 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:06.437303 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a73acd82-67c3-4288-8339-a74cb2090b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:06.445715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:06.597271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285b79f-b9ab-4f64-b612-26e1efaa9319 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:06.611978 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285b79f-b9ab-4f64-b612-26e1efaa9319 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:06.617382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176ae87-d519-4415-819d-83a127748119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:06.618012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176ae87-d519-4415-819d-83a127748119 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:06.618301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176ae87-d519-4415-819d-83a127748119 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:06.618584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176ae87-d519-4415-819d-83a127748119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:06.626770 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176ae87-d519-4415-819d-83a127748119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:06.628394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176ae87-d519-4415-819d-83a127748119 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:06.638094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 723/1440] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:08.615097 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677f5c-3c2e-42f6-9ab4-42d543663839 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:08.615683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677f5c-3c2e-42f6-9ab4-42d543663839 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:08.615683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677f5c-3c2e-42f6-9ab4-42d543663839 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:08.617084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:08.622368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08515276-d0fd-4d39-b406-06529703a075 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:08.622796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08515276-d0fd-4d39-b406-06529703a075 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:08.622946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08515276-d0fd-4d39-b406-06529703a075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:08.641151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-08515276-d0fd-4d39-b406-06529703a075 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:08.642353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-08515276-d0fd-4d39-b406-06529703a075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:08.650703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:08.688819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1677f5c-3c2e-42f6-9ab4-42d543663839 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:08.699984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1677f5c-3c2e-42f6-9ab4-42d543663839 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:08.703502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91d43-f035-40c2-ae08-1f343d4a810e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:08.704164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91d43-f035-40c2-ae08-1f343d4a810e service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:08.704447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91d43-f035-40c2-ae08-1f343d4a810e service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:08.704797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91d43-f035-40c2-ae08-1f343d4a810e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:08.714085 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91d43-f035-40c2-ae08-1f343d4a810e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:08.715543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91d43-f035-40c2-ae08-1f343d4a810e service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:08.724993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 719/1443] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:10.901709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b582-5daf-4d96-b638-d501858ee1cf None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:10.902231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b582-5daf-4d96-b638-d501858ee1cf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:10.902231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b582-5daf-4d96-b638-d501858ee1cf None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:10.903658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:10.909051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b873e60-3495-4c8b-adc3-dc0397bc80dd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:10.909468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b873e60-3495-4c8b-adc3-dc0397bc80dd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:10.909612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b873e60-3495-4c8b-adc3-dc0397bc80dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:10.926907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9b873e60-3495-4c8b-adc3-dc0397bc80dd None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:10.928161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9b873e60-3495-4c8b-adc3-dc0397bc80dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:10.935927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:10.974445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9b582-5daf-4d96-b638-d501858ee1cf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:10.985753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9b582-5daf-4d96-b638-d501858ee1cf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:10.989292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd22ca-1e66-43ee-b149-110ddad01b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:10.989933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd22ca-1e66-43ee-b149-110ddad01b87 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:10.990217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd22ca-1e66-43ee-b149-110ddad01b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:10.990547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd22ca-1e66-43ee-b149-110ddad01b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:11.000789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd22ca-1e66-43ee-b149-110ddad01b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:11.002237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd22ca-1e66-43ee-b149-110ddad01b87 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:11.012691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 726/1446] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:13.368156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436f93c-7664-405d-8564-74a5aa093bf6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:13.368678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436f93c-7664-405d-8564-74a5aa093bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:13.368678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436f93c-7664-405d-8564-74a5aa093bf6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:13.370028 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:13.375393 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f84965-7378-445e-90b6-c86901f27d7d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:13.375852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f84965-7378-445e-90b6-c86901f27d7d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:13.375950 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f84965-7378-445e-90b6-c86901f27d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:13.393842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-59f84965-7378-445e-90b6-c86901f27d7d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:13.395030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-59f84965-7378-445e-90b6-c86901f27d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:13.404344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:13.443177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436f93c-7664-405d-8564-74a5aa093bf6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:13.453907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436f93c-7664-405d-8564-74a5aa093bf6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:13.457413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc9ab5-0f43-4147-8311-2d50f1ad60e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:13.458048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc9ab5-0f43-4147-8311-2d50f1ad60e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:13.458364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc9ab5-0f43-4147-8311-2d50f1ad60e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:13.458643 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc9ab5-0f43-4147-8311-2d50f1ad60e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:13.468355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc9ab5-0f43-4147-8311-2d50f1ad60e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:13.469820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc9ab5-0f43-4147-8311-2d50f1ad60e1 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:13.479834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 722/1449] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:15.637720 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938bceb-c820-4360-99b2-6bdfe5f6c25d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:15.638746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938bceb-c820-4360-99b2-6bdfe5f6c25d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:15.638746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938bceb-c820-4360-99b2-6bdfe5f6c25d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:15.639903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:15.645329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0f0bc-a2e9-4401-9c89-c8b28383e5af None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:15.645797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0f0bc-a2e9-4401-9c89-c8b28383e5af None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:15.645899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0f0bc-a2e9-4401-9c89-c8b28383e5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:15.663049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9de0f0bc-a2e9-4401-9c89-c8b28383e5af None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:15.664323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9de0f0bc-a2e9-4401-9c89-c8b28383e5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:15.672213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:15.711066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938bceb-c820-4360-99b2-6bdfe5f6c25d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:15.721701 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938bceb-c820-4360-99b2-6bdfe5f6c25d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:15.725167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ca0ba-2eff-4735-9344-14ac4e7e048a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:15.725881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ca0ba-2eff-4735-9344-14ac4e7e048a service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:15.726083 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ca0ba-2eff-4735-9344-14ac4e7e048a service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:15.726365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ca0ba-2eff-4735-9344-14ac4e7e048a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:15.735172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ca0ba-2eff-4735-9344-14ac4e7e048a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:15.736647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ca0ba-2eff-4735-9344-14ac4e7e048a service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:15.746775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 729/1452] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:17.831429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e92c5-e5cf-41f9-84be-fd296681e7aa None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:17.831904 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e92c5-e5cf-41f9-84be-fd296681e7aa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:17.831998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e92c5-e5cf-41f9-84be-fd296681e7aa None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:17.833377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:17.839052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d6ee-4f29-45af-9546-602a8c5adcc5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:17.839493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d6ee-4f29-45af-9546-602a8c5adcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:17.839605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d6ee-4f29-45af-9546-602a8c5adcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:17.858844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6514d6ee-4f29-45af-9546-602a8c5adcc5 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:17.860094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6514d6ee-4f29-45af-9546-602a8c5adcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:17.867904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:17.905861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e92c5-e5cf-41f9-84be-fd296681e7aa None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:17.917061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e92c5-e5cf-41f9-84be-fd296681e7aa None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:17.920571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760348b-17c2-4751-a6c7-ab11e23af52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:17.921200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760348b-17c2-4751-a6c7-ab11e23af52c service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:17.921480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760348b-17c2-4751-a6c7-ab11e23af52c service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:17.921753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760348b-17c2-4751-a6c7-ab11e23af52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:17.930626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760348b-17c2-4751-a6c7-ab11e23af52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:17.932072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760348b-17c2-4751-a6c7-ab11e23af52c service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:17.941401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 725/1455] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:20.035462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab1ef-eada-4183-b388-f03c5f87ca3c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:20.036167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab1ef-eada-4183-b388-f03c5f87ca3c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:20.036167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab1ef-eada-4183-b388-f03c5f87ca3c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:20.037434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:20.042661 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c647e35-d7a7-4919-b847-a2077598e1b7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:20.043051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c647e35-d7a7-4919-b847-a2077598e1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:20.043229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c647e35-d7a7-4919-b847-a2077598e1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:20.061185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9c647e35-d7a7-4919-b847-a2077598e1b7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:20.062388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9c647e35-d7a7-4919-b847-a2077598e1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:20.070976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:20.108769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eab1ef-eada-4183-b388-f03c5f87ca3c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:20.119990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eab1ef-eada-4183-b388-f03c5f87ca3c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:20.123552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29f31e-ed2c-4ba4-a0b2-599e9c436cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:20.124214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29f31e-ed2c-4ba4-a0b2-599e9c436cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:20.124498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29f31e-ed2c-4ba4-a0b2-599e9c436cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:20.124772 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29f31e-ed2c-4ba4-a0b2-599e9c436cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:20.134162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29f31e-ed2c-4ba4-a0b2-599e9c436cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:20.135587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29f31e-ed2c-4ba4-a0b2-599e9c436cd0 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:20.145244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 732/1458] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:22.252693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013e16-3b65-49f9-82ad-4068e8563c09 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:22.253262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013e16-3b65-49f9-82ad-4068e8563c09 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:22.253262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013e16-3b65-49f9-82ad-4068e8563c09 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:22.254661 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:22.260094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a0a5-b431-4c4d-9435-4a4878c7442f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:22.260502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a0a5-b431-4c4d-9435-4a4878c7442f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:22.260661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a0a5-b431-4c4d-9435-4a4878c7442f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:22.278669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3f78a0a5-b431-4c4d-9435-4a4878c7442f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:22.279857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3f78a0a5-b431-4c4d-9435-4a4878c7442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:22.287630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:22.324757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b013e16-3b65-49f9-82ad-4068e8563c09 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:22.335764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b013e16-3b65-49f9-82ad-4068e8563c09 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:22.339265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ff153-d9c3-4d38-9674-501b9005d438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:22.339892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff153-d9c3-4d38-9674-501b9005d438 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:22.340211 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff153-d9c3-4d38-9674-501b9005d438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:22.340490 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff153-d9c3-4d38-9674-501b9005d438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:22.349299 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ff153-d9c3-4d38-9674-501b9005d438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:22.350723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ff153-d9c3-4d38-9674-501b9005d438 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:22.360720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 728/1461] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:24.465767 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9afc6-a478-4c01-81ed-22379bbf10c2 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:24.466358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9afc6-a478-4c01-81ed-22379bbf10c2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:24.466358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9afc6-a478-4c01-81ed-22379bbf10c2 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:24.467787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:24.473154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b1c23-aef5-4576-9224-d452421e22ad None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:24.473543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b1c23-aef5-4576-9224-d452421e22ad None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:24.473724 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b1c23-aef5-4576-9224-d452421e22ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:24.479755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=79 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:17:24.492787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-de8b1c23-aef5-4576-9224-d452421e22ad None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:24.493976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-de8b1c23-aef5-4576-9224-d452421e22ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:24.501643 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:24.539351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9afc6-a478-4c01-81ed-22379bbf10c2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:24.544750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=73 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:17:24.551094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9afc6-a478-4c01-81ed-22379bbf10c2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:24.555163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33e51e-aed2-4b31-b78c-907ca23b542a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:24.555801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33e51e-aed2-4b31-b78c-907ca23b542a service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:24.556122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33e51e-aed2-4b31-b78c-907ca23b542a service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:24.556408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33e51e-aed2-4b31-b78c-907ca23b542a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:24.565516 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33e51e-aed2-4b31-b78c-907ca23b542a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:24.566966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33e51e-aed2-4b31-b78c-907ca23b542a service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:24.577514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 735/1464] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:26.637330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff14e-9a1e-427b-98d6-e037d0c379ca None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:26.637885 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff14e-9a1e-427b-98d6-e037d0c379ca None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:26.637993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff14e-9a1e-427b-98d6-e037d0c379ca None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:26.639617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:26.644873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938962-1cc5-4260-8d2e-200b0878fdaa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:26.645261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938962-1cc5-4260-8d2e-200b0878fdaa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:26.645447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938962-1cc5-4260-8d2e-200b0878fdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:26.664195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-45938962-1cc5-4260-8d2e-200b0878fdaa None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:26.665402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-45938962-1cc5-4260-8d2e-200b0878fdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:26.673271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:26.709644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff14e-9a1e-427b-98d6-e037d0c379ca None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:26.720177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff14e-9a1e-427b-98d6-e037d0c379ca None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:26.723663 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4bad4-e008-4149-8034-94de19b2234b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:26.724326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4bad4-e008-4149-8034-94de19b2234b service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:26.724611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4bad4-e008-4149-8034-94de19b2234b service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:26.724889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4bad4-e008-4149-8034-94de19b2234b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:26.734108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4bad4-e008-4149-8034-94de19b2234b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:26.735539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4bad4-e008-4149-8034-94de19b2234b service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:26.744874 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 731/1467] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:28.814344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c8775-31d0-4e89-8ba0-98e1909a8dfd None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:28.814941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c8775-31d0-4e89-8ba0-98e1909a8dfd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:28.814941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c8775-31d0-4e89-8ba0-98e1909a8dfd None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:28.816403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:28.822285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927635-d3b4-4dbb-8088-16e7880786df None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:28.822754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927635-d3b4-4dbb-8088-16e7880786df None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:28.822848 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927635-d3b4-4dbb-8088-16e7880786df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:28.842009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c2927635-d3b4-4dbb-8088-16e7880786df None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:28.843196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c2927635-d3b4-4dbb-8088-16e7880786df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:28.851379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:28.888261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c8775-31d0-4e89-8ba0-98e1909a8dfd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:28.899243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c8775-31d0-4e89-8ba0-98e1909a8dfd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:28.902742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c8b2-f268-44da-b202-bdcd74710e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:28.903374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c8b2-f268-44da-b202-bdcd74710e81 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:28.903655 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c8b2-f268-44da-b202-bdcd74710e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:28.903929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c8b2-f268-44da-b202-bdcd74710e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:28.912869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c8b2-f268-44da-b202-bdcd74710e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:28.914873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c8b2-f268-44da-b202-bdcd74710e81 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:28.924312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 738/1470] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:38.836488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=11 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:17:38.920119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=14 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:17:48.778140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fddb7-e81c-48cd-8bda-b85fb1e274f9 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:48.782863 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fddb7-e81c-48cd-8bda-b85fb1e274f9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:48.782863 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fddb7-e81c-48cd-8bda-b85fb1e274f9 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:48.782863 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 733/1471] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:17:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:48.787403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8ce13-ab48-4a00-9b39-7e6dcff37fd5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:48.787952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8ce13-ab48-4a00-9b39-7e6dcff37fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:48.788087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8ce13-ab48-4a00-9b39-7e6dcff37fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:48.806244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4fe8ce13-ab48-4a00-9b39-7e6dcff37fd5 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:48.807452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4fe8ce13-ab48-4a00-9b39-7e6dcff37fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:48.815364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 739/1472] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:48.863070 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2574b-9200-4394-a2d9-49f3921e9bb4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:48.863370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2574b-9200-4394-a2d9-49f3921e9bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:48.863659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2574b-9200-4394-a2d9-49f3921e9bb4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:48.865069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 734/1473] 10.222.0.66 () {54 vars in 962 bytes} [Wed Jun 22 12:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:48.871099 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f19a2-755a-4f59-9da8-90ff582a6bfa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:48.871388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f19a2-755a-4f59-9da8-90ff582a6bfa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:48.871669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f19a2-755a-4f59-9da8-90ff582a6bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:48.890724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a72f19a2-755a-4f59-9da8-90ff582a6bfa None None] MFA Rules not processed for user `d82125a47ce044b389684b97c7097ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:48.891926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a72f19a2-755a-4f59-9da8-90ff582a6bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:48.898406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 740/1474] 10.222.0.66 () {58 vars in 1059 bytes} [Wed Jun 22 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:48.905597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2574b-9200-4394-a2d9-49f3921e9bb4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:48.917153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2574b-9200-4394-a2d9-49f3921e9bb4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:48.920687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd7b10-0e05-4073-9047-2b90460ed4fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd82125a47ce044b389684b97c7097ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:48.921318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd7b10-0e05-4073-9047-2b90460ed4fa service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:48.921605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd7b10-0e05-4073-9047-2b90460ed4fa service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:48.921882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd7b10-0e05-4073-9047-2b90460ed4fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:48.931555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd7b10-0e05-4073-9047-2b90460ed4fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:48.933063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd7b10-0e05-4073-9047-2b90460ed4fa service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:48.942609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 735/1475] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:51.059810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affadf9f-db07-4f26-a66a-35f7248cc4ee None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:51.060417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affadf9f-db07-4f26-a66a-35f7248cc4ee None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:51.060417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affadf9f-db07-4f26-a66a-35f7248cc4ee None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:51.061776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 741/1476] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:51.067149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab0c8-e198-4929-85cf-eea201c8564b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:51.067636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab0c8-e198-4929-85cf-eea201c8564b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:51.067744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab0c8-e198-4929-85cf-eea201c8564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:51.086750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f9bab0c8-e198-4929-85cf-eea201c8564b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:51.087916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f9bab0c8-e198-4929-85cf-eea201c8564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:51.097446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 736/1477] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:51.121710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affadf9f-db07-4f26-a66a-35f7248cc4ee None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:51.135232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affadf9f-db07-4f26-a66a-35f7248cc4ee None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:51.140428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7d903-22e2-4352-81ef-9d5c4fc1c678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:51.141129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d903-22e2-4352-81ef-9d5c4fc1c678 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:51.141414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d903-22e2-4352-81ef-9d5c4fc1c678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:51.141691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d903-22e2-4352-81ef-9d5c4fc1c678 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:51.142431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7d903-22e2-4352-81ef-9d5c4fc1c678 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:51.144312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-c6d7d903-22e2-4352-81ef-9d5c4fc1c678 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:17:51.144312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 22 12:17:51.144312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: Jun 22 12:17:51.145455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7d903-22e2-4352-81ef-9d5c4fc1c678 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:51.166377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 742/1478] 10.222.0.66 () {56 vars in 1108 bytes} [Wed Jun 22 12:17:51 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:17:53.248738 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f95e1a-d513-4ef5-ab6f-721471ccf55d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:53.249305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f95e1a-d513-4ef5-ab6f-721471ccf55d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:53.249305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f95e1a-d513-4ef5-ab6f-721471ccf55d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:53.250709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 737/1479] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:53.256081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb859e-4ec9-46bd-9d27-c9313e90a78f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:53.256580 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb859e-4ec9-46bd-9d27-c9313e90a78f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:53.256699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb859e-4ec9-46bd-9d27-c9313e90a78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:53.275019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a2bb859e-4ec9-46bd-9d27-c9313e90a78f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:53.276240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a2bb859e-4ec9-46bd-9d27-c9313e90a78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:53.283936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 743/1480] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:53.327267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f95e1a-d513-4ef5-ab6f-721471ccf55d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:53.341616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f95e1a-d513-4ef5-ab6f-721471ccf55d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:53.346937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31467ae7-6a21-4ec6-8acf-c17722f7093a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:53.347568 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31467ae7-6a21-4ec6-8acf-c17722f7093a service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:53.347853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31467ae7-6a21-4ec6-8acf-c17722f7093a service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:53.348164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31467ae7-6a21-4ec6-8acf-c17722f7093a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:53.356220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31467ae7-6a21-4ec6-8acf-c17722f7093a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:53.357795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31467ae7-6a21-4ec6-8acf-c17722f7093a service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:53.367736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 738/1481] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:55.585554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ab72-faf7-4cdd-b2b3-108fa7d7b13d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:55.586127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ab72-faf7-4cdd-b2b3-108fa7d7b13d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:55.586127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ab72-faf7-4cdd-b2b3-108fa7d7b13d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:55.587547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 744/1482] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:55.592730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe3b3-8b4a-4d14-9758-5a02f0d70293 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:55.593188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe3b3-8b4a-4d14-9758-5a02f0d70293 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:55.593315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe3b3-8b4a-4d14-9758-5a02f0d70293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:55.610627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-47bfe3b3-8b4a-4d14-9758-5a02f0d70293 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:55.611824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-47bfe3b3-8b4a-4d14-9758-5a02f0d70293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:55.620239 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 739/1483] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:55.657907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3ab72-faf7-4cdd-b2b3-108fa7d7b13d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:55.669025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3ab72-faf7-4cdd-b2b3-108fa7d7b13d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:55.672484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef7ccb-3dcd-4cd2-86dc-2e1fc26eee13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:55.673113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7ccb-3dcd-4cd2-86dc-2e1fc26eee13 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:55.673400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7ccb-3dcd-4cd2-86dc-2e1fc26eee13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:55.673677 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7ccb-3dcd-4cd2-86dc-2e1fc26eee13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:55.683150 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef7ccb-3dcd-4cd2-86dc-2e1fc26eee13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:55.684630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef7ccb-3dcd-4cd2-86dc-2e1fc26eee13 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:55.694338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 745/1484] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:17:57.798678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee67537-74b1-4d4d-b1d6-8972c369b965 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:57.799253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee67537-74b1-4d4d-b1d6-8972c369b965 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:57.799253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee67537-74b1-4d4d-b1d6-8972c369b965 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:57.800723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 740/1485] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:17:57.806515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caadae6-747e-4684-8251-423b7b48a5d3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:57.806961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caadae6-747e-4684-8251-423b7b48a5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:57.807076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caadae6-747e-4684-8251-423b7b48a5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:57.825047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1caadae6-747e-4684-8251-423b7b48a5d3 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:17:57.826424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1caadae6-747e-4684-8251-423b7b48a5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:17:57.834517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 746/1486] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:17:57.875160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee67537-74b1-4d4d-b1d6-8972c369b965 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:17:57.886534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee67537-74b1-4d4d-b1d6-8972c369b965 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:17:57.890379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d55330-9b56-4208-a2e0-c828e9be07d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:17:57.891017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55330-9b56-4208-a2e0-c828e9be07d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:17:57.891298 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55330-9b56-4208-a2e0-c828e9be07d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:17:57.891573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55330-9b56-4208-a2e0-c828e9be07d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:17:57.900595 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d55330-9b56-4208-a2e0-c828e9be07d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:17:57.902149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d55330-9b56-4208-a2e0-c828e9be07d7 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:17:57.912211 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 741/1487] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:18:00.037884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d745e95-e46d-4bd8-a1cf-8dcfc69aa332 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:18:00.038416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d745e95-e46d-4bd8-a1cf-8dcfc69aa332 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:18:00.038416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d745e95-e46d-4bd8-a1cf-8dcfc69aa332 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:18:00.039816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 747/1488] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:18:00.045099 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68563fe-b8cd-4d49-a89b-7ad97945ceb6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:18:00.045533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68563fe-b8cd-4d49-a89b-7ad97945ceb6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:18:00.045673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68563fe-b8cd-4d49-a89b-7ad97945ceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:18:00.063689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f68563fe-b8cd-4d49-a89b-7ad97945ceb6 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:18:00.064924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f68563fe-b8cd-4d49-a89b-7ad97945ceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:18:00.073587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 742/1489] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:18:00.113239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d745e95-e46d-4bd8-a1cf-8dcfc69aa332 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:18:00.126676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d745e95-e46d-4bd8-a1cf-8dcfc69aa332 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:18:00.130218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65211d-db16-4384-8a7f-419d4c7a8287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:18:00.130850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65211d-db16-4384-8a7f-419d4c7a8287 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:18:00.131133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65211d-db16-4384-8a7f-419d4c7a8287 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:18:00.132031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65211d-db16-4384-8a7f-419d4c7a8287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:18:00.141208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65211d-db16-4384-8a7f-419d4c7a8287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:18:00.142639 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65211d-db16-4384-8a7f-419d4c7a8287 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:18:00.152172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 748/1490] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:18:02.450112 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c91476-1610-49e5-ba51-a11a9140a0a3 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:18:02.450673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c91476-1610-49e5-ba51-a11a9140a0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:18:02.450673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c91476-1610-49e5-ba51-a11a9140a0a3 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:18:02.452088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 743/1491] 10.222.0.66 () {54 vars in 926 bytes} [Wed Jun 22 12:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:18:02.457248 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5565b5-769e-4d5a-a9a4-9bd89e364e17 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:18:02.457675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5565b5-769e-4d5a-a9a4-9bd89e364e17 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:18:02.457823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5565b5-769e-4d5a-a9a4-9bd89e364e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:18:02.476051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3e5565b5-769e-4d5a-a9a4-9bd89e364e17 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:18:02.477250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3e5565b5-769e-4d5a-a9a4-9bd89e364e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:18:02.485171 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 749/1492] 10.222.0.66 () {58 vars in 1023 bytes} [Wed Jun 22 12:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:18:02.525415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c91476-1610-49e5-ba51-a11a9140a0a3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:18:02.536050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c91476-1610-49e5-ba51-a11a9140a0a3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:18:02.539522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e41bd-998f-4b2a-b899-ff4679850cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:18:02.540192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e41bd-998f-4b2a-b899-ff4679850cbe service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:18:02.540480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e41bd-998f-4b2a-b899-ff4679850cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:18:02.540760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e41bd-998f-4b2a-b899-ff4679850cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:18:02.550098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e41bd-998f-4b2a-b899-ff4679850cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:18:02.551541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e41bd-998f-4b2a-b899-ff4679850cbe service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:18:02.560864 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 744/1493] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:18:12.470875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=33 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:18:12.556883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=33 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:19:35.905028 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19827-6811-4210-a1ab-115dc9853284 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:35.905626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19827-6811-4210-a1ab-115dc9853284 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:35.905626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19827-6811-4210-a1ab-115dc9853284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:35.924342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4cf19827-6811-4210-a1ab-115dc9853284 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:19:35.925569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4cf19827-6811-4210-a1ab-115dc9853284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:19:35.933420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 750/1494] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:19:35.942746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104c645-d940-43a4-a4eb-3cde02c12ac4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:35.943249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104c645-d940-43a4-a4eb-3cde02c12ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:35.943366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104c645-d940-43a4-a4eb-3cde02c12ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:35.962684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f104c645-d940-43a4-a4eb-3cde02c12ac4 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:19:35.964248 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f104c645-d940-43a4-a4eb-3cde02c12ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:19:35.972508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 745/1495] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:19:35.982726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf19827-6811-4210-a1ab-115dc9853284 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:19:35.992403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf19827-6811-4210-a1ab-115dc9853284 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:19:35.997569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b112413-a051-4be6-9390-a25a8451226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:19:35.998238 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b112413-a051-4be6-9390-a25a8451226e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:35.998530 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b112413-a051-4be6-9390-a25a8451226e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:35.998810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b112413-a051-4be6-9390-a25a8451226e admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:35.999532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b112413-a051-4be6-9390-a25a8451226e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:19:35.999842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b112413-a051-4be6-9390-a25a8451226e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:19:36.000891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-8b112413-a051-4be6-9390-a25a8451226e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:19:36.000891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 22 12:19:36.000891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: Jun 22 12:19:36.001778 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b112413-a051-4be6-9390-a25a8451226e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:19:36.014053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 751/1496] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:19:36.023273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104c645-d940-43a4-a4eb-3cde02c12ac4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:19:36.032723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104c645-d940-43a4-a4eb-3cde02c12ac4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:19:36.038258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd262e-3a53-4f34-83c7-a8447b055459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:19:36.038907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd262e-3a53-4f34-83c7-a8447b055459 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.039337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd262e-3a53-4f34-83c7-a8447b055459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.039612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd262e-3a53-4f34-83c7-a8447b055459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.040344 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd262e-3a53-4f34-83c7-a8447b055459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:19:36.042210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-06bd262e-3a53-4f34-83c7-a8447b055459 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:19:36.042210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Jun 22 12:19:36.042210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: Jun 22 12:19:36.043409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd262e-3a53-4f34-83c7-a8447b055459 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:19:36.081295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 746/1497] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:19:36 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:19:36.085988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b112413-a051-4be6-9390-a25a8451226e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:19:36.095937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b112413-a051-4be6-9390-a25a8451226e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:19:36.152728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3182fe8-73e3-4015-a425-75ac32915121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:19:36.153401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3182fe8-73e3-4015-a425-75ac32915121 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.153691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3182fe8-73e3-4015-a425-75ac32915121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.153975 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3182fe8-73e3-4015-a425-75ac32915121 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.154681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3182fe8-73e3-4015-a425-75ac32915121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:19:36.155710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-c3182fe8-73e3-4015-a425-75ac32915121 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:19:36.155710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 22 12:19:36.155710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: Jun 22 12:19:36.156975 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3182fe8-73e3-4015-a425-75ac32915121 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:19:36.177323 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 752/1498] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:19:36 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:19:36.181594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd262e-3a53-4f34-83c7-a8447b055459 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:19:36.192247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd262e-3a53-4f34-83c7-a8447b055459 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:19:36.196709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08076d-38e5-413b-96e8-55dadef00fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:19:36.197366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08076d-38e5-413b-96e8-55dadef00fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.197651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08076d-38e5-413b-96e8-55dadef00fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.197929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08076d-38e5-413b-96e8-55dadef00fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.198651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08076d-38e5-413b-96e8-55dadef00fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:19:36.199654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-1c08076d-38e5-413b-96e8-55dadef00fbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:19:36.199654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Jun 22 12:19:36.199654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: Jun 22 12:19:36.200577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08076d-38e5-413b-96e8-55dadef00fbe admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:19:36.213934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 747/1499] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:19:36.218131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3182fe8-73e3-4015-a425-75ac32915121 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:19:36.227980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3182fe8-73e3-4015-a425-75ac32915121 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:19:36.232747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23894d5-ca45-41f1-99f4-0266b2702b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:19:36.233405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23894d5-ca45-41f1-99f4-0266b2702b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.233689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23894d5-ca45-41f1-99f4-0266b2702b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.233966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23894d5-ca45-41f1-99f4-0266b2702b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.234688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23894d5-ca45-41f1-99f4-0266b2702b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:19:36.235703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-e23894d5-ca45-41f1-99f4-0266b2702b2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:19:36.235703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 22 12:19:36.235703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: Jun 22 12:19:36.236643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23894d5-ca45-41f1-99f4-0266b2702b2c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:19:36.250356 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 753/1500] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:19:36.255190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08076d-38e5-413b-96e8-55dadef00fbe admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:19:36.265101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08076d-38e5-413b-96e8-55dadef00fbe admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:19:36.270442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56095844-7cc7-4e7b-9397-f53e1ae45dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:19:36.271314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56095844-7cc7-4e7b-9397-f53e1ae45dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.271596 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56095844-7cc7-4e7b-9397-f53e1ae45dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.271872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56095844-7cc7-4e7b-9397-f53e1ae45dfb admin admin] PATH_INFO: `/v3/projects/84c76cd4e05d49cba206c0690dcbdb6a/users/88aff1e1e7ea45da978251067d21a226/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.286387 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56095844-7cc7-4e7b-9397-f53e1ae45dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c76cd4e05d49cba206c0690dcbdb6a, user_id=88aff1e1e7ea45da978251067d21a226, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:19:36.287421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-56095844-7cc7-4e7b-9397-f53e1ae45dfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:19:36.287421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Jun 22 12:19:36.287421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: Jun 22 12:19:36.289407 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56095844-7cc7-4e7b-9397-f53e1ae45dfb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:19:36.302710 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 748/1501] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:19:36 2022] PUT /identity/v3/projects/84c76cd4e05d49cba206c0690dcbdb6a/users/88aff1e1e7ea45da978251067d21a226/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:19:36.314024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eced9b-b229-4a0f-8ecd-97de7fc9c582 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.314318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eced9b-b229-4a0f-8ecd-97de7fc9c582 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.314598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eced9b-b229-4a0f-8ecd-97de7fc9c582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.341760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e2eced9b-b229-4a0f-8ecd-97de7fc9c582 None None] MFA Rules not processed for user `88aff1e1e7ea45da978251067d21a226`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:19:36.342969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e2eced9b-b229-4a0f-8ecd-97de7fc9c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:19:36.406636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 754/1502] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:19:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:19:36.419924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4b44d-1d9e-4f9c-bef9-ba8d92d6c254 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.420249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4b44d-1d9e-4f9c-bef9-ba8d92d6c254 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.420534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4b44d-1d9e-4f9c-bef9-ba8d92d6c254 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.421911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 749/1503] 10.222.0.66 () {54 vars in 963 bytes} [Wed Jun 22 12:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:19:36.426951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676eb46-e0e7-4752-8df2-245bc78564c4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.427245 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676eb46-e0e7-4752-8df2-245bc78564c4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.427529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676eb46-e0e7-4752-8df2-245bc78564c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.447390 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3676eb46-e0e7-4752-8df2-245bc78564c4 None None] MFA Rules not processed for user `eeb4a8bcbc374f139db9e6e134b6d681`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:19:36.448650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3676eb46-e0e7-4752-8df2-245bc78564c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:19:36.492271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:19:36.500526 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 755/1504] 10.222.0.66 () {58 vars in 1060 bytes} [Wed Jun 22 12:19:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:19:36.508962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4b44d-1d9e-4f9c-bef9-ba8d92d6c254 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:19:36.520781 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4b44d-1d9e-4f9c-bef9-ba8d92d6c254 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:19:36.524606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d4978-f951-4438-b2dd-8203597c4bea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:19:36.525286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4978-f951-4438-b2dd-8203597c4bea service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.525555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4978-f951-4438-b2dd-8203597c4bea service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.525832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4978-f951-4438-b2dd-8203597c4bea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.534870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d4978-f951-4438-b2dd-8203597c4bea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:19:36.536346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d4978-f951-4438-b2dd-8203597c4bea service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:19:36.545455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 750/1505] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:19:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:19:36.588705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b16e8-8b0b-4fb8-b44c-3b9c478ce0a0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.588989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b16e8-8b0b-4fb8-b44c-3b9c478ce0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.589264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b16e8-8b0b-4fb8-b44c-3b9c478ce0a0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.590549 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 756/1506] 10.222.0.66 () {52 vars in 829 bytes} [Wed Jun 22 12:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:19:36.594306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d4978-f951-4438-b2dd-8203597c4bea service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:19:36.655847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d4978-f951-4438-b2dd-8203597c4bea service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:19:36.660358 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:19:36.661222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.661503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.661782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] PATH_INFO: `/v3/users/88aff1e1e7ea45da978251067d21a226` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.662946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=88aff1e1e7ea45da978251067d21a226)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:19:36.663952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:19:36.663952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Jun 22 12:19:36.663952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: Jun 22 12:19:36.665198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:19:36.729286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88aff1e1e7ea45da978251067d21a226'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:19:36.748570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88aff1e1e7ea45da978251067d21a226'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:19:36.758974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88aff1e1e7ea45da978251067d21a226'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:19:36.759745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88aff1e1e7ea45da978251067d21a226'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:19:36.768982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:19:36.774635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88aff1e1e7ea45da978251067d21a226'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:19:36.781619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 751/1507] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:19:36 2022] DELETE /identity/v3/users/88aff1e1e7ea45da978251067d21a226 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:19:36.786374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58f790-01b9-4906-ba65-a8ec208abc20 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.786713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58f790-01b9-4906-ba65-a8ec208abc20 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.787029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58f790-01b9-4906-ba65-a8ec208abc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.805498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fb58f790-01b9-4906-ba65-a8ec208abc20 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:19:36.806704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fb58f790-01b9-4906-ba65-a8ec208abc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:19:36.869322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 757/1508] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:19:36.880361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:19:36.881800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:19:36.940511 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bd528-9ab5-4f9d-a790-b3f4d400cc0c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:19:36.944395 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb53a1-f8b5-42c7-a537-446f9428aa2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:19:36.945053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb53a1-f8b5-42c7-a537-446f9428aa2b service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:36.945334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb53a1-f8b5-42c7-a537-446f9428aa2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:36.945611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb53a1-f8b5-42c7-a537-446f9428aa2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:36.955147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb53a1-f8b5-42c7-a537-446f9428aa2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:19:36.956964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb53a1-f8b5-42c7-a537-446f9428aa2b service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:19:36.967018 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 752/1509] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:19:37.341907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58f790-01b9-4906-ba65-a8ec208abc20 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:19:37.343470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fb58f790-01b9-4906-ba65-a8ec208abc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:19:37.355938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58f790-01b9-4906-ba65-a8ec208abc20 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:19:37.360850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:19:37.361718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:19:37.362004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:19:37.362281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] PATH_INFO: `/v3/projects/84c76cd4e05d49cba206c0690dcbdb6a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:19:37.364425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c76cd4e05d49cba206c0690dcbdb6a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:19:37.365549 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:19:37.365549 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 22 12:19:37.365549 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: Jun 22 12:19:37.366697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:19:37.428875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c76cd4e05d49cba206c0690dcbdb6a', 'request_id': 'req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:19:37.442153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c76cd4e05d49cba206c0690dcbdb6a', 'request_id': 'req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:19:37.448330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c76cd4e05d49cba206c0690dcbdb6a', 'request_id': 'req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:19:37.462897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] The token cache is being invalidate because project 84c76cd4e05d49cba206c0690dcbdb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:19:37.463180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:19:37.463809 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1de2f62-f28a-4f68-8009-f5bf2512f2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:19:37.465503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 758/1510] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:19:37 2022] DELETE /identity/v3/projects/84c76cd4e05d49cba206c0690dcbdb6a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:19:46.962564 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=29 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:19:47.459750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:21:17.548210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54986c-fba5-4cbb-a37d-c5e12c788e6e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:17.548811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54986c-fba5-4cbb-a37d-c5e12c788e6e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:17.548811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54986c-fba5-4cbb-a37d-c5e12c788e6e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:17.550302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:21:17.555813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c167873-4ed7-47c4-a615-f4f203bcf7c0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:17.556281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c167873-4ed7-47c4-a615-f4f203bcf7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:17.556416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c167873-4ed7-47c4-a615-f4f203bcf7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:17.574789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6c167873-4ed7-47c4-a615-f4f203bcf7c0 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:21:17.575997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6c167873-4ed7-47c4-a615-f4f203bcf7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:17.632683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:21:17.787845 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54986c-fba5-4cbb-a37d-c5e12c788e6e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:21:17.789621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cb54986c-fba5-4cbb-a37d-c5e12c788e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:17.863268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54986c-fba5-4cbb-a37d-c5e12c788e6e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:21:17.869154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6dba5-0f1d-4440-b1a2-d80ef8d26786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:21:17.869799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6dba5-0f1d-4440-b1a2-d80ef8d26786 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:17.870086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6dba5-0f1d-4440-b1a2-d80ef8d26786 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:17.870368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6dba5-0f1d-4440-b1a2-d80ef8d26786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:17.878409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6dba5-0f1d-4440-b1a2-d80ef8d26786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:21:17.880010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6dba5-0f1d-4440-b1a2-d80ef8d26786 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:21:17.889649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 754/1513] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:21:18.710703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb033b-0ae4-4fd9-97d3-a1cec98b8e5f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:18.711263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb033b-0ae4-4fd9-97d3-a1cec98b8e5f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:18.711263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb033b-0ae4-4fd9-97d3-a1cec98b8e5f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:18.712665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:21:18.717483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f339ca4-7676-49bf-8541-ab3b688061df None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:18.717902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f339ca4-7676-49bf-8541-ab3b688061df None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:18.718055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f339ca4-7676-49bf-8541-ab3b688061df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:18.736267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8f339ca4-7676-49bf-8541-ab3b688061df None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:21:18.737486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8f339ca4-7676-49bf-8541-ab3b688061df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:18.745845 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:21:18.897393 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb033b-0ae4-4fd9-97d3-a1cec98b8e5f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:21:18.912202 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb033b-0ae4-4fd9-97d3-a1cec98b8e5f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:21:18.917481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e1a82-9b21-4e41-a29a-b84ec7120422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:21:18.918116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e1a82-9b21-4e41-a29a-b84ec7120422 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:18.918423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e1a82-9b21-4e41-a29a-b84ec7120422 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:18.918799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e1a82-9b21-4e41-a29a-b84ec7120422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:18.927637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e1a82-9b21-4e41-a29a-b84ec7120422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:21:18.929330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e1a82-9b21-4e41-a29a-b84ec7120422 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:21:18.941069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 761/1516] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:21:19.864437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e337-1c34-47af-9ad7-86e1acff01ab None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:19.865400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e337-1c34-47af-9ad7-86e1acff01ab None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:19.865503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e337-1c34-47af-9ad7-86e1acff01ab None None] PATH_INFO: `/v3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:19.866762 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 756/1517] 10.222.0.43 () {54 vars in 925 bytes} [Wed Jun 22 12:21:19 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:21:19.873331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88655-a726-4f27-a6bd-e04023ccd791 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:19.873727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88655-a726-4f27-a6bd-e04023ccd791 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:19.873890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88655-a726-4f27-a6bd-e04023ccd791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:19.892697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-26b88655-a726-4f27-a6bd-e04023ccd791 None None] MFA Rules not processed for user `c89ae81d49214b75a747a6cfa3ddf0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:21:19.893904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-26b88655-a726-4f27-a6bd-e04023ccd791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:19.954278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 762/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jun 22 12:21:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:21:28.731016 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=37 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:21:28.837031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd8280-44c9-4bcd-a529-fecc710454b6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:28.837267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd8280-44c9-4bcd-a529-fecc710454b6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:28.837555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd8280-44c9-4bcd-a529-fecc710454b6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:28.838938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 757/1519] 10.222.0.66 () {54 vars in 960 bytes} [Wed Jun 22 12:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:21:28.844249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5bea0-5c43-4aea-8039-cac47439f7ec None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:28.844702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5bea0-5c43-4aea-8039-cac47439f7ec None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:28.844802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5bea0-5c43-4aea-8039-cac47439f7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:28.863996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8ea5bea0-5c43-4aea-8039-cac47439f7ec None None] MFA Rules not processed for user `c89ae81d49214b75a747a6cfa3ddf0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:21:28.865254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8ea5bea0-5c43-4aea-8039-cac47439f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:28.873684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 763/1520] 10.222.0.66 () {58 vars in 1057 bytes} [Wed Jun 22 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:21:28.881785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd8280-44c9-4bcd-a529-fecc710454b6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:21:28.895132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd8280-44c9-4bcd-a529-fecc710454b6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:21:28.900708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955e986-11fa-463a-8c69-087b3c54137b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:21:28.901328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955e986-11fa-463a-8c69-087b3c54137b service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:28.901613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955e986-11fa-463a-8c69-087b3c54137b service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:28.901890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955e986-11fa-463a-8c69-087b3c54137b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:28.910029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955e986-11fa-463a-8c69-087b3c54137b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:21:28.911621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955e986-11fa-463a-8c69-087b3c54137b service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:21:28.921030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 758/1521] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:21:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:21:30.172816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86734d3b-afd1-46ad-b73c-739b65c226bd None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:30.173295 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86734d3b-afd1-46ad-b73c-739b65c226bd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:30.173399 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86734d3b-afd1-46ad-b73c-739b65c226bd None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:30.174860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:21:30.179643 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614e03-091a-4700-991a-d8bbf6748bb3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:30.180077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614e03-091a-4700-991a-d8bbf6748bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:30.180237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614e03-091a-4700-991a-d8bbf6748bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:30.200360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b7614e03-091a-4700-991a-d8bbf6748bb3 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:21:30.201555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b7614e03-091a-4700-991a-d8bbf6748bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:30.209730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:21:30.365533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86734d3b-afd1-46ad-b73c-739b65c226bd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:21:30.380742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86734d3b-afd1-46ad-b73c-739b65c226bd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:21:30.386154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d65b2-88f5-4fe7-b882-4935e5b2d6e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:21:30.386788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d65b2-88f5-4fe7-b882-4935e5b2d6e0 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:30.387072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d65b2-88f5-4fe7-b882-4935e5b2d6e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:30.387349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d65b2-88f5-4fe7-b882-4935e5b2d6e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:30.396246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d65b2-88f5-4fe7-b882-4935e5b2d6e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:21:30.397835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d65b2-88f5-4fe7-b882-4935e5b2d6e0 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:21:30.407133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 765/1524] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:21:31.238642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac05a6-61ec-481e-aeea-3c4bdf11869c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:31.239174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac05a6-61ec-481e-aeea-3c4bdf11869c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:31.239174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac05a6-61ec-481e-aeea-3c4bdf11869c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:31.240616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 12:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 12:21:31.245316 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9177cd-1616-4a6c-bc31-18bede76b20d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:31.245713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9177cd-1616-4a6c-bc31-18bede76b20d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:31.245878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9177cd-1616-4a6c-bc31-18bede76b20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:31.265669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0f9177cd-1616-4a6c-bc31-18bede76b20d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:21:31.267136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0f9177cd-1616-4a6c-bc31-18bede76b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:31.275534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:21:31.427310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac05a6-61ec-481e-aeea-3c4bdf11869c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:21:31.441489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac05a6-61ec-481e-aeea-3c4bdf11869c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:21:31.447655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebd482-6a9d-4fb7-b1b7-41e64b915ddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:21:31.448330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebd482-6a9d-4fb7-b1b7-41e64b915ddd service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:31.448615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebd482-6a9d-4fb7-b1b7-41e64b915ddd service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:31.448896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebd482-6a9d-4fb7-b1b7-41e64b915ddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:31.457151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebd482-6a9d-4fb7-b1b7-41e64b915ddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:21:31.459383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebd482-6a9d-4fb7-b1b7-41e64b915ddd service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:21:31.468768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 761/1527] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:21:35.504190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db95ed0-19fa-4a12-8741-89de835df036 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:35.504801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db95ed0-19fa-4a12-8741-89de835df036 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:35.504911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db95ed0-19fa-4a12-8741-89de835df036 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:35.506246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:21:35.511756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292bcf-d368-4595-9f76-70a594007818 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:35.512164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292bcf-d368-4595-9f76-70a594007818 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:35.512359 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292bcf-d368-4595-9f76-70a594007818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:35.530631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cc292bcf-d368-4595-9f76-70a594007818 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:21:35.531831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cc292bcf-d368-4595-9f76-70a594007818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:35.540307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:21:35.577110 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db95ed0-19fa-4a12-8741-89de835df036 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:21:35.578797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0db95ed0-19fa-4a12-8741-89de835df036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:35.636067 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db95ed0-19fa-4a12-8741-89de835df036 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:21:35.639609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd564ce6-8917-49ff-a676-5abed90e234f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:21:35.640314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd564ce6-8917-49ff-a676-5abed90e234f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:35.640606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd564ce6-8917-49ff-a676-5abed90e234f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:35.640887 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd564ce6-8917-49ff-a676-5abed90e234f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:35.650604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd564ce6-8917-49ff-a676-5abed90e234f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:21:35.652058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd564ce6-8917-49ff-a676-5abed90e234f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:21:35.656927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:21:35.662104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 768/1530] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:21:37.690160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9d18-e279-42df-bd95-0667ad5564e9 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:37.690736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9d18-e279-42df-bd95-0667ad5564e9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:37.690736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9d18-e279-42df-bd95-0667ad5564e9 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:37.692693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:21:37.697972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706802c9-a981-466b-b5ab-b3680cfd6c21 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:37.698388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706802c9-a981-466b-b5ab-b3680cfd6c21 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:37.698536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706802c9-a981-466b-b5ab-b3680cfd6c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:37.716846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-706802c9-a981-466b-b5ab-b3680cfd6c21 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:21:37.718035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-706802c9-a981-466b-b5ab-b3680cfd6c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:37.726044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:21:37.762676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a9d18-e279-42df-bd95-0667ad5564e9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:21:37.773784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a9d18-e279-42df-bd95-0667ad5564e9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:21:37.777392 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37fdbc-cf0f-45db-9a06-10b982ad88f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:21:37.778023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fdbc-cf0f-45db-9a06-10b982ad88f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:37.778309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fdbc-cf0f-45db-9a06-10b982ad88f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:37.778587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fdbc-cf0f-45db-9a06-10b982ad88f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:37.787410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37fdbc-cf0f-45db-9a06-10b982ad88f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:21:37.788865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37fdbc-cf0f-45db-9a06-10b982ad88f1 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:21:37.798033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 764/1533] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:21:41.460305 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8d6fd-4ac0-47d7-9abf-90e43f307b01 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:41.460869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8d6fd-4ac0-47d7-9abf-90e43f307b01 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:41.460869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8d6fd-4ac0-47d7-9abf-90e43f307b01 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:41.462241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:21:41.467357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7663e1-d3f0-4f45-bfac-d8271226c5a6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:41.467796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7663e1-d3f0-4f45-bfac-d8271226c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:41.467926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7663e1-d3f0-4f45-bfac-d8271226c5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:41.485775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2d7663e1-d3f0-4f45-bfac-d8271226c5a6 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:21:41.487011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2d7663e1-d3f0-4f45-bfac-d8271226c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:41.495301 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:21:41.797488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8d6fd-4ac0-47d7-9abf-90e43f307b01 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:21:41.799163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-95e8d6fd-4ac0-47d7-9abf-90e43f307b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:41.855443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8d6fd-4ac0-47d7-9abf-90e43f307b01 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:21:41.858938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597acf7-66d3-4b2d-a645-f0d3dbacd743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:21:41.859577 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597acf7-66d3-4b2d-a645-f0d3dbacd743 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:41.859865 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597acf7-66d3-4b2d-a645-f0d3dbacd743 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:41.860172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597acf7-66d3-4b2d-a645-f0d3dbacd743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:41.869429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597acf7-66d3-4b2d-a645-f0d3dbacd743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:21:41.870871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597acf7-66d3-4b2d-a645-f0d3dbacd743 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:21:41.880117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 771/1536] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:21:43.930649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab8cea-0f77-468a-823b-6f71fbc7eae3 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:43.931218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab8cea-0f77-468a-823b-6f71fbc7eae3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:43.931218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab8cea-0f77-468a-823b-6f71fbc7eae3 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:43.932622 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 12:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:21:43.937845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede65c70-c999-40af-b110-1c126bf20b95 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:43.938288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede65c70-c999-40af-b110-1c126bf20b95 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:43.938391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede65c70-c999-40af-b110-1c126bf20b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:43.956597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ede65c70-c999-40af-b110-1c126bf20b95 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:21:43.958376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ede65c70-c999-40af-b110-1c126bf20b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:43.966105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 12:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:21:44.268791 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab8cea-0f77-468a-823b-6f71fbc7eae3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:21:44.271132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-79ab8cea-0f77-468a-823b-6f71fbc7eae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:21:44.283952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab8cea-0f77-468a-823b-6f71fbc7eae3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:21:44.287484 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8965c-21cc-482f-9107-a455af9be86d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:21:44.288158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8965c-21cc-482f-9107-a455af9be86d service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:21:44.288446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8965c-21cc-482f-9107-a455af9be86d service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:21:44.288726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8965c-21cc-482f-9107-a455af9be86d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:21:44.297468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8965c-21cc-482f-9107-a455af9be86d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:21:44.298897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8965c-21cc-482f-9107-a455af9be86d service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:21:44.308728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 767/1539] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:21:53.951471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=32 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:21:54.304629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=33 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:10.347183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ce3d8-bbd9-4de8-a087-1d0fd6bb96ba None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.347850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ce3d8-bbd9-4de8-a087-1d0fd6bb96ba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.347850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ce3d8-bbd9-4de8-a087-1d0fd6bb96ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.371084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5d0ce3d8-bbd9-4de8-a087-1d0fd6bb96ba None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:10.372978 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5d0ce3d8-bbd9-4de8-a087-1d0fd6bb96ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:10.386608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 773/1540] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:10.398339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe12d8-020c-4cad-b108-c474bbca30a9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.398935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe12d8-020c-4cad-b108-c474bbca30a9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.398935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe12d8-020c-4cad-b108-c474bbca30a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.405543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b48c2c-64ed-4dd9-943b-f46331c89123 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.405881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b48c2c-64ed-4dd9-943b-f46331c89123 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.406131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b48c2c-64ed-4dd9-943b-f46331c89123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.428887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-52fe12d8-020c-4cad-b108-c474bbca30a9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:10.430531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-52fe12d8-020c-4cad-b108-c474bbca30a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:10.445375 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b0b48c2c-64ed-4dd9-943b-f46331c89123 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:10.446723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0b48c2c-64ed-4dd9-943b-f46331c89123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:10.449932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 768/1541] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:23:10.455285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe12d8-020c-4cad-b108-c474bbca30a9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:10.464047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 774/1542] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:10.469970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe12d8-020c-4cad-b108-c474bbca30a9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:10.472465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf5f5-d235-4a31-9985-7ceaaded2980 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.472760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf5f5-d235-4a31-9985-7ceaaded2980 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.473105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf5f5-d235-4a31-9985-7ceaaded2980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.479074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceccb55-8379-4470-96dc-e6222ac9caf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:10.480234 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceccb55-8379-4470-96dc-e6222ac9caf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.480876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceccb55-8379-4470-96dc-e6222ac9caf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.481473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceccb55-8379-4470-96dc-e6222ac9caf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.482542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceccb55-8379-4470-96dc-e6222ac9caf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:10.483085 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceccb55-8379-4470-96dc-e6222ac9caf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:10.484401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-cceccb55-8379-4470-96dc-e6222ac9caf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:23:10.484401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Jun 22 12:23:10.484401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: Jun 22 12:23:10.485715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceccb55-8379-4470-96dc-e6222ac9caf0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:10.508856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 769/1543] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:23:10.510374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4e7cf5f5-d235-4a31-9985-7ceaaded2980 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:10.511578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4e7cf5f5-d235-4a31-9985-7ceaaded2980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:10.518716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceccb55-8379-4470-96dc-e6222ac9caf0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:10.528661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 775/1544] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:10.533532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cf5f5-d235-4a31-9985-7ceaaded2980 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:10.535036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceccb55-8379-4470-96dc-e6222ac9caf0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:10.548939 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fa16e-e2f9-4427-a4e7-3ff1561c6fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:10.549605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cf5f5-d235-4a31-9985-7ceaaded2980 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:10.550472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fa16e-e2f9-4427-a4e7-3ff1561c6fff admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.551626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fa16e-e2f9-4427-a4e7-3ff1561c6fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.552256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fa16e-e2f9-4427-a4e7-3ff1561c6fff admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.553347 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fa16e-e2f9-4427-a4e7-3ff1561c6fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:10.555996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fa16e-e2f9-4427-a4e7-3ff1561c6fff admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:10.560635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba88ded-037e-4325-bf8c-de0633544a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:10.561343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba88ded-037e-4325-bf8c-de0633544a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.561633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba88ded-037e-4325-bf8c-de0633544a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.561917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba88ded-037e-4325-bf8c-de0633544a92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.562676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba88ded-037e-4325-bf8c-de0633544a92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:10.562996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba88ded-037e-4325-bf8c-de0633544a92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:10.568052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba88ded-037e-4325-bf8c-de0633544a92 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:10.587761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 776/1545] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:23:10.596435 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba88ded-037e-4325-bf8c-de0633544a92 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:10.609000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 770/1546] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/projects => generated 363 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:23:10.613405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fa16e-e2f9-4427-a4e7-3ff1561c6fff admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:10.614097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba88ded-037e-4325-bf8c-de0633544a92 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:10.709430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fa16e-e2f9-4427-a4e7-3ff1561c6fff admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:10.722267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eb879-989d-4e2f-a096-16d6ddb83680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:10.723983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb879-989d-4e2f-a096-16d6ddb83680 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.724544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb879-989d-4e2f-a096-16d6ddb83680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.725059 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb879-989d-4e2f-a096-16d6ddb83680 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.725978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eb879-989d-4e2f-a096-16d6ddb83680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:10.727213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-eb9eb879-989d-4e2f-a096-16d6ddb83680 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:23:10.727213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Jun 22 12:23:10.727213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: Jun 22 12:23:10.728971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eb879-989d-4e2f-a096-16d6ddb83680 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:10.735002 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572951-adfa-430e-89b4-d2a4311efb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:10.735684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572951-adfa-430e-89b4-d2a4311efb88 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.735986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572951-adfa-430e-89b4-d2a4311efb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.736624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572951-adfa-430e-89b4-d2a4311efb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.737401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d572951-adfa-430e-89b4-d2a4311efb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:10.738786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-5d572951-adfa-430e-89b4-d2a4311efb88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:23:10.738786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 22 12:23:10.738786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: Jun 22 12:23:10.740037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d572951-adfa-430e-89b4-d2a4311efb88 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:10.774008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 771/1547] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/users => generated 282 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:23:10.775709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63f5b3-0d05-468d-aa4a-79c446b3187b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.776322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63f5b3-0d05-468d-aa4a-79c446b3187b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.776865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63f5b3-0d05-468d-aa4a-79c446b3187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.799772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4d63f5b3-0d05-468d-aa4a-79c446b3187b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:10.801722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4d63f5b3-0d05-468d-aa4a-79c446b3187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:10.813258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 772/1548] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:10.815060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61724-a734-4754-ad6f-f937b96c10ac None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.815587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61724-a734-4754-ad6f-f937b96c10ac None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.816553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c61724-a734-4754-ad6f-f937b96c10ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.836490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 777/1549] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/projects => generated 381 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:10.836490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff0d9-0ca0-41d9-b760-8c84286c7e9b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.836490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff0d9-0ca0-41d9-b760-8c84286c7e9b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.836490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff0d9-0ca0-41d9-b760-8c84286c7e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.843365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c6c61724-a734-4754-ad6f-f937b96c10ac None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:10.844595 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c6c61724-a734-4754-ad6f-f937b96c10ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:10.860113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5b5ff0d9-0ca0-41d9-b760-8c84286c7e9b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:10.861268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5b5ff0d9-0ca0-41d9-b760-8c84286c7e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:10.906115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 773/1550] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:10.907751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceec5d-bf1d-415a-b231-e927cdb05947 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.908077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceec5d-bf1d-415a-b231-e927cdb05947 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.908366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceec5d-bf1d-415a-b231-e927cdb05947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.925368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d3ceec5d-bf1d-415a-b231-e927cdb05947 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:10.926100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 778/1551] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:10.926607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d3ceec5d-bf1d-415a-b231-e927cdb05947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:10.927067 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ff0d9-0ca0-41d9-b760-8c84286c7e9b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:10.934842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 774/1552] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:10.936295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef5dc-c99d-4497-8379-b7cd62cf22db None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.936724 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef5dc-c99d-4497-8379-b7cd62cf22db None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.937002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef5dc-c99d-4497-8379-b7cd62cf22db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.937543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ff0d9-0ca0-41d9-b760-8c84286c7e9b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:10.942727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cb409-356c-42db-8a20-03775bc9a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:10.943469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb409-356c-42db-8a20-03775bc9a538 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.943942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb409-356c-42db-8a20-03775bc9a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.944327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb409-356c-42db-8a20-03775bc9a538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.945067 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cb409-356c-42db-8a20-03775bc9a538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:10.946703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cb409-356c-42db-8a20-03775bc9a538 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:10.955233 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e22ef5dc-c99d-4497-8379-b7cd62cf22db None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:10.956493 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e22ef5dc-c99d-4497-8379-b7cd62cf22db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:10.956926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 779/1553] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:10.958863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085da05-880f-4e7a-b6f1-d1e11161f275 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.959127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085da05-880f-4e7a-b6f1-d1e11161f275 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.959411 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085da05-880f-4e7a-b6f1-d1e11161f275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.966667 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 775/1554] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:10.967441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ef5dc-c99d-4497-8379-b7cd62cf22db None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:10.976716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ef5dc-c99d-4497-8379-b7cd62cf22db None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:10.980101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8085da05-880f-4e7a-b6f1-d1e11161f275 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:10.981212 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb37b4-28c5-4e3d-9ea7-c2333e3c8553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:10.981347 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8085da05-880f-4e7a-b6f1-d1e11161f275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:10.981861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb37b4-28c5-4e3d-9ea7-c2333e3c8553 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.982148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb37b4-28c5-4e3d-9ea7-c2333e3c8553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.982425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb37b4-28c5-4e3d-9ea7-c2333e3c8553 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:10.983105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb37b4-28c5-4e3d-9ea7-c2333e3c8553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:10.985074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb37b4-28c5-4e3d-9ea7-c2333e3c8553 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:10.989469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 780/1555] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:10.990664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea50ef-c407-44c0-9c3e-88ebcb8fff76 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:10.990954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea50ef-c407-44c0-9c3e-88ebcb8fff76 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:10.991238 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea50ef-c407-44c0-9c3e-88ebcb8fff76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.010145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 776/1556] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/users => generated 291 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.010145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930994-58f6-41ae-9654-a30b1abe05b5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.010145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930994-58f6-41ae-9654-a30b1abe05b5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.010145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930994-58f6-41ae-9654-a30b1abe05b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.012793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-48ea50ef-c407-44c0-9c3e-88ebcb8fff76 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:11.014043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-48ea50ef-c407-44c0-9c3e-88ebcb8fff76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:11.022904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 781/1557] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:11.023919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99b942-477e-4a46-8ce5-549f1e7d341c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.024313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99b942-477e-4a46-8ce5-549f1e7d341c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.024704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99b942-477e-4a46-8ce5-549f1e7d341c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.030087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a3930994-58f6-41ae-9654-a30b1abe05b5 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:11.031422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a3930994-58f6-41ae-9654-a30b1abe05b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:11.039683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 777/1558] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:11.041089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c494-9c01-4b2e-aaa0-ac24f569ca35 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.041507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c494-9c01-4b2e-aaa0-ac24f569ca35 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.041863 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c494-9c01-4b2e-aaa0-ac24f569ca35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.044457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5f99b942-477e-4a46-8ce5-549f1e7d341c None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:11.045620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5f99b942-477e-4a46-8ce5-549f1e7d341c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:11.049193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:11.058624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 782/1559] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:11.058624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99b942-477e-4a46-8ce5-549f1e7d341c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.062522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2a70c494-9c01-4b2e-aaa0-ac24f569ca35 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:11.063740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2a70c494-9c01-4b2e-aaa0-ac24f569ca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:11.065938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99b942-477e-4a46-8ce5-549f1e7d341c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.071312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533aca6-6dd8-487b-8702-f8ba6dc3a54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.072129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533aca6-6dd8-487b-8702-f8ba6dc3a54f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.072312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 778/1560] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:11.072424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533aca6-6dd8-487b-8702-f8ba6dc3a54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.072684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533aca6-6dd8-487b-8702-f8ba6dc3a54f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.073147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70c494-9c01-4b2e-aaa0-ac24f569ca35 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.073414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533aca6-6dd8-487b-8702-f8ba6dc3a54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.075026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533aca6-6dd8-487b-8702-f8ba6dc3a54f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.085798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70c494-9c01-4b2e-aaa0-ac24f569ca35 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.089191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 783/1561] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:11.089191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942aae1-6252-4f13-bfca-98d6355346d8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.089191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942aae1-6252-4f13-bfca-98d6355346d8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.089191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942aae1-6252-4f13-bfca-98d6355346d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.090570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62a3c8-c3f0-4cb1-baf2-edfbfd5d9d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.091220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62a3c8-c3f0-4cb1-baf2-edfbfd5d9d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.091511 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62a3c8-c3f0-4cb1-baf2-edfbfd5d9d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.091793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62a3c8-c3f0-4cb1-baf2-edfbfd5d9d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.092554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62a3c8-c3f0-4cb1-baf2-edfbfd5d9d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:11.092865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62a3c8-c3f0-4cb1-baf2-edfbfd5d9d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.094483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62a3c8-c3f0-4cb1-baf2-edfbfd5d9d02 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.105835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c942aae1-6252-4f13-bfca-98d6355346d8 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:11.106333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 779/1562] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:11.107117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c942aae1-6252-4f13-bfca-98d6355346d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:11.107242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62a3c8-c3f0-4cb1-baf2-edfbfd5d9d02 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.118996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 784/1563] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:11.120746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a88741-20a4-40f0-a526-26524344ba38 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.121106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a88741-20a4-40f0-a526-26524344ba38 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.121241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62a3c8-c3f0-4cb1-baf2-edfbfd5d9d02 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.121502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a88741-20a4-40f0-a526-26524344ba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.125823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd5aa4-86da-4c31-8f0e-c16c6ebf5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.126466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd5aa4-86da-4c31-8f0e-c16c6ebf5e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.126752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd5aa4-86da-4c31-8f0e-c16c6ebf5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.127032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd5aa4-86da-4c31-8f0e-c16c6ebf5e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.127748 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd5aa4-86da-4c31-8f0e-c16c6ebf5e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.128763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:11.130034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd5aa4-86da-4c31-8f0e-c16c6ebf5e41 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.140763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c7a88741-20a4-40f0-a526-26524344ba38 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:11.140935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 780/1564] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:11.142058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd5aa4-86da-4c31-8f0e-c16c6ebf5e41 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.142232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c7a88741-20a4-40f0-a526-26524344ba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:11.151249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 785/1565] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:11.152055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a88741-20a4-40f0-a526-26524344ba38 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.154046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd5aa4-86da-4c31-8f0e-c16c6ebf5e41 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.158951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217919a7-c3ad-4ef1-bbb4-a94da842da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.159598 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217919a7-c3ad-4ef1-bbb4-a94da842da35 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.159886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217919a7-c3ad-4ef1-bbb4-a94da842da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.160219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217919a7-c3ad-4ef1-bbb4-a94da842da35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.161482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217919a7-c3ad-4ef1-bbb4-a94da842da35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:11.161792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a88741-20a4-40f0-a526-26524344ba38 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.161906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217919a7-c3ad-4ef1-bbb4-a94da842da35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.163413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217919a7-c3ad-4ef1-bbb4-a94da842da35 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.166711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3f8a1-7167-4512-bd08-de1f68acf605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.167349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3f8a1-7167-4512-bd08-de1f68acf605 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.167637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3f8a1-7167-4512-bd08-de1f68acf605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.167918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3f8a1-7167-4512-bd08-de1f68acf605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.168669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3f8a1-7167-4512-bd08-de1f68acf605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:11.168977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3f8a1-7167-4512-bd08-de1f68acf605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.171341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3f8a1-7167-4512-bd08-de1f68acf605 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.183304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 781/1566] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:11.183304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217919a7-c3ad-4ef1-bbb4-a94da842da35 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.189925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 786/1567] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:11.189925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3f8a1-7167-4512-bd08-de1f68acf605 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.193634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217919a7-c3ad-4ef1-bbb4-a94da842da35 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.194807 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3f8a1-7167-4512-bd08-de1f68acf605 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.198213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dbfd7-787a-4f8c-96be-80abcacabf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.198850 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dbfd7-787a-4f8c-96be-80abcacabf51 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.199133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dbfd7-787a-4f8c-96be-80abcacabf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.199273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c61860-c138-484c-a63b-e86029d307cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.199398 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dbfd7-787a-4f8c-96be-80abcacabf51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.200146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dbfd7-787a-4f8c-96be-80abcacabf51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:11.200259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c61860-c138-484c-a63b-e86029d307cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.200438 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c61860-c138-484c-a63b-e86029d307cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.200540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dbfd7-787a-4f8c-96be-80abcacabf51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.200717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c61860-c138-484c-a63b-e86029d307cb admin admin] PATH_INFO: `/v3/projects/453014e0b03f44d6bf1fcf5a71920f5a/users/f693b676054c4a0f911c53c7550665b7/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.202140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dbfd7-787a-4f8c-96be-80abcacabf51 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.221958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 782/1568] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:11.222116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c61860-c138-484c-a63b-e86029d307cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=453014e0b03f44d6bf1fcf5a71920f5a, user_id=f693b676054c4a0f911c53c7550665b7, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.222217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dbfd7-787a-4f8c-96be-80abcacabf51 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.222312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-49c61860-c138-484c-a63b-e86029d307cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:23:11.222312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 22 12:23:11.222312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: Jun 22 12:23:11.222312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c61860-c138-484c-a63b-e86029d307cb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.226491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dbfd7-787a-4f8c-96be-80abcacabf51 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.231946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 787/1569] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:11 2022] PUT /identity/v3/projects/453014e0b03f44d6bf1fcf5a71920f5a/users/f693b676054c4a0f911c53c7550665b7/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:11.232767 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c61860-c138-484c-a63b-e86029d307cb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.283787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167d063-d5a3-4ab1-8e51-1316961df99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.284481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167d063-d5a3-4ab1-8e51-1316961df99d admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.284770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167d063-d5a3-4ab1-8e51-1316961df99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.285050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167d063-d5a3-4ab1-8e51-1316961df99d admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.285924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167d063-d5a3-4ab1-8e51-1316961df99d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.287877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167d063-d5a3-4ab1-8e51-1316961df99d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.302454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c61860-c138-484c-a63b-e86029d307cb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.307764 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68706fe-d738-4b14-a6b6-98db6b494bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.308487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68706fe-d738-4b14-a6b6-98db6b494bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.308769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68706fe-d738-4b14-a6b6-98db6b494bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.309051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68706fe-d738-4b14-a6b6-98db6b494bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.309769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68706fe-d738-4b14-a6b6-98db6b494bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:11.310076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68706fe-d738-4b14-a6b6-98db6b494bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.311702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68706fe-d738-4b14-a6b6-98db6b494bfb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.313643 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 783/1570] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.314476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167d063-d5a3-4ab1-8e51-1316961df99d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.325476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 788/1571] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:11.326371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68706fe-d738-4b14-a6b6-98db6b494bfb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.335906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68706fe-d738-4b14-a6b6-98db6b494bfb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.385384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167d063-d5a3-4ab1-8e51-1316961df99d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.390056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d879b8-b502-4f65-8129-3afc76ce51b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.390719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d879b8-b502-4f65-8129-3afc76ce51b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.391004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d879b8-b502-4f65-8129-3afc76ce51b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.391547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d879b8-b502-4f65-8129-3afc76ce51b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.391765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7ba4a-280e-408f-96ab-4d13d065b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.392303 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d879b8-b502-4f65-8129-3afc76ce51b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.392471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7ba4a-280e-408f-96ab-4d13d065b105 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.392769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7ba4a-280e-408f-96ab-4d13d065b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.393050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7ba4a-280e-408f-96ab-4d13d065b105 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.393869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7ba4a-280e-408f-96ab-4d13d065b105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:11.393984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d879b8-b502-4f65-8129-3afc76ce51b1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.394185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7ba4a-280e-408f-96ab-4d13d065b105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.395809 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7ba4a-280e-408f-96ab-4d13d065b105 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.403978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 784/1572] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:11.404848 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d879b8-b502-4f65-8129-3afc76ce51b1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.410271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 789/1573] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:11.411250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7ba4a-280e-408f-96ab-4d13d065b105 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.414480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d879b8-b502-4f65-8129-3afc76ce51b1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.419894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78976032-a1dd-4df4-ac32-e5837252e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.420568 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78976032-a1dd-4df4-ac32-e5837252e130 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.420854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78976032-a1dd-4df4-ac32-e5837252e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.421133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78976032-a1dd-4df4-ac32-e5837252e130 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.421229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7ba4a-280e-408f-96ab-4d13d065b105 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.421829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78976032-a1dd-4df4-ac32-e5837252e130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.423814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78976032-a1dd-4df4-ac32-e5837252e130 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.425746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292f38f-1e3d-41bd-b371-f1b58ca1339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.426915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292f38f-1e3d-41bd-b371-f1b58ca1339f admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.427208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292f38f-1e3d-41bd-b371-f1b58ca1339f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.427492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292f38f-1e3d-41bd-b371-f1b58ca1339f admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.428218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292f38f-1e3d-41bd-b371-f1b58ca1339f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.430107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292f38f-1e3d-41bd-b371-f1b58ca1339f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.452286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 785/1574] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.453501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78976032-a1dd-4df4-ac32-e5837252e130 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.456443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 790/1575] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.458280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188b41-174e-4dfa-a2f2-8a37073adc1d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.458570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188b41-174e-4dfa-a2f2-8a37073adc1d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.458847 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188b41-174e-4dfa-a2f2-8a37073adc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.463928 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:11.485470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f8188b41-174e-4dfa-a2f2-8a37073adc1d None None] MFA Rules not processed for user `f693b676054c4a0f911c53c7550665b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:11.486684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f8188b41-174e-4dfa-a2f2-8a37073adc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:11.499253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:11.521403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78976032-a1dd-4df4-ac32-e5837252e130 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.554701 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 791/1576] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:11.557828 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8188b41-174e-4dfa-a2f2-8a37073adc1d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.583620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003f5aa-a90c-4d61-83f5-2e24929a2813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.584314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f5aa-a90c-4d61-83f5-2e24929a2813 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.584609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f5aa-a90c-4d61-83f5-2e24929a2813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.584891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003f5aa-a90c-4d61-83f5-2e24929a2813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.585582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003f5aa-a90c-4d61-83f5-2e24929a2813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.587519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003f5aa-a90c-4d61-83f5-2e24929a2813 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.615429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 786/1577] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.615429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003f5aa-a90c-4d61-83f5-2e24929a2813 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.621050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8188b41-174e-4dfa-a2f2-8a37073adc1d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.674300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003f5aa-a90c-4d61-83f5-2e24929a2813 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.676702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28ec45-b1ff-4701-a510-14e83c900747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.677381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28ec45-b1ff-4701-a510-14e83c900747 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.677762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28ec45-b1ff-4701-a510-14e83c900747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.678048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28ec45-b1ff-4701-a510-14e83c900747 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.678734 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28ec45-b1ff-4701-a510-14e83c900747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.678854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5bcae-b861-4ba0-ba23-cc4c0a237d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.679473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5bcae-b861-4ba0-ba23-cc4c0a237d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.679756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5bcae-b861-4ba0-ba23-cc4c0a237d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.680041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5bcae-b861-4ba0-ba23-cc4c0a237d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.680687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28ec45-b1ff-4701-a510-14e83c900747 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.680797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5bcae-b861-4ba0-ba23-cc4c0a237d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.682608 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5bcae-b861-4ba0-ba23-cc4c0a237d4b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.704367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 792/1578] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.704367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28ec45-b1ff-4701-a510-14e83c900747 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.714514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 787/1579] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.714514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5bcae-b861-4ba0-ba23-cc4c0a237d4b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.714757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28ec45-b1ff-4701-a510-14e83c900747 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.738523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:11.761551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:11.772008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d75a3-4cf3-4068-b091-0bd244c48419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.772934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d75a3-4cf3-4068-b091-0bd244c48419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.773219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d75a3-4cf3-4068-b091-0bd244c48419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.773503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d75a3-4cf3-4068-b091-0bd244c48419 admin admin] PATH_INFO: `/v3/projects/9f29a58b07fd46de962c127876f15611/users/364ae8e304774d3bb2fc8e571fd19bc8/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.775747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5bcae-b861-4ba0-ba23-cc4c0a237d4b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.780420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e57c67-a5d2-41a8-b334-9ad7a8c748d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.781077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57c67-a5d2-41a8-b334-9ad7a8c748d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.781368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57c67-a5d2-41a8-b334-9ad7a8c748d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.781651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57c67-a5d2-41a8-b334-9ad7a8c748d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.782342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e57c67-a5d2-41a8-b334-9ad7a8c748d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.784305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e57c67-a5d2-41a8-b334-9ad7a8c748d3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.788477 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d75a3-4cf3-4068-b091-0bd244c48419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f29a58b07fd46de962c127876f15611, user_id=364ae8e304774d3bb2fc8e571fd19bc8, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.791168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d75a3-4cf3-4068-b091-0bd244c48419 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.804351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 793/1580] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:11 2022] PUT /identity/v3/projects/9f29a58b07fd46de962c127876f15611/users/364ae8e304774d3bb2fc8e571fd19bc8/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:11.806713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d75a3-4cf3-4068-b091-0bd244c48419 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.814796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 788/1581] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.816310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e57c67-a5d2-41a8-b334-9ad7a8c748d3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.875636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d75a3-4cf3-4068-b091-0bd244c48419 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.878475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e57c67-a5d2-41a8-b334-9ad7a8c748d3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.880723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97fead-d79d-4db6-9ec2-79a682a6567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.881392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97fead-d79d-4db6-9ec2-79a682a6567a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.881676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97fead-d79d-4db6-9ec2-79a682a6567a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.881955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97fead-d79d-4db6-9ec2-79a682a6567a admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.882672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97fead-d79d-4db6-9ec2-79a682a6567a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.883639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9f1fb-2d7d-4706-82dc-12f1cf166a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.884338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f1fb-2d7d-4706-82dc-12f1cf166a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.884631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f1fb-2d7d-4706-82dc-12f1cf166a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.884747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97fead-d79d-4db6-9ec2-79a682a6567a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.884916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f1fb-2d7d-4706-82dc-12f1cf166a35 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.885605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9f1fb-2d7d-4706-82dc-12f1cf166a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.887532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9f1fb-2d7d-4706-82dc-12f1cf166a35 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.909004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 794/1582] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.909004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97fead-d79d-4db6-9ec2-79a682a6567a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.909276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 789/1583] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.909276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9f1fb-2d7d-4706-82dc-12f1cf166a35 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.917105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97fead-d79d-4db6-9ec2-79a682a6567a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.920646 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9f1fb-2d7d-4706-82dc-12f1cf166a35 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:11.921658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77233666-1fc4-429e-9c8e-ed933af03ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.922293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233666-1fc4-429e-9c8e-ed933af03ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.922577 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233666-1fc4-429e-9c8e-ed933af03ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.922857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233666-1fc4-429e-9c8e-ed933af03ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.924231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77233666-1fc4-429e-9c8e-ed933af03ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.925488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77233666-1fc4-429e-9c8e-ed933af03ab2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.931128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5466bbe-dee1-4e17-9784-d82e138964a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:11.931796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5466bbe-dee1-4e17-9784-d82e138964a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:11.932110 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5466bbe-dee1-4e17-9784-d82e138964a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:11.932390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5466bbe-dee1-4e17-9784-d82e138964a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:11.933105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5466bbe-dee1-4e17-9784-d82e138964a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:11.935453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5466bbe-dee1-4e17-9784-d82e138964a3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:11.954934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 795/1584] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.954934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77233666-1fc4-429e-9c8e-ed933af03ab2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.955231 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 790/1585] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:11.955231 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5466bbe-dee1-4e17-9784-d82e138964a3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:11.966688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5466bbe-dee1-4e17-9784-d82e138964a3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.015567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77233666-1fc4-429e-9c8e-ed933af03ab2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.020897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4735f1-a3bc-433d-ac76-f7025f16a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.021570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4735f1-a3bc-433d-ac76-f7025f16a8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.021861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4735f1-a3bc-433d-ac76-f7025f16a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.022145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4735f1-a3bc-433d-ac76-f7025f16a8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.022874 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4735f1-a3bc-433d-ac76-f7025f16a8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.023704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed724ac6-5e80-46f9-aa88-ad354da6b2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.024405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed724ac6-5e80-46f9-aa88-ad354da6b2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.024553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4735f1-a3bc-433d-ac76-f7025f16a8cf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.024693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed724ac6-5e80-46f9-aa88-ad354da6b2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.024972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed724ac6-5e80-46f9-aa88-ad354da6b2b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.025657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed724ac6-5e80-46f9-aa88-ad354da6b2b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.027561 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed724ac6-5e80-46f9-aa88-ad354da6b2b8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.034274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 796/1586] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.036041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488e847-785f-4f70-ab19-9f5719d94d86 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.036342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488e847-785f-4f70-ab19-9f5719d94d86 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.036628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488e847-785f-4f70-ab19-9f5719d94d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.052241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 791/1587] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:11 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:12.052241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed724ac6-5e80-46f9-aa88-ad354da6b2b8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.059276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed724ac6-5e80-46f9-aa88-ad354da6b2b8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.062417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c488e847-785f-4f70-ab19-9f5719d94d86 None None] MFA Rules not processed for user `364ae8e304774d3bb2fc8e571fd19bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:12.063643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c488e847-785f-4f70-ab19-9f5719d94d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:12.063773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c3086-025a-461f-9841-92b47a32d201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.064439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c3086-025a-461f-9841-92b47a32d201 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.064728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c3086-025a-461f-9841-92b47a32d201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.065006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c3086-025a-461f-9841-92b47a32d201 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.065680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c3086-025a-461f-9841-92b47a32d201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.067817 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c3086-025a-461f-9841-92b47a32d201 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.076601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:12.092926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 792/1588] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:12 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:12.092926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c3086-025a-461f-9841-92b47a32d201 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.097823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:12.100824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c3086-025a-461f-9841-92b47a32d201 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.106140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e60cb3-c36b-4bbd-9cb1-30a13ca1d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.106816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60cb3-c36b-4bbd-9cb1-30a13ca1d0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.107100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60cb3-c36b-4bbd-9cb1-30a13ca1d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.107715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60cb3-c36b-4bbd-9cb1-30a13ca1d0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.108132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e60cb3-c36b-4bbd-9cb1-30a13ca1d0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.109698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e60cb3-c36b-4bbd-9cb1-30a13ca1d0d4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.120506 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 793/1589] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.121290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e60cb3-c36b-4bbd-9cb1-30a13ca1d0d4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.130872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e60cb3-c36b-4bbd-9cb1-30a13ca1d0d4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.134656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 797/1590] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:12.135466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488e847-785f-4f70-ab19-9f5719d94d86 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.138745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7a5bd-c2c6-4f10-a4b6-8f4c277c879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.139476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7a5bd-c2c6-4f10-a4b6-8f4c277c879c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.139797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7a5bd-c2c6-4f10-a4b6-8f4c277c879c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.140129 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7a5bd-c2c6-4f10-a4b6-8f4c277c879c admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.140955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7a5bd-c2c6-4f10-a4b6-8f4c277c879c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.142815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7a5bd-c2c6-4f10-a4b6-8f4c277c879c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.149022 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488e847-785f-4f70-ab19-9f5719d94d86 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.153570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d1920-97df-445b-b83b-c9562bb391d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.153717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 794/1591] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.154234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1920-97df-445b-b83b-c9562bb391d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.154439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7a5bd-c2c6-4f10-a4b6-8f4c277c879c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.154562 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1920-97df-445b-b83b-c9562bb391d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.154930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1920-97df-445b-b83b-c9562bb391d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.155629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d1920-97df-445b-b83b-c9562bb391d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.157580 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d1920-97df-445b-b83b-c9562bb391d7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.165318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7a5bd-c2c6-4f10-a4b6-8f4c277c879c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.173032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7109d-c420-4a29-88ff-97ffad6d52c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.173032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7109d-c420-4a29-88ff-97ffad6d52c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.173032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7109d-c420-4a29-88ff-97ffad6d52c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.173032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7109d-c420-4a29-88ff-97ffad6d52c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.173430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7109d-c420-4a29-88ff-97ffad6d52c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.174354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7109d-c420-4a29-88ff-97ffad6d52c4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.178228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 798/1592] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:12 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:12.181794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d1920-97df-445b-b83b-c9562bb391d7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.188595 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 795/1593] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.188595 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7109d-c420-4a29-88ff-97ffad6d52c4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.192814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d1920-97df-445b-b83b-c9562bb391d7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.196784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7109d-c420-4a29-88ff-97ffad6d52c4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.197471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09333ec-2f93-4359-bb3f-1a1f2fdd4a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.198126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09333ec-2f93-4359-bb3f-1a1f2fdd4a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.198423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09333ec-2f93-4359-bb3f-1a1f2fdd4a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.198709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09333ec-2f93-4359-bb3f-1a1f2fdd4a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.199464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09333ec-2f93-4359-bb3f-1a1f2fdd4a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.201098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09333ec-2f93-4359-bb3f-1a1f2fdd4a8e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.201559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396910f-ed1f-4644-871b-a7b72ea369db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.202207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396910f-ed1f-4644-871b-a7b72ea369db admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.202500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396910f-ed1f-4644-871b-a7b72ea369db admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.202774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396910f-ed1f-4644-871b-a7b72ea369db admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.203482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396910f-ed1f-4644-871b-a7b72ea369db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.205074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396910f-ed1f-4644-871b-a7b72ea369db admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.211896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 799/1594] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.212763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09333ec-2f93-4359-bb3f-1a1f2fdd4a8e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.221026 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 796/1595] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.221026 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396910f-ed1f-4644-871b-a7b72ea369db admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.222003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09333ec-2f93-4359-bb3f-1a1f2fdd4a8e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.227215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0856-de14-4596-acc0-686c7b9e5777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.227859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0856-de14-4596-acc0-686c7b9e5777 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.228189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0856-de14-4596-acc0-686c7b9e5777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.228473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e0856-de14-4596-acc0-686c7b9e5777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.229187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e0856-de14-4596-acc0-686c7b9e5777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.230771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e0856-de14-4596-acc0-686c7b9e5777 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.231075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396910f-ed1f-4644-871b-a7b72ea369db admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.235800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85329dae-9d17-4378-a6d3-8619839b9c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.236482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85329dae-9d17-4378-a6d3-8619839b9c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.236776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85329dae-9d17-4378-a6d3-8619839b9c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.237058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85329dae-9d17-4378-a6d3-8619839b9c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.237777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85329dae-9d17-4378-a6d3-8619839b9c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.239881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85329dae-9d17-4378-a6d3-8619839b9c68 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.247458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 800/1596] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.248251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0856-de14-4596-acc0-686c7b9e5777 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.251215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 797/1597] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.252058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85329dae-9d17-4378-a6d3-8619839b9c68 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.258909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e0856-de14-4596-acc0-686c7b9e5777 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.262055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85329dae-9d17-4378-a6d3-8619839b9c68 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.263668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7460d6-2fa5-43d5-bcd2-9613087a4ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.264350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7460d6-2fa5-43d5-bcd2-9613087a4ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.264665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7460d6-2fa5-43d5-bcd2-9613087a4ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.264947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7460d6-2fa5-43d5-bcd2-9613087a4ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.265685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7460d6-2fa5-43d5-bcd2-9613087a4ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.266872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120e7e6-159a-40c5-9e35-427f6cc977bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.267501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120e7e6-159a-40c5-9e35-427f6cc977bb admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.267782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120e7e6-159a-40c5-9e35-427f6cc977bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.267973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7460d6-2fa5-43d5-bcd2-9613087a4ba1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.268099 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120e7e6-159a-40c5-9e35-427f6cc977bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.268796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120e7e6-159a-40c5-9e35-427f6cc977bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.270388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120e7e6-159a-40c5-9e35-427f6cc977bb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.280294 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 798/1598] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.281083 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120e7e6-159a-40c5-9e35-427f6cc977bb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.290854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120e7e6-159a-40c5-9e35-427f6cc977bb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.294139 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 801/1599] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:12 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:12.294948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7460d6-2fa5-43d5-bcd2-9613087a4ba1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.295751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446560c4-0da7-47d7-b414-d42c14b86e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.296440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446560c4-0da7-47d7-b414-d42c14b86e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.296733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446560c4-0da7-47d7-b414-d42c14b86e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.297277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446560c4-0da7-47d7-b414-d42c14b86e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.298002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446560c4-0da7-47d7-b414-d42c14b86e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.299613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446560c4-0da7-47d7-b414-d42c14b86e09 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.310578 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 799/1600] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.311415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446560c4-0da7-47d7-b414-d42c14b86e09 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.323366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446560c4-0da7-47d7-b414-d42c14b86e09 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.362265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7460d6-2fa5-43d5-bcd2-9613087a4ba1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.367464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e3866-1703-4fe5-9dbc-9b5b1928e43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.368163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e3866-1703-4fe5-9dbc-9b5b1928e43b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.368450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e3866-1703-4fe5-9dbc-9b5b1928e43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.368761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e3866-1703-4fe5-9dbc-9b5b1928e43b admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.369468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e3866-1703-4fe5-9dbc-9b5b1928e43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.371069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e3866-1703-4fe5-9dbc-9b5b1928e43b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.380861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 802/1601] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.381206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11996618-1774-430b-9ff5-6867e8a6fa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.381646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e3866-1703-4fe5-9dbc-9b5b1928e43b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.382094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11996618-1774-430b-9ff5-6867e8a6fa1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.382379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11996618-1774-430b-9ff5-6867e8a6fa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.382936 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11996618-1774-430b-9ff5-6867e8a6fa1a admin admin] PATH_INFO: `/v3/projects/5998eeb14d9842fa8b330a9cb9cd5f03/users/45beec4d30384eb49bba3ba9a5f2c7ca/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.391854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e3866-1703-4fe5-9dbc-9b5b1928e43b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.396600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497b62b-0d4f-4434-b9cc-233f0db8b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.397237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497b62b-0d4f-4434-b9cc-233f0db8b309 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.397521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497b62b-0d4f-4434-b9cc-233f0db8b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.397802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497b62b-0d4f-4434-b9cc-233f0db8b309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.398508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497b62b-0d4f-4434-b9cc-233f0db8b309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.398829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11996618-1774-430b-9ff5-6867e8a6fa1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5998eeb14d9842fa8b330a9cb9cd5f03, user_id=45beec4d30384eb49bba3ba9a5f2c7ca, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.400105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497b62b-0d4f-4434-b9cc-233f0db8b309 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.401676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11996618-1774-430b-9ff5-6867e8a6fa1a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.411119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 803/1602] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.411989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497b62b-0d4f-4434-b9cc-233f0db8b309 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.418184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 800/1603] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:12 2022] PUT /identity/v3/projects/5998eeb14d9842fa8b330a9cb9cd5f03/users/45beec4d30384eb49bba3ba9a5f2c7ca/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:12.419024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11996618-1774-430b-9ff5-6867e8a6fa1a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.422871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497b62b-0d4f-4434-b9cc-233f0db8b309 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.471567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:12.481636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16576544-9748-42b2-815f-9d07a62706a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.482309 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16576544-9748-42b2-815f-9d07a62706a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.482608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16576544-9748-42b2-815f-9d07a62706a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.482880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16576544-9748-42b2-815f-9d07a62706a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.483600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16576544-9748-42b2-815f-9d07a62706a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.484120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11996618-1774-430b-9ff5-6867e8a6fa1a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.485242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16576544-9748-42b2-815f-9d07a62706a7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.488991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529561f8-202a-428b-8992-156b92dbe6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.489872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529561f8-202a-428b-8992-156b92dbe6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.490162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529561f8-202a-428b-8992-156b92dbe6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.490440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529561f8-202a-428b-8992-156b92dbe6fa admin admin] PATH_INFO: `/v3/projects/2696e8302ee246eb850d7d471cbcd9b1/users/05ab28ce7db949cb9f322aedc4d5163f/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.492761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:12.499668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 804/1604] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.499668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16576544-9748-42b2-815f-9d07a62706a7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.507498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529561f8-202a-428b-8992-156b92dbe6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2696e8302ee246eb850d7d471cbcd9b1, user_id=05ab28ce7db949cb9f322aedc4d5163f, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.509560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16576544-9748-42b2-815f-9d07a62706a7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.510281 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529561f8-202a-428b-8992-156b92dbe6fa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.514116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dab48-d079-438a-90b1-2001f6aa6a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.514983 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dab48-d079-438a-90b1-2001f6aa6a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.515309 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dab48-d079-438a-90b1-2001f6aa6a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.515631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dab48-d079-438a-90b1-2001f6aa6a08 admin admin] PATH_INFO: `/v3/projects/e5058d932d2245daa0e0da4bf69d0434/users/7f78f3daa4744f41a914c0563982b79a/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.524056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 801/1605] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:12 2022] PUT /identity/v3/projects/2696e8302ee246eb850d7d471cbcd9b1/users/05ab28ce7db949cb9f322aedc4d5163f/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:12.525075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529561f8-202a-428b-8992-156b92dbe6fa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.532666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dab48-d079-438a-90b1-2001f6aa6a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5058d932d2245daa0e0da4bf69d0434, user_id=7f78f3daa4744f41a914c0563982b79a, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.535321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dab48-d079-438a-90b1-2001f6aa6a08 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.549708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 805/1606] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:12 2022] PUT /identity/v3/projects/e5058d932d2245daa0e0da4bf69d0434/users/7f78f3daa4744f41a914c0563982b79a/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:12.550277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dab48-d079-438a-90b1-2001f6aa6a08 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.589323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529561f8-202a-428b-8992-156b92dbe6fa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.615325 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dab48-d079-438a-90b1-2001f6aa6a08 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.619868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e7a30-a140-4625-a268-51152dc4141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.620779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e7a30-a140-4625-a268-51152dc4141c admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.621716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e7a30-a140-4625-a268-51152dc4141c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.621716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e7a30-a140-4625-a268-51152dc4141c admin admin] PATH_INFO: `/v3/projects/169417e964c14cf28a9381a23d56017e/users/3c3ec9ad702f4e94a4a00fa25020ffae/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.637288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e7a30-a140-4625-a268-51152dc4141c admin admin] RBAC: Authorizing `identity:create_grant(project_id=169417e964c14cf28a9381a23d56017e, user_id=3c3ec9ad702f4e94a4a00fa25020ffae, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.640010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e7a30-a140-4625-a268-51152dc4141c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.644378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8402c2-ad23-43bb-a7c0-d68a2011f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.645676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8402c2-ad23-43bb-a7c0-d68a2011f2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.645954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8402c2-ad23-43bb-a7c0-d68a2011f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.646257 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8402c2-ad23-43bb-a7c0-d68a2011f2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.646946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8402c2-ad23-43bb-a7c0-d68a2011f2d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.648896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8402c2-ad23-43bb-a7c0-d68a2011f2d3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.654294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 806/1607] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:12 2022] PUT /identity/v3/projects/169417e964c14cf28a9381a23d56017e/users/3c3ec9ad702f4e94a4a00fa25020ffae/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:12.657105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e7a30-a140-4625-a268-51152dc4141c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.669411 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 802/1608] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:12 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:12.670295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8402c2-ad23-43bb-a7c0-d68a2011f2d3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.682093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8402c2-ad23-43bb-a7c0-d68a2011f2d3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.722579 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e7a30-a140-4625-a268-51152dc4141c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.727220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055101a1-845d-4b4a-9aa5-d9ec2e328e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.728144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055101a1-845d-4b4a-9aa5-d9ec2e328e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.728430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055101a1-845d-4b4a-9aa5-d9ec2e328e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.728717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055101a1-845d-4b4a-9aa5-d9ec2e328e31 admin admin] PATH_INFO: `/v3/projects/a7f6403248e24e4fbceffa15c06bc63b/users/05fd0cfd50be476a9e227bbf578a288f/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.737235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9f083-9b21-46ce-bccf-e78aec80b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.738144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9f083-9b21-46ce-bccf-e78aec80b577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.738429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9f083-9b21-46ce-bccf-e78aec80b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.739452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9f083-9b21-46ce-bccf-e78aec80b577 admin admin] PATH_INFO: `/v3/projects/c66ab1e364a54ec58229f8189e70a896/users/76011af8b8b94434bb461d81cff5ae8e/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.743557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055101a1-845d-4b4a-9aa5-d9ec2e328e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f6403248e24e4fbceffa15c06bc63b, user_id=05fd0cfd50be476a9e227bbf578a288f, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.746293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055101a1-845d-4b4a-9aa5-d9ec2e328e31 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.755493 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9f083-9b21-46ce-bccf-e78aec80b577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66ab1e364a54ec58229f8189e70a896, user_id=76011af8b8b94434bb461d81cff5ae8e, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.758198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9f083-9b21-46ce-bccf-e78aec80b577 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.759600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 807/1609] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:12 2022] PUT /identity/v3/projects/a7f6403248e24e4fbceffa15c06bc63b/users/05fd0cfd50be476a9e227bbf578a288f/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:12.760680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3445cf-bd88-4798-afc7-aa2c4c4ddb89 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.760996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3445cf-bd88-4798-afc7-aa2c4c4ddb89 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.761277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3445cf-bd88-4798-afc7-aa2c4c4ddb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.777960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bc3445cf-bd88-4798-afc7-aa2c4c4ddb89 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:12.779089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bc3445cf-bd88-4798-afc7-aa2c4c4ddb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:12.781354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 803/1610] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:12 2022] PUT /identity/v3/projects/c66ab1e364a54ec58229f8189e70a896/users/76011af8b8b94434bb461d81cff5ae8e/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:12.782273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9f083-9b21-46ce-bccf-e78aec80b577 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.786091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:12.808155 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:12.845541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 808/1611] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:12.846823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdb8c-fe3a-4c26-afd4-54ee187aad0e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.847116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdb8c-fe3a-4c26-afd4-54ee187aad0e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.847397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdb8c-fe3a-4c26-afd4-54ee187aad0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.848375 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9f083-9b21-46ce-bccf-e78aec80b577 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.853017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dc0ea-1b7c-4760-b8f8-dc90cd76dd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.853915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dc0ea-1b7c-4760-b8f8-dc90cd76dd09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.854198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dc0ea-1b7c-4760-b8f8-dc90cd76dd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.854475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dc0ea-1b7c-4760-b8f8-dc90cd76dd09 admin admin] PATH_INFO: `/v3/projects/987e8002399f4c63bf71dff701592968/users/0803daf6759c42fdaf5a7fa06ff7c09e/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.865863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-184fdb8c-fe3a-4c26-afd4-54ee187aad0e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:12.867195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-184fdb8c-fe3a-4c26-afd4-54ee187aad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:12.870006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dc0ea-1b7c-4760-b8f8-dc90cd76dd09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987e8002399f4c63bf71dff701592968, user_id=0803daf6759c42fdaf5a7fa06ff7c09e, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.872714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dc0ea-1b7c-4760-b8f8-dc90cd76dd09 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.875109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 809/1612] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:12.876531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27248-5d5c-4198-9483-ebfe25f7e7d3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.876819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27248-5d5c-4198-9483-ebfe25f7e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.877100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27248-5d5c-4198-9483-ebfe25f7e7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.891755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 804/1613] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:12 2022] PUT /identity/v3/projects/987e8002399f4c63bf71dff701592968/users/0803daf6759c42fdaf5a7fa06ff7c09e/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:12.892607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dc0ea-1b7c-4760-b8f8-dc90cd76dd09 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.896044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-82a27248-5d5c-4198-9483-ebfe25f7e7d3 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:12.897432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-82a27248-5d5c-4198-9483-ebfe25f7e7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:12.953686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dc0ea-1b7c-4760-b8f8-dc90cd76dd09 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.960210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 810/1614] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:12.960210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a27248-5d5c-4198-9483-ebfe25f7e7d3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:12.966900 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053a0e6-67c7-4c87-a2c8-4ccb8cac9f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.967109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a27248-5d5c-4198-9483-ebfe25f7e7d3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:12.967698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053a0e6-67c7-4c87-a2c8-4ccb8cac9f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.968067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053a0e6-67c7-4c87-a2c8-4ccb8cac9f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.968499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053a0e6-67c7-4c87-a2c8-4ccb8cac9f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.969233 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053a0e6-67c7-4c87-a2c8-4ccb8cac9f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.970888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053a0e6-67c7-4c87-a2c8-4ccb8cac9f46 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.971910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcedd40-14d4-46b7-849b-c4005a2a6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:12.972658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcedd40-14d4-46b7-849b-c4005a2a6a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.973135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcedd40-14d4-46b7-849b-c4005a2a6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.973344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcedd40-14d4-46b7-849b-c4005a2a6a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.974144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcedd40-14d4-46b7-849b-c4005a2a6a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:12.975829 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcedd40-14d4-46b7-849b-c4005a2a6a36 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:12.985533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 805/1615] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.985533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e64fa1-c12b-4a60-83e9-c84258a77315 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.985533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e64fa1-c12b-4a60-83e9-c84258a77315 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.985533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e64fa1-c12b-4a60-83e9-c84258a77315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:12.986603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 811/1616] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:12.987901 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbb104-0242-41c4-b578-f779b93002eb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:12.988219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbb104-0242-41c4-b578-f779b93002eb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:12.989043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbb104-0242-41c4-b578-f779b93002eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.010173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-14dbb104-0242-41c4-b578-f779b93002eb None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:13.011374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-14dbb104-0242-41c4-b578-f779b93002eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:13.014983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b2e64fa1-c12b-4a60-83e9-c84258a77315 None None] MFA Rules not processed for user `05fd0cfd50be476a9e227bbf578a288f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:13.016446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b2e64fa1-c12b-4a60-83e9-c84258a77315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:13.019479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 812/1617] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:13.021048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbb104-0242-41c4-b578-f779b93002eb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.077788 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbb104-0242-41c4-b578-f779b93002eb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.081353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e07b99-6334-420d-b818-5499c9ddfb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.081829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 806/1618] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:13.082083 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e07b99-6334-420d-b818-5499c9ddfb69 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.082470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e07b99-6334-420d-b818-5499c9ddfb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.082623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e64fa1-c12b-4a60-83e9-c84258a77315 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.082756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e07b99-6334-420d-b818-5499c9ddfb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.094479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e07b99-6334-420d-b818-5499c9ddfb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.095919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e07b99-6334-420d-b818-5499c9ddfb69 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:13.097675 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e64fa1-c12b-4a60-83e9-c84258a77315 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.108499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba841ab-96e6-4895-918e-18d8987bc645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.109212 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba841ab-96e6-4895-918e-18d8987bc645 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.109445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba841ab-96e6-4895-918e-18d8987bc645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.109722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba841ab-96e6-4895-918e-18d8987bc645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.114854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 813/1619] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:13.116044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fba98-b4a3-4c11-adea-b8cc9efcb8e1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.116371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fba98-b4a3-4c11-adea-b8cc9efcb8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.116686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fba98-b4a3-4c11-adea-b8cc9efcb8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.123897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba841ab-96e6-4895-918e-18d8987bc645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.125455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba841ab-96e6-4895-918e-18d8987bc645 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:13.130220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:13.137659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 807/1620] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:13.138616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba841ab-96e6-4895-918e-18d8987bc645 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.147937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba841ab-96e6-4895-918e-18d8987bc645 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.148132 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f48fba98-b4a3-4c11-adea-b8cc9efcb8e1 None None] MFA Rules not processed for user `0803daf6759c42fdaf5a7fa06ff7c09e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:13.149276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f48fba98-b4a3-4c11-adea-b8cc9efcb8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:13.151944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2446d6-ad11-4e28-aa62-cfd48bb583be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.152626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2446d6-ad11-4e28-aa62-cfd48bb583be service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.152916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2446d6-ad11-4e28-aa62-cfd48bb583be service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.153237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2446d6-ad11-4e28-aa62-cfd48bb583be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.163597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2446d6-ad11-4e28-aa62-cfd48bb583be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.165080 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2446d6-ad11-4e28-aa62-cfd48bb583be service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:13.175884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 808/1621] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:13.177228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2446d6-ad11-4e28-aa62-cfd48bb583be service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.186877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2446d6-ad11-4e28-aa62-cfd48bb583be service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.191810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10582e-c5c5-4b20-ba48-cc1fd6d36894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.192770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10582e-c5c5-4b20-ba48-cc1fd6d36894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.193060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10582e-c5c5-4b20-ba48-cc1fd6d36894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.193340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10582e-c5c5-4b20-ba48-cc1fd6d36894 admin admin] PATH_INFO: `/v3/projects/169417e964c14cf28a9381a23d56017e/users/3c3ec9ad702f4e94a4a00fa25020ffae/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.195399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10582e-c5c5-4b20-ba48-cc1fd6d36894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169417e964c14cf28a9381a23d56017e, user_id=3c3ec9ad702f4e94a4a00fa25020ffae, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.196460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:13.198108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10582e-c5c5-4b20-ba48-cc1fd6d36894 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:13.208959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 809/1622] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:13 2022] PUT /identity/v3/projects/169417e964c14cf28a9381a23d56017e/users/3c3ec9ad702f4e94a4a00fa25020ffae/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:13.219172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10582e-c5c5-4b20-ba48-cc1fd6d36894 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.224237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 814/1623] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:13.225193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fba98-b4a3-4c11-adea-b8cc9efcb8e1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.227360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f48fba98-b4a3-4c11-adea-b8cc9efcb8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:13.241292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fba98-b4a3-4c11-adea-b8cc9efcb8e1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.289712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10582e-c5c5-4b20-ba48-cc1fd6d36894 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.294251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4759d2-7303-456d-9ae9-ecf3e5cd5f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.295241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4759d2-7303-456d-9ae9-ecf3e5cd5f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.295677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4759d2-7303-456d-9ae9-ecf3e5cd5f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.295887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4759d2-7303-456d-9ae9-ecf3e5cd5f67 admin admin] PATH_INFO: `/v3/projects/3d383fc5bea34fd598b33a8a811b04ce/users/0442e24418e04500a3681d05f63bdff7/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.302846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b76395-520d-418b-acd1-5308113b8e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.303584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76395-520d-418b-acd1-5308113b8e07 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.303938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76395-520d-418b-acd1-5308113b8e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.304316 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b76395-520d-418b-acd1-5308113b8e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.312971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4759d2-7303-456d-9ae9-ecf3e5cd5f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d383fc5bea34fd598b33a8a811b04ce, user_id=0442e24418e04500a3681d05f63bdff7, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.315690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4759d2-7303-456d-9ae9-ecf3e5cd5f67 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:13.315820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b76395-520d-418b-acd1-5308113b8e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.317388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b76395-520d-418b-acd1-5308113b8e07 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:13.328496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 815/1624] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:13.329927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38b94d-e65e-4e01-88ac-43adb477093f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.330394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38b94d-e65e-4e01-88ac-43adb477093f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.331018 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38b94d-e65e-4e01-88ac-43adb477093f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.332883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 816/1625] 10.222.0.66 () {54 vars in 961 bytes} [Wed Jun 22 12:23:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:23:13.333809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 810/1626] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:13 2022] PUT /identity/v3/projects/3d383fc5bea34fd598b33a8a811b04ce/users/0442e24418e04500a3681d05f63bdff7/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:13.334165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e97b1-24c3-4837-afa0-33eb16354032 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.334494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e97b1-24c3-4837-afa0-33eb16354032 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.334844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e97b1-24c3-4837-afa0-33eb16354032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.334994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4759d2-7303-456d-9ae9-ecf3e5cd5f67 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.384195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-214e97b1-24c3-4837-afa0-33eb16354032 None None] MFA Rules not processed for user `3c3ec9ad702f4e94a4a00fa25020ffae`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:13.386519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-214e97b1-24c3-4837-afa0-33eb16354032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:13.439327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4759d2-7303-456d-9ae9-ecf3e5cd5f67 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.447959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc7e75-3352-4fb6-b7d1-7d0a134c61c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.448920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc7e75-3352-4fb6-b7d1-7d0a134c61c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.449223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc7e75-3352-4fb6-b7d1-7d0a134c61c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.450971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc7e75-3352-4fb6-b7d1-7d0a134c61c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.451919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc7e75-3352-4fb6-b7d1-7d0a134c61c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.455351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc7e75-3352-4fb6-b7d1-7d0a134c61c3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:13.486998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 817/1627] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:13.488207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e97b1-24c3-4837-afa0-33eb16354032 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.490433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 811/1628] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:13 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:13.491797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9b6cc-b2e9-41f4-babd-f719d6d4e079 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.492218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9b6cc-b2e9-41f4-babd-f719d6d4e079 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.492557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9b6cc-b2e9-41f4-babd-f719d6d4e079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.503440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e97b1-24c3-4837-afa0-33eb16354032 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.517541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-32c9b6cc-b2e9-41f4-babd-f719d6d4e079 None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:13.519385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-32c9b6cc-b2e9-41f4-babd-f719d6d4e079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:13.577830 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:13.605431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc211bf-cb04-42dd-8b05-303a53614450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.606342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc211bf-cb04-42dd-8b05-303a53614450 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.606469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc211bf-cb04-42dd-8b05-303a53614450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.606754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc211bf-cb04-42dd-8b05-303a53614450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.608331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc211bf-cb04-42dd-8b05-303a53614450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.610488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc211bf-cb04-42dd-8b05-303a53614450 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:13.624349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 812/1629] 10.222.0.66 () {58 vars in 1058 bytes} [Wed Jun 22 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:13.625444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9b6cc-b2e9-41f4-babd-f719d6d4e079 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.627746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 818/1630] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:13.629120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc211bf-cb04-42dd-8b05-303a53614450 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.638290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:13.639858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9b6cc-b2e9-41f4-babd-f719d6d4e079 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.648328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddd726-376a-4433-8bef-56f6854aec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.649320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddd726-376a-4433-8bef-56f6854aec01 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.650115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddd726-376a-4433-8bef-56f6854aec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.651362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddd726-376a-4433-8bef-56f6854aec01 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.652571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddd726-376a-4433-8bef-56f6854aec01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.655077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddd726-376a-4433-8bef-56f6854aec01 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:13.699125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 813/1631] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:13 2022] POST /identity/v3/users => generated 293 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:13.699125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddd726-376a-4433-8bef-56f6854aec01 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.711304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddd726-376a-4433-8bef-56f6854aec01 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.719789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55549e0-a1a8-43c6-836c-77a2d4f1d969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.720870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55549e0-a1a8-43c6-836c-77a2d4f1d969 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.721280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55549e0-a1a8-43c6-836c-77a2d4f1d969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.721682 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55549e0-a1a8-43c6-836c-77a2d4f1d969 admin admin] PATH_INFO: `/v3/projects/3d383fc5bea34fd598b33a8a811b04ce/users/0442e24418e04500a3681d05f63bdff7/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.724705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55549e0-a1a8-43c6-836c-77a2d4f1d969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d383fc5bea34fd598b33a8a811b04ce, user_id=0442e24418e04500a3681d05f63bdff7, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.729878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55549e0-a1a8-43c6-836c-77a2d4f1d969 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:13.746275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc211bf-cb04-42dd-8b05-303a53614450 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.747777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 814/1632] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:13 2022] PUT /identity/v3/projects/3d383fc5bea34fd598b33a8a811b04ce/users/0442e24418e04500a3681d05f63bdff7/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:13.748835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55549e0-a1a8-43c6-836c-77a2d4f1d969 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.841078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38ac2b-cbda-4866-bfae-f24444e226fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.842134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38ac2b-cbda-4866-bfae-f24444e226fe service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.842719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38ac2b-cbda-4866-bfae-f24444e226fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.843292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38ac2b-cbda-4866-bfae-f24444e226fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.862733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55549e0-a1a8-43c6-836c-77a2d4f1d969 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:13.882039 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315c73f-7369-4949-acf7-3e3078b32a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:13.882908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315c73f-7369-4949-acf7-3e3078b32a43 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:13.883243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315c73f-7369-4949-acf7-3e3078b32a43 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:13.884081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315c73f-7369-4949-acf7-3e3078b32a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:13.938246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38ac2b-cbda-4866-bfae-f24444e226fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.940841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38ac2b-cbda-4866-bfae-f24444e226fe service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:13.954827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 819/1633] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:13.955857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38ac2b-cbda-4866-bfae-f24444e226fe service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:13.979891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315c73f-7369-4949-acf7-3e3078b32a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:13.985619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315c73f-7369-4949-acf7-3e3078b32a43 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:14.016475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 815/1634] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:14.018384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4edfab-5aa1-4886-8830-489b491381e7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:14.018702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4edfab-5aa1-4886-8830-489b491381e7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:14.019061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4edfab-5aa1-4886-8830-489b491381e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:14.058726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38ac2b-cbda-4866-bfae-f24444e226fe service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:14.066322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311bba6-121e-4bf9-b64c-2a942a1ee59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:14.075744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311bba6-121e-4bf9-b64c-2a942a1ee59c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:14.076268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311bba6-121e-4bf9-b64c-2a942a1ee59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:14.076565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311bba6-121e-4bf9-b64c-2a942a1ee59c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:14.078501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311bba6-121e-4bf9-b64c-2a942a1ee59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:14.080009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311bba6-121e-4bf9-b64c-2a942a1ee59c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:14.085216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3c4edfab-5aa1-4886-8830-489b491381e7 None None] MFA Rules not processed for user `0442e24418e04500a3681d05f63bdff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:14.087603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3c4edfab-5aa1-4886-8830-489b491381e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:14.096403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 820/1635] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:14.099144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311bba6-121e-4bf9-b64c-2a942a1ee59c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:14.116597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311bba6-121e-4bf9-b64c-2a942a1ee59c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:14.138607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac941a-a22b-4aa7-a561-28ef0d192b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:14.139759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac941a-a22b-4aa7-a561-28ef0d192b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:14.140267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac941a-a22b-4aa7-a561-28ef0d192b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:14.140634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac941a-a22b-4aa7-a561-28ef0d192b5d admin admin] PATH_INFO: `/v3/projects/5cd9aa4707c64821904050c98a3e5c29/users/b3f05234f7474e5d8b2b5f6461da253c/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:14.148596 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:14.150410 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:14.190011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac941a-a22b-4aa7-a561-28ef0d192b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd9aa4707c64821904050c98a3e5c29, user_id=b3f05234f7474e5d8b2b5f6461da253c, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:14.193587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac941a-a22b-4aa7-a561-28ef0d192b5d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:14.224355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 821/1636] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:14 2022] PUT /identity/v3/projects/5cd9aa4707c64821904050c98a3e5c29/users/b3f05234f7474e5d8b2b5f6461da253c/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:14.227929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac941a-a22b-4aa7-a561-28ef0d192b5d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:14.248614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 816/1637] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:14.248614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4edfab-5aa1-4886-8830-489b491381e7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:14.271922 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4edfab-5aa1-4886-8830-489b491381e7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:14.346076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac941a-a22b-4aa7-a561-28ef0d192b5d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:14.351317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c71f-cb5d-43d3-abe1-8466853e8cb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:14.365136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c71f-cb5d-43d3-abe1-8466853e8cb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:14.366910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c71f-cb5d-43d3-abe1-8466853e8cb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:14.368010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c71f-cb5d-43d3-abe1-8466853e8cb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:14.402503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cc436-2e27-498d-ad47-3a5d5a14f7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:14.403774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cc436-2e27-498d-ad47-3a5d5a14f7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:14.404352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cc436-2e27-498d-ad47-3a5d5a14f7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:14.404851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cc436-2e27-498d-ad47-3a5d5a14f7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:14.406159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cc436-2e27-498d-ad47-3a5d5a14f7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:14.408856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cc436-2e27-498d-ad47-3a5d5a14f7e8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:14.427589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 817/1638] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:14.435196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cc436-2e27-498d-ad47-3a5d5a14f7e8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:14.451141 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cc436-2e27-498d-ad47-3a5d5a14f7e8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:14.458403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e4d02-575e-490e-aaf4-991d7de56c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:14.459305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4d02-575e-490e-aaf4-991d7de56c58 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:14.459698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4d02-575e-490e-aaf4-991d7de56c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:14.460103 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4d02-575e-490e-aaf4-991d7de56c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:14.468728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c71f-cb5d-43d3-abe1-8466853e8cb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:14.470824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c71f-cb5d-43d3-abe1-8466853e8cb3 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:14.485326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 822/1639] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:14 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:14.486830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14646da0-1fc1-4a0f-9690-71d51002aac7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:14.487132 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14646da0-1fc1-4a0f-9690-71d51002aac7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:14.487686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14646da0-1fc1-4a0f-9690-71d51002aac7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:14.489917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 823/1640] 10.222.0.66 () {54 vars in 912 bytes} [Wed Jun 22 12:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:23:14.490691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14646da0-1fc1-4a0f-9690-71d51002aac7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:14.506371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14646da0-1fc1-4a0f-9690-71d51002aac7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:14.515186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cafad7-b23a-4051-870c-c6a91c9ae1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:14.518841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cafad7-b23a-4051-870c-c6a91c9ae1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:14.519139 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cafad7-b23a-4051-870c-c6a91c9ae1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:14.520684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cafad7-b23a-4051-870c-c6a91c9ae1c0 admin admin] PATH_INFO: `/v3/projects/5cd9aa4707c64821904050c98a3e5c29/users/b3f05234f7474e5d8b2b5f6461da253c/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:14.525692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cafad7-b23a-4051-870c-c6a91c9ae1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd9aa4707c64821904050c98a3e5c29, user_id=b3f05234f7474e5d8b2b5f6461da253c, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:14.531899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cafad7-b23a-4051-870c-c6a91c9ae1c0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:14.564005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 824/1641] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:14 2022] PUT /identity/v3/projects/5cd9aa4707c64821904050c98a3e5c29/users/b3f05234f7474e5d8b2b5f6461da253c/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:14.567616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4c1e-2995-4ea9-aa24-54538558d1c3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:14.567826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4c1e-2995-4ea9-aa24-54538558d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:14.568134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4c1e-2995-4ea9-aa24-54538558d1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:14.601816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e4d02-575e-490e-aaf4-991d7de56c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:14.604911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e4d02-575e-490e-aaf4-991d7de56c58 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:14.618042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7fff4c1e-2995-4ea9-aa24-54538558d1c3 None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:14.619295 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7fff4c1e-2995-4ea9-aa24-54538558d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:14.632488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 818/1642] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:14.635844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6045-35ea-456a-b1be-13499403a6f4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:14.637756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6045-35ea-456a-b1be-13499403a6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:14.640262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc6045-35ea-456a-b1be-13499403a6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:14.737496 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-89dc6045-35ea-456a-b1be-13499403a6f4 None None] MFA Rules not processed for user `b3f05234f7474e5d8b2b5f6461da253c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:14.741937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-89dc6045-35ea-456a-b1be-13499403a6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:14.822859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 825/1643] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:14.823757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff4c1e-2995-4ea9-aa24-54538558d1c3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:14.845690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:14.865273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:14.905839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 819/1644] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:14.934355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc6045-35ea-456a-b1be-13499403a6f4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:14.971297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff4c1e-2995-4ea9-aa24-54538558d1c3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:14.978997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f101ad6-adec-4ac3-b343-b20364e13240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:14.979744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f101ad6-adec-4ac3-b343-b20364e13240 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:14.980134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f101ad6-adec-4ac3-b343-b20364e13240 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:14.980426 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f101ad6-adec-4ac3-b343-b20364e13240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:15.072216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc6045-35ea-456a-b1be-13499403a6f4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:15.078304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003eb9b-e652-4cf1-8ed0-07eb0d6c20fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:15.078954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003eb9b-e652-4cf1-8ed0-07eb0d6c20fb service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:15.079251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003eb9b-e652-4cf1-8ed0-07eb0d6c20fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:15.079538 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003eb9b-e652-4cf1-8ed0-07eb0d6c20fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:15.101084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003eb9b-e652-4cf1-8ed0-07eb0d6c20fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:15.102964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003eb9b-e652-4cf1-8ed0-07eb0d6c20fb service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:15.108655 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f101ad6-adec-4ac3-b343-b20364e13240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:15.110935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f101ad6-adec-4ac3-b343-b20364e13240 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:15.117066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 820/1645] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:15.127699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 826/1646] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:15.423467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003eb9b-e652-4cf1-8ed0-07eb0d6c20fb service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:15.438610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003eb9b-e652-4cf1-8ed0-07eb0d6c20fb service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:15.452814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43a707-dba4-45b6-946f-63fcefd9589b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:15.453490 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43a707-dba4-45b6-946f-63fcefd9589b service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:15.453777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43a707-dba4-45b6-946f-63fcefd9589b service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:15.454063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43a707-dba4-45b6-946f-63fcefd9589b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:15.486869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43a707-dba4-45b6-946f-63fcefd9589b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:15.488684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43a707-dba4-45b6-946f-63fcefd9589b service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:15.519926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 821/1647] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:16.416849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9dc7-7d03-4133-b8d8-e276937d8f40 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:16.417338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9dc7-7d03-4133-b8d8-e276937d8f40 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:16.417453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d9dc7-7d03-4133-b8d8-e276937d8f40 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:16.418826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 827/1648] 10.222.0.66 () {54 vars in 961 bytes} [Wed Jun 22 12:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:23:16.429222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8f5b1-4a1c-4591-979b-1576f67d9080 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:16.429514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8f5b1-4a1c-4591-979b-1576f67d9080 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:16.429801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8f5b1-4a1c-4591-979b-1576f67d9080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:16.472999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-53c8f5b1-4a1c-4591-979b-1576f67d9080 None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:16.476488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-53c8f5b1-4a1c-4591-979b-1576f67d9080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:16.501379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 822/1649] 10.222.0.66 () {58 vars in 1058 bytes} [Wed Jun 22 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:16.510241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b967489-4f7e-4265-a645-fcdfb71ae0ce None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:16.510544 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b967489-4f7e-4265-a645-fcdfb71ae0ce None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:16.511136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b967489-4f7e-4265-a645-fcdfb71ae0ce None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:16.512406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 828/1650] 10.222.0.66 () {54 vars in 912 bytes} [Wed Jun 22 12:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:23:16.520755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588336c1-369c-4ec6-8dd1-84731a0b61be None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:16.521049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588336c1-369c-4ec6-8dd1-84731a0b61be None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:16.521404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588336c1-369c-4ec6-8dd1-84731a0b61be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:16.556544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-588336c1-369c-4ec6-8dd1-84731a0b61be None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:16.557778 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-588336c1-369c-4ec6-8dd1-84731a0b61be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:16.593696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 823/1651] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:16.726151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b967489-4f7e-4265-a645-fcdfb71ae0ce None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:16.752789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b967489-4f7e-4265-a645-fcdfb71ae0ce None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:16.762243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c5d08-bb91-460b-95f3-af7f2621f752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:16.762912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c5d08-bb91-460b-95f3-af7f2621f752 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:16.763187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c5d08-bb91-460b-95f3-af7f2621f752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:16.763469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c5d08-bb91-460b-95f3-af7f2621f752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:16.794930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c5d08-bb91-460b-95f3-af7f2621f752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:16.796433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c5d08-bb91-460b-95f3-af7f2621f752 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:16.819112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 829/1652] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:17.499312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588336c1-369c-4ec6-8dd1-84731a0b61be None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:17.654382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588336c1-369c-4ec6-8dd1-84731a0b61be None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:17.681520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:17.682896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:17.683417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:17.686356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] PATH_INFO: `/v3/users/0803daf6759c42fdaf5a7fa06ff7c09e` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:17.693435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0803daf6759c42fdaf5a7fa06ff7c09e)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:17.695761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:17.802697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0803daf6759c42fdaf5a7fa06ff7c09e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:17.817590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:17.912898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0803daf6759c42fdaf5a7fa06ff7c09e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:17.912898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0803daf6759c42fdaf5a7fa06ff7c09e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:17.912898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0803daf6759c42fdaf5a7fa06ff7c09e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:17.941709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0803daf6759c42fdaf5a7fa06ff7c09e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:17.961616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 824/1653] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:17 2022] DELETE /identity/v3/users/0803daf6759c42fdaf5a7fa06ff7c09e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:17.968628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66e75b-c926-4dd8-b220-9754feb8ba23 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:17.969497 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66e75b-c926-4dd8-b220-9754feb8ba23 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:17.969953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66e75b-c926-4dd8-b220-9754feb8ba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:18.012683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-eb66e75b-c926-4dd8-b220-9754feb8ba23 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:18.014239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eb66e75b-c926-4dd8-b220-9754feb8ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:18.187888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 830/1654] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:18.201650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:18.203412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:18.421036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fd7ac-9fcd-4003-a262-61edbf537dfa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:18.437393 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b58ba-e08a-41f0-9b26-333ed4ac89bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:18.440064 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b58ba-e08a-41f0-9b26-333ed4ac89bb service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:18.441273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b58ba-e08a-41f0-9b26-333ed4ac89bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:18.442208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b58ba-e08a-41f0-9b26-333ed4ac89bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:18.470931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b58ba-e08a-41f0-9b26-333ed4ac89bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:18.473405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b58ba-e08a-41f0-9b26-333ed4ac89bb service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:18.503792 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 825/1655] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:21.130112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66e75b-c926-4dd8-b220-9754feb8ba23 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:21.131699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eb66e75b-c926-4dd8-b220-9754feb8ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:21.158047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66e75b-c926-4dd8-b220-9754feb8ba23 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:21.192819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:21.209173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:21.209498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:21.209932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] PATH_INFO: `/v3/projects/987e8002399f4c63bf71dff701592968` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:21.212941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] RBAC: Authorizing `identity:delete_project(project_id=987e8002399f4c63bf71dff701592968)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:21.214920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:21.338993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987e8002399f4c63bf71dff701592968', 'request_id': 'req-51f96746-c821-4a35-9ee5-0ba5b420022f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:21.341607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:21.357086 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987e8002399f4c63bf71dff701592968', 'request_id': 'req-51f96746-c821-4a35-9ee5-0ba5b420022f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:21.386402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987e8002399f4c63bf71dff701592968', 'request_id': 'req-51f96746-c821-4a35-9ee5-0ba5b420022f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:21.413343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] The token cache is being invalidate because project 987e8002399f4c63bf71dff701592968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:21.414088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:21.419276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-51f96746-c821-4a35-9ee5-0ba5b420022f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:21.431894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 831/1656] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:21 2022] DELETE /identity/v3/projects/987e8002399f4c63bf71dff701592968 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:21.433179 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b58ba-e08a-41f0-9b26-333ed4ac89bb service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:21.446146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b58ba-e08a-41f0-9b26-333ed4ac89bb service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:21.595142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:21.596230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:21.596521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:21.596797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] PATH_INFO: `/v3/users/b3f05234f7474e5d8b2b5f6461da253c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:21.598308 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f05234f7474e5d8b2b5f6461da253c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:21.600488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:21.687942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f05234f7474e5d8b2b5f6461da253c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:21.712270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f05234f7474e5d8b2b5f6461da253c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:21.725532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f05234f7474e5d8b2b5f6461da253c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:21.726208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f05234f7474e5d8b2b5f6461da253c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:21.733557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:21.738046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f05234f7474e5d8b2b5f6461da253c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:21.757610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 826/1657] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:21 2022] DELETE /identity/v3/users/b3f05234f7474e5d8b2b5f6461da253c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:23.181242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f99e9-b89e-4dbf-84df-1d091d013b24 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:23.181741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f99e9-b89e-4dbf-84df-1d091d013b24 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:23.181863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f99e9-b89e-4dbf-84df-1d091d013b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:23.264808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-998f99e9-b89e-4dbf-84df-1d091d013b24 None None] MFA Rules not processed for user `76011af8b8b94434bb461d81cff5ae8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:23.266603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-998f99e9-b89e-4dbf-84df-1d091d013b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:23.434220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 832/1658] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:23.450520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:23.452727 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:23.616168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37b873-4901-4a93-a58c-b8a721ff0be5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:23.640115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa767dc-c17f-4739-b998-3f02d5f83587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:23.640807 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa767dc-c17f-4739-b998-3f02d5f83587 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:23.641357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa767dc-c17f-4739-b998-3f02d5f83587 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:23.641645 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa767dc-c17f-4739-b998-3f02d5f83587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:23.658616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa767dc-c17f-4739-b998-3f02d5f83587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:23.663865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa767dc-c17f-4739-b998-3f02d5f83587 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:23.690957 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 827/1659] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:24.630926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f99e9-b89e-4dbf-84df-1d091d013b24 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:24.633066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-998f99e9-b89e-4dbf-84df-1d091d013b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:24.931010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f99e9-b89e-4dbf-84df-1d091d013b24 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:24.951396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:24.952318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:24.955132 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:24.960341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] PATH_INFO: `/v3/projects/5cd9aa4707c64821904050c98a3e5c29` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:24.963232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd9aa4707c64821904050c98a3e5c29)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:24.969968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:25.097876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd9aa4707c64821904050c98a3e5c29', 'request_id': 'req-848a897e-5001-4eec-a8a9-33886beb8b5a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:25.115715 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd9aa4707c64821904050c98a3e5c29', 'request_id': 'req-848a897e-5001-4eec-a8a9-33886beb8b5a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:25.132000 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd9aa4707c64821904050c98a3e5c29', 'request_id': 'req-848a897e-5001-4eec-a8a9-33886beb8b5a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:25.151617 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:25.158430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] The token cache is being invalidate because project 5cd9aa4707c64821904050c98a3e5c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:25.159103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:25.161052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-848a897e-5001-4eec-a8a9-33886beb8b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:25.168631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 833/1660] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:24 2022] DELETE /identity/v3/projects/5cd9aa4707c64821904050c98a3e5c29 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:25.174712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b904-b2ee-42c4-9388-7015bb119132 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:25.175222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b904-b2ee-42c4-9388-7015bb119132 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:25.175349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b904-b2ee-42c4-9388-7015bb119132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:25.216660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7bf3b904-b2ee-42c4-9388-7015bb119132 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:25.222178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7bf3b904-b2ee-42c4-9388-7015bb119132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:25.398515 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 828/1661] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:25.406429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5516e-4cff-45a5-a9a3-b0d67aa009ad None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:25.406999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5516e-4cff-45a5-a9a3-b0d67aa009ad None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:25.408291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5516e-4cff-45a5-a9a3-b0d67aa009ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:25.471842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-62a5516e-4cff-45a5-a9a3-b0d67aa009ad None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:25.473218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-62a5516e-4cff-45a5-a9a3-b0d67aa009ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:25.493545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 834/1662] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:25.497971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3b904-b2ee-42c4-9388-7015bb119132 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:25.511607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3b904-b2ee-42c4-9388-7015bb119132 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:25.522604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d42bc-269d-4ed9-a85b-e845ec2a38cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:25.523292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d42bc-269d-4ed9-a85b-e845ec2a38cc admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:25.523575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d42bc-269d-4ed9-a85b-e845ec2a38cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:25.524856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d42bc-269d-4ed9-a85b-e845ec2a38cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:25.525967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d42bc-269d-4ed9-a85b-e845ec2a38cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:25.526271 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d42bc-269d-4ed9-a85b-e845ec2a38cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:25.528314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d42bc-269d-4ed9-a85b-e845ec2a38cc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:25.567018 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 829/1663] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:25.569762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5516e-4cff-45a5-a9a3-b0d67aa009ad None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:25.581370 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5516e-4cff-45a5-a9a3-b0d67aa009ad None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:25.591398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19509533-7fc4-4624-a25e-5c95bc82baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:25.592210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509533-7fc4-4624-a25e-5c95bc82baf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:25.592598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509533-7fc4-4624-a25e-5c95bc82baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:25.593610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509533-7fc4-4624-a25e-5c95bc82baf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:25.594947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19509533-7fc4-4624-a25e-5c95bc82baf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:25.597007 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19509533-7fc4-4624-a25e-5c95bc82baf6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:25.648713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 835/1664] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:25 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:25.649903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d42bc-269d-4ed9-a85b-e845ec2a38cc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:25.695969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d42bc-269d-4ed9-a85b-e845ec2a38cc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:25.885656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7f950-f377-453b-a5ea-5732363e68f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:25.886463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7f950-f377-453b-a5ea-5732363e68f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:25.886638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7f950-f377-453b-a5ea-5732363e68f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:25.886918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7f950-f377-453b-a5ea-5732363e68f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:25.887804 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7f950-f377-453b-a5ea-5732363e68f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:25.889645 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7f950-f377-453b-a5ea-5732363e68f7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:25.974966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:25.991061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19509533-7fc4-4624-a25e-5c95bc82baf6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:25.997960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 830/1665] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:25 2022] POST /identity/v3/users => generated 291 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:26.003314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19509533-7fc4-4624-a25e-5c95bc82baf6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:26.029799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c46ee9-b496-4613-a243-b909febce903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:26.045605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46ee9-b496-4613-a243-b909febce903 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:26.046646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46ee9-b496-4613-a243-b909febce903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:26.047120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46ee9-b496-4613-a243-b909febce903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:26.048129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c46ee9-b496-4613-a243-b909febce903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:26.050674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c46ee9-b496-4613-a243-b909febce903 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:26.069801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 836/1666] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:26.074460 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7f950-f377-453b-a5ea-5732363e68f7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:26.099006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7f950-f377-453b-a5ea-5732363e68f7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:26.120620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791aea2-eaaf-4319-8513-390575d6aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:26.121987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791aea2-eaaf-4319-8513-390575d6aaee admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:26.122280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791aea2-eaaf-4319-8513-390575d6aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:26.122563 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791aea2-eaaf-4319-8513-390575d6aaee admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:26.123315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791aea2-eaaf-4319-8513-390575d6aaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:26.124990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791aea2-eaaf-4319-8513-390575d6aaee admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:26.190450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 831/1667] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:26.194943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c46ee9-b496-4613-a243-b909febce903 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:26.205439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c46ee9-b496-4613-a243-b909febce903 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:26.230729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41881c69-6f4f-4d25-b08a-0bcf3bd019af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:26.234063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41881c69-6f4f-4d25-b08a-0bcf3bd019af admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:26.234572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41881c69-6f4f-4d25-b08a-0bcf3bd019af admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:26.235053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41881c69-6f4f-4d25-b08a-0bcf3bd019af admin admin] PATH_INFO: `/v3/projects/b2990149be8d4171b3426390edae6435/users/6ba6bc4553b2460d9e07f42726c1fa24/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:26.273637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41881c69-6f4f-4d25-b08a-0bcf3bd019af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2990149be8d4171b3426390edae6435, user_id=6ba6bc4553b2460d9e07f42726c1fa24, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:26.277321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41881c69-6f4f-4d25-b08a-0bcf3bd019af admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:26.308487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 837/1668] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:26 2022] PUT /identity/v3/projects/b2990149be8d4171b3426390edae6435/users/6ba6bc4553b2460d9e07f42726c1fa24/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:26.318658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef634d-136f-49a8-a10e-818500b4fdf8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:26.318992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef634d-136f-49a8-a10e-818500b4fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:26.319285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef634d-136f-49a8-a10e-818500b4fdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:26.378076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-49ef634d-136f-49a8-a10e-818500b4fdf8 None None] MFA Rules not processed for user `6ba6bc4553b2460d9e07f42726c1fa24`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:26.379883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-49ef634d-136f-49a8-a10e-818500b4fdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:26.462096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1d766-5682-4abb-8441-a53941025f95 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:26.462308 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1d766-5682-4abb-8441-a53941025f95 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:26.462823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1d766-5682-4abb-8441-a53941025f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:26.519738 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e8a1d766-5682-4abb-8441-a53941025f95 None None] MFA Rules not processed for user `7f78f3daa4744f41a914c0563982b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:26.522317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e8a1d766-5682-4abb-8441-a53941025f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:26.624660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 832/1669] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:26.629767 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef634d-136f-49a8-a10e-818500b4fdf8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:26.692906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 838/1670] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:23:26.706002 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e54e9-dd01-4da5-9613-83ea69b680de None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:26.706519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e54e9-dd01-4da5-9613-83ea69b680de None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:26.707484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e54e9-dd01-4da5-9613-83ea69b680de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:26.753233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e06e54e9-dd01-4da5-9613-83ea69b680de None None] MFA Rules not processed for user `7f78f3daa4744f41a914c0563982b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:26.754818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e06e54e9-dd01-4da5-9613-83ea69b680de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:26.762470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 839/1671] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:23:26.792094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e54e9-dd01-4da5-9613-83ea69b680de None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:26.793522 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e06e54e9-dd01-4da5-9613-83ea69b680de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:26.806355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef634d-136f-49a8-a10e-818500b4fdf8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:26.812614 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86750b5-0625-4e3f-a23e-bc040f85fe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:26.813319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86750b5-0625-4e3f-a23e-bc040f85fe26 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:26.813612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86750b5-0625-4e3f-a23e-bc040f85fe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:26.813895 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86750b5-0625-4e3f-a23e-bc040f85fe26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:26.814613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86750b5-0625-4e3f-a23e-bc040f85fe26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:26.816703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86750b5-0625-4e3f-a23e-bc040f85fe26 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:26.859862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 833/1672] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:26 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:26.861631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86750b5-0625-4e3f-a23e-bc040f85fe26 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:26.975242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e54e9-dd01-4da5-9613-83ea69b680de None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:27.003283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:27.006495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86750b5-0625-4e3f-a23e-bc040f85fe26 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:27.015471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f78f44-1a2b-468a-821d-e473d01deb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:27.016889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f78f44-1a2b-468a-821d-e473d01deb9f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:27.017178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f78f44-1a2b-468a-821d-e473d01deb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:27.017502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f78f44-1a2b-468a-821d-e473d01deb9f admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:27.018704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f78f44-1a2b-468a-821d-e473d01deb9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:27.021755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f78f44-1a2b-468a-821d-e473d01deb9f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:27.036403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:27.070162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 834/1673] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:26 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:27.075410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f78f44-1a2b-468a-821d-e473d01deb9f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:27.102755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f78f44-1a2b-468a-821d-e473d01deb9f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:27.108321 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c1e89-a1ed-4bdb-a068-3e88e5e56878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:27.109318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c1e89-a1ed-4bdb-a068-3e88e5e56878 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:27.109750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c1e89-a1ed-4bdb-a068-3e88e5e56878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:27.110431 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c1e89-a1ed-4bdb-a068-3e88e5e56878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:27.111323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c1e89-a1ed-4bdb-a068-3e88e5e56878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:27.113390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c1e89-a1ed-4bdb-a068-3e88e5e56878 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:27.127208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 835/1674] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:27.129081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557572a6-fd09-4a55-83c3-61084f47738b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:27.129783 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557572a6-fd09-4a55-83c3-61084f47738b service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:27.130072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557572a6-fd09-4a55-83c3-61084f47738b service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:27.130581 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557572a6-fd09-4a55-83c3-61084f47738b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:27.132357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c1e89-a1ed-4bdb-a068-3e88e5e56878 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:27.180654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c1e89-a1ed-4bdb-a068-3e88e5e56878 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:27.200324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e203db-7077-489b-a219-9045eabceb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:27.201446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e203db-7077-489b-a219-9045eabceb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:27.201814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e203db-7077-489b-a219-9045eabceb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:27.202166 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e203db-7077-489b-a219-9045eabceb7e admin admin] PATH_INFO: `/v3/projects/3a8b48bac7334698bac4ed83d8c03c6d/users/f1e1d9bb26fe47f284f091eebe5c3184/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:27.233632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e203db-7077-489b-a219-9045eabceb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8b48bac7334698bac4ed83d8c03c6d, user_id=f1e1d9bb26fe47f284f091eebe5c3184, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:27.239158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e203db-7077-489b-a219-9045eabceb7e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:27.261401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 836/1675] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:27 2022] PUT /identity/v3/projects/3a8b48bac7334698bac4ed83d8c03c6d/users/f1e1d9bb26fe47f284f091eebe5c3184/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:27.263480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8fcd-0044-4d3e-b04e-a6efcc15c694 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:27.264161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8fcd-0044-4d3e-b04e-a6efcc15c694 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:27.265109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8fcd-0044-4d3e-b04e-a6efcc15c694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:27.309940 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c9cd8fcd-0044-4d3e-b04e-a6efcc15c694 None None] MFA Rules not processed for user `05ab28ce7db949cb9f322aedc4d5163f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:27.312245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c9cd8fcd-0044-4d3e-b04e-a6efcc15c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:27.315012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557572a6-fd09-4a55-83c3-61084f47738b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:27.317209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557572a6-fd09-4a55-83c3-61084f47738b service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:27.353170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 840/1676] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:27.360255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557572a6-fd09-4a55-83c3-61084f47738b service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:27.399164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557572a6-fd09-4a55-83c3-61084f47738b service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:27.439435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 837/1677] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:27.445564 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd8fcd-0044-4d3e-b04e-a6efcc15c694 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:27.447478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c9cd8fcd-0044-4d3e-b04e-a6efcc15c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:27.563094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1da9a-1eb0-4068-aac7-a0e005297ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:27.563786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1da9a-1eb0-4068-aac7-a0e005297ede admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:27.564105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1da9a-1eb0-4068-aac7-a0e005297ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:27.564389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1da9a-1eb0-4068-aac7-a0e005297ede admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:27.565128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1da9a-1eb0-4068-aac7-a0e005297ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:27.568909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1da9a-1eb0-4068-aac7-a0e005297ede admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:27.569868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd8fcd-0044-4d3e-b04e-a6efcc15c694 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:27.577024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42ff3b-7791-450d-8eff-8c95b3403e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:27.578573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42ff3b-7791-450d-8eff-8c95b3403e9a service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:27.578988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42ff3b-7791-450d-8eff-8c95b3403e9a service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:27.579552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42ff3b-7791-450d-8eff-8c95b3403e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:27.608868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42ff3b-7791-450d-8eff-8c95b3403e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:27.609957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 841/1678] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:27.612851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42ff3b-7791-450d-8eff-8c95b3403e9a service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:27.614636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1da9a-1eb0-4068-aac7-a0e005297ede admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:27.641794 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 838/1679] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:27.652292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1da9a-1eb0-4068-aac7-a0e005297ede admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:27.680753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc049-b1b9-4ed1-9e25-4e6d27adad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:27.681675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc049-b1b9-4ed1-9e25-4e6d27adad66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:27.681964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc049-b1b9-4ed1-9e25-4e6d27adad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:27.682242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc049-b1b9-4ed1-9e25-4e6d27adad66 admin admin] PATH_INFO: `/v3/projects/3a8b48bac7334698bac4ed83d8c03c6d/users/f1e1d9bb26fe47f284f091eebe5c3184/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:27.695770 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddc049-b1b9-4ed1-9e25-4e6d27adad66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8b48bac7334698bac4ed83d8c03c6d, user_id=f1e1d9bb26fe47f284f091eebe5c3184, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:27.707275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddc049-b1b9-4ed1-9e25-4e6d27adad66 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:27.761155 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 842/1680] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:27 2022] PUT /identity/v3/projects/3a8b48bac7334698bac4ed83d8c03c6d/users/f1e1d9bb26fe47f284f091eebe5c3184/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:23:27.774030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2f5d-3dab-4a1c-b7b4-180ec9e385ba None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:27.774430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2f5d-3dab-4a1c-b7b4-180ec9e385ba None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:27.775027 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2f5d-3dab-4a1c-b7b4-180ec9e385ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:27.862113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-62fa2f5d-3dab-4a1c-b7b4-180ec9e385ba None None] MFA Rules not processed for user `f1e1d9bb26fe47f284f091eebe5c3184`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:27.864248 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-62fa2f5d-3dab-4a1c-b7b4-180ec9e385ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:27.925117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:28.112337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 839/1681] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:28.207236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc049-b1b9-4ed1-9e25-4e6d27adad66 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:28.210080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1cddc049-b1b9-4ed1-9e25-4e6d27adad66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:28.347001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:28.429757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc049-b1b9-4ed1-9e25-4e6d27adad66 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:28.439331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92309-5b9b-41ab-ab36-f223dd73389b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:28.440029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92309-5b9b-41ab-ab36-f223dd73389b service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:28.440348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92309-5b9b-41ab-ab36-f223dd73389b service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:28.440634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92309-5b9b-41ab-ab36-f223dd73389b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:28.469704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d92309-5b9b-41ab-ab36-f223dd73389b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:28.471567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d92309-5b9b-41ab-ab36-f223dd73389b service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:28.516369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 843/1682] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:28.773172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa2f5d-3dab-4a1c-b7b4-180ec9e385ba None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:28.788517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa2f5d-3dab-4a1c-b7b4-180ec9e385ba None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:28.817494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bde8c-867d-40e4-b1fb-c852467c8af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:28.849439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bde8c-867d-40e4-b1fb-c852467c8af0 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:28.849439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bde8c-867d-40e4-b1fb-c852467c8af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:28.849439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bde8c-867d-40e4-b1fb-c852467c8af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:28.854301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92309-5b9b-41ab-ab36-f223dd73389b service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:28.854301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-19d92309-5b9b-41ab-ab36-f223dd73389b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:28.978589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bde8c-867d-40e4-b1fb-c852467c8af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:28.980299 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bde8c-867d-40e4-b1fb-c852467c8af0 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:29.012669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 840/1683] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:29.017623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22800a6-e417-48ad-a03f-c509d196fbaf None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:29.017929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22800a6-e417-48ad-a03f-c509d196fbaf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:29.018217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22800a6-e417-48ad-a03f-c509d196fbaf None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:29.019869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 841/1684] 10.222.0.66 () {54 vars in 912 bytes} [Wed Jun 22 12:23:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:23:29.029329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336debd8-2376-4571-999f-5976e6228545 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:29.029627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336debd8-2376-4571-999f-5976e6228545 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:29.029906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336debd8-2376-4571-999f-5976e6228545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:29.084495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92309-5b9b-41ab-ab36-f223dd73389b service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:29.106191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:29.107693 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:29.107981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:29.108311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] PATH_INFO: `/v3/users/05fd0cfd50be476a9e227bbf578a288f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:29.113645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fd0cfd50be476a9e227bbf578a288f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:29.115959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:23:29.115959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 22 12:23:29.115959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: Jun 22 12:23:29.118137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:29.161753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-336debd8-2376-4571-999f-5976e6228545 None None] MFA Rules not processed for user `b37002ecc6384dc08fca3ddf6ca2f9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:29.163240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-336debd8-2376-4571-999f-5976e6228545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:29.296764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 842/1685] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:29.330816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fd0cfd50be476a9e227bbf578a288f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:29.374521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fd0cfd50be476a9e227bbf578a288f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:29.411610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336debd8-2376-4571-999f-5976e6228545 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:29.413974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-336debd8-2376-4571-999f-5976e6228545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:29.433378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fd0cfd50be476a9e227bbf578a288f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:29.436242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fd0cfd50be476a9e227bbf578a288f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:29.443689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336debd8-2376-4571-999f-5976e6228545 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:29.453474 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd51ef9-05e2-45a8-bcbd-4f2da352dfab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:29.454082 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd51ef9-05e2-45a8-bcbd-4f2da352dfab service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:29.454549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd51ef9-05e2-45a8-bcbd-4f2da352dfab service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:29.455000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd51ef9-05e2-45a8-bcbd-4f2da352dfab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:29.466834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0bd51ef9-05e2-45a8-bcbd-4f2da352dfab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:29.507341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd51ef9-05e2-45a8-bcbd-4f2da352dfab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:29.509597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd51ef9-05e2-45a8-bcbd-4f2da352dfab service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:29.523026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fd0cfd50be476a9e227bbf578a288f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:29.535509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 843/1686] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:29.556620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 844/1687] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:28 2022] DELETE /identity/v3/users/05fd0cfd50be476a9e227bbf578a288f => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:29.561258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acd382-9fd6-4482-86f4-fc6cb9f1b4be None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:29.561432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acd382-9fd6-4482-86f4-fc6cb9f1b4be None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:29.562415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acd382-9fd6-4482-86f4-fc6cb9f1b4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:29.602838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a4acd382-9fd6-4482-86f4-fc6cb9f1b4be None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:29.606291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a4acd382-9fd6-4482-86f4-fc6cb9f1b4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:29.740674 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:29.827523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 844/1688] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:30.002158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:30.003731 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:30.031721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608a28b-b8a9-457f-b8d2-8c1d12c4cbd5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:30.049848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751204f7-3b47-46a2-8285-e7f1bde8158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:30.051170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751204f7-3b47-46a2-8285-e7f1bde8158e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:30.051612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751204f7-3b47-46a2-8285-e7f1bde8158e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:30.052082 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751204f7-3b47-46a2-8285-e7f1bde8158e admin admin] PATH_INFO: `/v3/users/364ae8e304774d3bb2fc8e571fd19bc8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:30.056079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751204f7-3b47-46a2-8285-e7f1bde8158e admin admin] RBAC: Authorizing `identity:delete_user(user_id=364ae8e304774d3bb2fc8e571fd19bc8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:30.059842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751204f7-3b47-46a2-8285-e7f1bde8158e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:30.207930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-751204f7-3b47-46a2-8285-e7f1bde8158e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364ae8e304774d3bb2fc8e571fd19bc8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:30.219061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:30.277030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-751204f7-3b47-46a2-8285-e7f1bde8158e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364ae8e304774d3bb2fc8e571fd19bc8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:30.294375 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acd382-9fd6-4482-86f4-fc6cb9f1b4be None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:30.299148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a4acd382-9fd6-4482-86f4-fc6cb9f1b4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:30.299393 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-751204f7-3b47-46a2-8285-e7f1bde8158e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364ae8e304774d3bb2fc8e571fd19bc8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:30.300801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-751204f7-3b47-46a2-8285-e7f1bde8158e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364ae8e304774d3bb2fc8e571fd19bc8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:30.317300 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-751204f7-3b47-46a2-8285-e7f1bde8158e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364ae8e304774d3bb2fc8e571fd19bc8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:30.337518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 845/1689] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:30 2022] DELETE /identity/v3/users/364ae8e304774d3bb2fc8e571fd19bc8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:30.342275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf0ed2-d512-4b2d-92a0-d238aad1c5c9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:30.349979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf0ed2-d512-4b2d-92a0-d238aad1c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:30.350272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf0ed2-d512-4b2d-92a0-d238aad1c5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:30.416763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-81bf0ed2-d512-4b2d-92a0-d238aad1c5c9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:30.419943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-81bf0ed2-d512-4b2d-92a0-d238aad1c5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:30.472095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acd382-9fd6-4482-86f4-fc6cb9f1b4be None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:30.610845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 846/1690] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:30.627035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e86870-95a5-485f-91cc-31d009c29b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:30.627812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e86870-95a5-485f-91cc-31d009c29b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:30.628201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e86870-95a5-485f-91cc-31d009c29b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:30.628542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e86870-95a5-485f-91cc-31d009c29b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:30.636257 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-68e86870-95a5-485f-91cc-31d009c29b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:30.636455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf0ed2-d512-4b2d-92a0-d238aad1c5c9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:30.637902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-81bf0ed2-d512-4b2d-92a0-d238aad1c5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:30.658642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf0ed2-d512-4b2d-92a0-d238aad1c5c9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:30.663468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e86870-95a5-485f-91cc-31d009c29b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:30.665006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e86870-95a5-485f-91cc-31d009c29b47 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:30.681096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716a35d-656e-45ea-abb0-f200ebb241f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:30.681784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a35d-656e-45ea-abb0-f200ebb241f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:30.682073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a35d-656e-45ea-abb0-f200ebb241f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:30.682355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a35d-656e-45ea-abb0-f200ebb241f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:30.697823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 845/1691] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:23:30.724956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716a35d-656e-45ea-abb0-f200ebb241f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:30.726751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716a35d-656e-45ea-abb0-f200ebb241f5 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:30.770046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 847/1692] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:23:31.333514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf351cc-df18-458e-8f57-4e4e11f8f7ed None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:31.334445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf351cc-df18-458e-8f57-4e4e11f8f7ed None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:31.334881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf351cc-df18-458e-8f57-4e4e11f8f7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:31.380599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc7c5-28ef-4b1d-a375-237477e4e2d3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:31.381610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc7c5-28ef-4b1d-a375-237477e4e2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:31.382043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc7c5-28ef-4b1d-a375-237477e4e2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:31.414126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ecf351cc-df18-458e-8f57-4e4e11f8f7ed None None] MFA Rules not processed for user `76011af8b8b94434bb461d81cff5ae8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:31.416433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ecf351cc-df18-458e-8f57-4e4e11f8f7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:31.457302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3c5cc7c5-28ef-4b1d-a375-237477e4e2d3 None None] MFA Rules not processed for user `45beec4d30384eb49bba3ba9a5f2c7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:31.462495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3c5cc7c5-28ef-4b1d-a375-237477e4e2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:31.682974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 846/1693] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:31.808638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5a75-9f5a-462e-8cf5-b42966109d3d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:31.809035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5a75-9f5a-462e-8cf5-b42966109d3d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:31.809379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5a75-9f5a-462e-8cf5-b42966109d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:31.810767 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 848/1694] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:31.852439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cc7c5-28ef-4b1d-a375-237477e4e2d3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:31.854039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3c5cc7c5-28ef-4b1d-a375-237477e4e2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:31.887931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8deb5a75-9f5a-462e-8cf5-b42966109d3d None None] MFA Rules not processed for user `45beec4d30384eb49bba3ba9a5f2c7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:31.906824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8deb5a75-9f5a-462e-8cf5-b42966109d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:31.925996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cc7c5-28ef-4b1d-a375-237477e4e2d3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:31.939457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 847/1695] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:31.942043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212c54b-ca1f-4ac9-9a1e-33484212a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:31.942955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212c54b-ca1f-4ac9-9a1e-33484212a298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:31.943243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212c54b-ca1f-4ac9-9a1e-33484212a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:31.943519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212c54b-ca1f-4ac9-9a1e-33484212a298 admin admin] PATH_INFO: `/v3/users/f693b676054c4a0f911c53c7550665b7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:31.950277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb5a75-9f5a-462e-8cf5-b42966109d3d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:31.952230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212c54b-ca1f-4ac9-9a1e-33484212a298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f693b676054c4a0f911c53c7550665b7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:31.957177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8deb5a75-9f5a-462e-8cf5-b42966109d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:31.959710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212c54b-ca1f-4ac9-9a1e-33484212a298 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:32.004513 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb5a75-9f5a-462e-8cf5-b42966109d3d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:32.009793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:32.010684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:32.010963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:32.011239 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] PATH_INFO: `/v3/projects/a7f6403248e24e4fbceffa15c06bc63b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:32.012631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f6403248e24e4fbceffa15c06bc63b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:32.013673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: WARNING py.warnings [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 12:23:32.013673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: warnings.warn(msg) Jun 22 12:23:32.013673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: Jun 22 12:23:32.014870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:32.108666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:32.130154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:32.138256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1212c54b-ca1f-4ac9-9a1e-33484212a298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f693b676054c4a0f911c53c7550665b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.181288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1212c54b-ca1f-4ac9-9a1e-33484212a298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f693b676054c4a0f911c53c7550665b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.190044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f6403248e24e4fbceffa15c06bc63b', 'request_id': 'req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.196623 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1212c54b-ca1f-4ac9-9a1e-33484212a298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f693b676054c4a0f911c53c7550665b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.197294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1212c54b-ca1f-4ac9-9a1e-33484212a298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f693b676054c4a0f911c53c7550665b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.217385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f6403248e24e4fbceffa15c06bc63b', 'request_id': 'req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.220527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1212c54b-ca1f-4ac9-9a1e-33484212a298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f693b676054c4a0f911c53c7550665b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.232579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f6403248e24e4fbceffa15c06bc63b', 'request_id': 'req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.236471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 849/1696] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:31 2022] DELETE /identity/v3/users/f693b676054c4a0f911c53c7550665b7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:32.238263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2195-abbf-43e9-8637-5fb24a817a76 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:32.238560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2195-abbf-43e9-8637-5fb24a817a76 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:32.238934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2195-abbf-43e9-8637-5fb24a817a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:32.270403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] The token cache is being invalidate because project a7f6403248e24e4fbceffa15c06bc63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:32.270403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.271849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d488eaa-0dcd-4a4f-bbd7-4b4313751d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.277432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 848/1697] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:31 2022] DELETE /identity/v3/projects/a7f6403248e24e4fbceffa15c06bc63b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:32.283023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7cb82-cebf-4245-a0de-e5283c9ea143 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:32.283226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7cb82-cebf-4245-a0de-e5283c9ea143 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:32.283504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7cb82-cebf-4245-a0de-e5283c9ea143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:32.305805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fc4c2195-abbf-43e9-8637-5fb24a817a76 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:32.307077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fc4c2195-abbf-43e9-8637-5fb24a817a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:32.339109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a8c7cb82-cebf-4245-a0de-e5283c9ea143 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:32.344305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a8c7cb82-cebf-4245-a0de-e5283c9ea143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:32.517812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 850/1698] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:32.518908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2195-abbf-43e9-8637-5fb24a817a76 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:32.528980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fc4c2195-abbf-43e9-8637-5fb24a817a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:32.554811 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2195-abbf-43e9-8637-5fb24a817a76 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:32.564502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee924b46-3a22-4059-abf5-16d22312cba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:32.565607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924b46-3a22-4059-abf5-16d22312cba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:32.566576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924b46-3a22-4059-abf5-16d22312cba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:32.567006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924b46-3a22-4059-abf5-16d22312cba1 admin admin] PATH_INFO: `/v3/users/6ba6bc4553b2460d9e07f42726c1fa24` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:32.573753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee924b46-3a22-4059-abf5-16d22312cba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba6bc4553b2460d9e07f42726c1fa24)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:32.575961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee924b46-3a22-4059-abf5-16d22312cba1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:32.595427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 849/1699] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:32.597166 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7cb82-cebf-4245-a0de-e5283c9ea143 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:32.599044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a8c7cb82-cebf-4245-a0de-e5283c9ea143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:32.688867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee924b46-3a22-4059-abf5-16d22312cba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba6bc4553b2460d9e07f42726c1fa24'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.727144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee924b46-3a22-4059-abf5-16d22312cba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba6bc4553b2460d9e07f42726c1fa24'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.740417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee924b46-3a22-4059-abf5-16d22312cba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba6bc4553b2460d9e07f42726c1fa24'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.741130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee924b46-3a22-4059-abf5-16d22312cba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba6bc4553b2460d9e07f42726c1fa24'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.747472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7cb82-cebf-4245-a0de-e5283c9ea143 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:32.752734 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee924b46-3a22-4059-abf5-16d22312cba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba6bc4553b2460d9e07f42726c1fa24'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:32.760682 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d41afa-7033-4a9a-ac68-0c40a5e892ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:32.761328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 851/1700] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:32 2022] DELETE /identity/v3/users/6ba6bc4553b2460d9e07f42726c1fa24 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:32.761457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d41afa-7033-4a9a-ac68-0c40a5e892ce service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:32.761627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d41afa-7033-4a9a-ac68-0c40a5e892ce service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:32.761913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d41afa-7033-4a9a-ac68-0c40a5e892ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:32.763540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4534f7-fd6b-4a17-8001-ce85ad667dcc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:32.764088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4534f7-fd6b-4a17-8001-ce85ad667dcc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:32.764902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4534f7-fd6b-4a17-8001-ce85ad667dcc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:32.767186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 852/1701] 10.222.0.66 () {54 vars in 960 bytes} [Wed Jun 22 12:23:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:23:32.768585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b3d41afa-7033-4a9a-ac68-0c40a5e892ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:32.768723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4534f7-fd6b-4a17-8001-ce85ad667dcc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:32.771128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2a4534f7-fd6b-4a17-8001-ce85ad667dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:32.856210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:32.882529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:32.886529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d41afa-7033-4a9a-ac68-0c40a5e892ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:32.889713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d41afa-7033-4a9a-ac68-0c40a5e892ce service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:32.919368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4534f7-fd6b-4a17-8001-ce85ad667dcc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:32.927057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 850/1702] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:32.935078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d39d41-e5ac-4464-8003-4cc29e6b0e05 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:32.935539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d39d41-e5ac-4464-8003-4cc29e6b0e05 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:32.936711 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d39d41-e5ac-4464-8003-4cc29e6b0e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:32.943757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087d121-c7ee-422e-aaa5-5d81dbe09ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:32.945578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d121-c7ee-422e-aaa5-5d81dbe09ffa service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:32.947714 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d121-c7ee-422e-aaa5-5d81dbe09ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:32.948529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087d121-c7ee-422e-aaa5-5d81dbe09ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:32.957675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6087d121-c7ee-422e-aaa5-5d81dbe09ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:32.992791 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d2d39d41-e5ac-4464-8003-4cc29e6b0e05 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:32.995683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d2d39d41-e5ac-4464-8003-4cc29e6b0e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:33.121539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087d121-c7ee-422e-aaa5-5d81dbe09ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:33.124384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087d121-c7ee-422e-aaa5-5d81dbe09ffa service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:33.173742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 853/1703] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:33.176862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec295-9305-4f8a-be54-24651adac292 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:33.177472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec295-9305-4f8a-be54-24651adac292 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:33.178115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec295-9305-4f8a-be54-24651adac292 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:33.181836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 854/1704] 10.222.0.66 () {54 vars in 912 bytes} [Wed Jun 22 12:23:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:23:33.184596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4c65a-9994-4421-99d3-9d7c2de51184 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:33.185554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4c65a-9994-4421-99d3-9d7c2de51184 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:33.186139 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4c65a-9994-4421-99d3-9d7c2de51184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:33.245354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 851/1705] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:33.246910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af8a6-32bb-4dea-a587-0201c448e6dc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:33.247384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af8a6-32bb-4dea-a587-0201c448e6dc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:33.247841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af8a6-32bb-4dea-a587-0201c448e6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:33.283148 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-84f4c65a-9994-4421-99d3-9d7c2de51184 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:33.285945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-84f4c65a-9994-4421-99d3-9d7c2de51184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:33.303023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d80af8a6-32bb-4dea-a587-0201c448e6dc None None] MFA Rules not processed for user `c89ae81d49214b75a747a6cfa3ddf0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:33.304667 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d80af8a6-32bb-4dea-a587-0201c448e6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:33.306816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 855/1706] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:33.309919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4c65a-9994-4421-99d3-9d7c2de51184 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:33.312190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-84f4c65a-9994-4421-99d3-9d7c2de51184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:33.337164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4c65a-9994-4421-99d3-9d7c2de51184 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:33.345374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:33.346871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:33.348215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:33.348760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] PATH_INFO: `/v3/projects/9f29a58b07fd46de962c127876f15611` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:33.350902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f29a58b07fd46de962c127876f15611)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:33.354569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:33.490974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 852/1707] 10.222.0.66 () {58 vars in 1057 bytes} [Wed Jun 22 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:33.500529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edf66a-5e9b-490e-9840-d4e7b0dd277a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:33.500852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edf66a-5e9b-490e-9840-d4e7b0dd277a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:33.501896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edf66a-5e9b-490e-9840-d4e7b0dd277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:33.542635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f29a58b07fd46de962c127876f15611', 'request_id': 'req-a1a62eaf-86d5-42d4-a86c-e86cc64af444'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:33.549846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e4edf66a-5e9b-490e-9840-d4e7b0dd277a None None] MFA Rules not processed for user `05ab28ce7db949cb9f322aedc4d5163f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:33.554000 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f29a58b07fd46de962c127876f15611', 'request_id': 'req-a1a62eaf-86d5-42d4-a86c-e86cc64af444'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:33.554895 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e4edf66a-5e9b-490e-9840-d4e7b0dd277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:33.561776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f29a58b07fd46de962c127876f15611', 'request_id': 'req-a1a62eaf-86d5-42d4-a86c-e86cc64af444'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:33.610341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] The token cache is being invalidate because project 9f29a58b07fd46de962c127876f15611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:33.610661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:33.611931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a1a62eaf-86d5-42d4-a86c-e86cc64af444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:33.617798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 856/1708] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:33 2022] DELETE /identity/v3/projects/9f29a58b07fd46de962c127876f15611 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:33.619259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f38b9c-aa8f-404d-8736-26756a103433 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:33.620863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f38b9c-aa8f-404d-8736-26756a103433 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:33.621230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f38b9c-aa8f-404d-8736-26756a103433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:33.663245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 853/1709] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:33.669873 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edf66a-5e9b-490e-9840-d4e7b0dd277a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:33.671299 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e4edf66a-5e9b-490e-9840-d4e7b0dd277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:33.692125 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-45f38b9c-aa8f-404d-8736-26756a103433 None None] MFA Rules not processed for user `b37002ecc6384dc08fca3ddf6ca2f9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:33.694213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-45f38b9c-aa8f-404d-8736-26756a103433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:33.753620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:33.792424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 857/1710] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:33.793429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f38b9c-aa8f-404d-8736-26756a103433 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:33.795019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-45f38b9c-aa8f-404d-8736-26756a103433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:33.801397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edf66a-5e9b-490e-9840-d4e7b0dd277a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:33.809997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f38b9c-aa8f-404d-8736-26756a103433 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:33.811300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1891d-74e5-469d-8416-a30f3f70e051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:33.811916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1891d-74e5-469d-8416-a30f3f70e051 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:33.812233 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1891d-74e5-469d-8416-a30f3f70e051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:33.812509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1891d-74e5-469d-8416-a30f3f70e051 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:33.813273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1891d-74e5-469d-8416-a30f3f70e051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:33.813567 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1891d-74e5-469d-8416-a30f3f70e051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:33.815274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1891d-74e5-469d-8416-a30f3f70e051 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:33.819277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04593aaa-b4da-4c93-963a-c0055c7a3f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:33.820050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593aaa-b4da-4c93-963a-c0055c7a3f46 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:33.820553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593aaa-b4da-4c93-963a-c0055c7a3f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:33.820904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04593aaa-b4da-4c93-963a-c0055c7a3f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:33.823190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-04593aaa-b4da-4c93-963a-c0055c7a3f46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:33.836068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 854/1711] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:33.837050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1891d-74e5-469d-8416-a30f3f70e051 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:33.838876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:33.843164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d1d1891d-74e5-469d-8416-a30f3f70e051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:33.853215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04593aaa-b4da-4c93-963a-c0055c7a3f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:33.858982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04593aaa-b4da-4c93-963a-c0055c7a3f46 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:33.880781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 858/1712] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:33.896814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04593aaa-b4da-4c93-963a-c0055c7a3f46 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:33.901064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-04593aaa-b4da-4c93-963a-c0055c7a3f46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:33.932126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04593aaa-b4da-4c93-963a-c0055c7a3f46 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:33.942853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:33.944978 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:33.945278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:33.945691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] PATH_INFO: `/v3/users/0442e24418e04500a3681d05f63bdff7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:33.947942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0442e24418e04500a3681d05f63bdff7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:33.951752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:33.997149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1891d-74e5-469d-8416-a30f3f70e051 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:34.009854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35573de-8703-46e8-81a1-d8b47f299485 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:34.011187 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35573de-8703-46e8-81a1-d8b47f299485 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:34.012420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35573de-8703-46e8-81a1-d8b47f299485 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:34.014295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35573de-8703-46e8-81a1-d8b47f299485 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:34.020133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d35573de-8703-46e8-81a1-d8b47f299485 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:34.049547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35573de-8703-46e8-81a1-d8b47f299485 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:34.053495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35573de-8703-46e8-81a1-d8b47f299485 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:34.077263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0442e24418e04500a3681d05f63bdff7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:34.080698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 855/1713] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:34.082096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35573de-8703-46e8-81a1-d8b47f299485 service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:34.108184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35573de-8703-46e8-81a1-d8b47f299485 service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:34.117068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfaece-a694-4c65-a700-9a34cb6f4a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:34.117864 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfaece-a694-4c65-a700-9a34cb6f4a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:34.118084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfaece-a694-4c65-a700-9a34cb6f4a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:34.118289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfaece-a694-4c65-a700-9a34cb6f4a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:34.119098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfaece-a694-4c65-a700-9a34cb6f4a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:34.120912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfaece-a694-4c65-a700-9a34cb6f4a3d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:34.124676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0442e24418e04500a3681d05f63bdff7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:34.154641 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0442e24418e04500a3681d05f63bdff7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:34.156378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0442e24418e04500a3681d05f63bdff7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:34.181395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0442e24418e04500a3681d05f63bdff7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:34.205847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 856/1714] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:34 2022] POST /identity/v3/projects => generated 405 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:34.205847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfaece-a694-4c65-a700-9a34cb6f4a3d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:34.209370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4abfaece-a694-4c65-a700-9a34cb6f4a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:34.215915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 859/1715] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:33 2022] DELETE /identity/v3/users/0442e24418e04500a3681d05f63bdff7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:34.218965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:34.221913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:34.364673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfaece-a694-4c65-a700-9a34cb6f4a3d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:34.455883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61956ba-d8a9-443a-80e8-82ecd027ced1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:34.461278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2c3cc-5734-4673-91b5-f98813d64012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:34.462063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c3cc-5734-4673-91b5-f98813d64012 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:34.463219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c3cc-5734-4673-91b5-f98813d64012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:34.463583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c3cc-5734-4673-91b5-f98813d64012 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:34.464456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2c3cc-5734-4673-91b5-f98813d64012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:34.466877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2c3cc-5734-4673-91b5-f98813d64012 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:34.486366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7e80-709e-4f48-b485-b49d9f269c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:34.487052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7e80-709e-4f48-b485-b49d9f269c9a service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:34.487412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7e80-709e-4f48-b485-b49d9f269c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:34.488240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7e80-709e-4f48-b485-b49d9f269c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:34.494703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5dbd7e80-709e-4f48-b485-b49d9f269c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:34.524581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd7e80-709e-4f48-b485-b49d9f269c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:34.525922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 860/1716] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:34 2022] POST /identity/v3/users => generated 303 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:34.526345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd7e80-709e-4f48-b485-b49d9f269c9a service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:34.530595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2c3cc-5734-4673-91b5-f98813d64012 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:34.539427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 857/1717] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:34.543912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:34.568960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2c3cc-5734-4673-91b5-f98813d64012 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:34.584158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1da68-9e30-450f-ac23-febdb86aa1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:34.585029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1da68-9e30-450f-ac23-febdb86aa1de admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:34.585311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1da68-9e30-450f-ac23-febdb86aa1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:34.585596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1da68-9e30-450f-ac23-febdb86aa1de admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:34.586406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1da68-9e30-450f-ac23-febdb86aa1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:34.590159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1da68-9e30-450f-ac23-febdb86aa1de admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:34.632870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 861/1718] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:34.634258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7e80-709e-4f48-b485-b49d9f269c9a service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:34.664384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7e80-709e-4f48-b485-b49d9f269c9a service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:34.697941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f12b9-9005-48d6-87f0-1dfa53c1e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:34.698708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f12b9-9005-48d6-87f0-1dfa53c1e83d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:34.698962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f12b9-9005-48d6-87f0-1dfa53c1e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:34.699245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f12b9-9005-48d6-87f0-1dfa53c1e83d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:34.707682 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f12b9-9005-48d6-87f0-1dfa53c1e83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:34.709968 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f12b9-9005-48d6-87f0-1dfa53c1e83d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:34.756915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1da68-9e30-450f-ac23-febdb86aa1de admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:34.759501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1bd1da68-9e30-450f-ac23-febdb86aa1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:34.770630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 858/1719] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:34.774068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f12b9-9005-48d6-87f0-1dfa53c1e83d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:34.790661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1da68-9e30-450f-ac23-febdb86aa1de admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:34.814740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:34.816437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:34.817227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:34.817726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] PATH_INFO: `/v3/projects/453014e0b03f44d6bf1fcf5a71920f5a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:34.827612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=453014e0b03f44d6bf1fcf5a71920f5a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:34.832418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:34.860829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f12b9-9005-48d6-87f0-1dfa53c1e83d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:34.889003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d722e7-678c-4ead-84ce-38047120eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:34.889923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d722e7-678c-4ead-84ce-38047120eafc admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:34.890205 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d722e7-678c-4ead-84ce-38047120eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:34.890485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d722e7-678c-4ead-84ce-38047120eafc admin admin] PATH_INFO: `/v3/projects/5a3047dd19b0419892fe0579549c6d92/users/54456ce5f68d46b3bba5554e21bf36c4/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:34.940589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d722e7-678c-4ead-84ce-38047120eafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3047dd19b0419892fe0579549c6d92, user_id=54456ce5f68d46b3bba5554e21bf36c4, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:34.952157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d722e7-678c-4ead-84ce-38047120eafc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:34.963381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:34.980683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453014e0b03f44d6bf1fcf5a71920f5a', 'request_id': 'req-4e236f32-f4a4-4771-a201-668a1c110ab1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:34.982005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 859/1720] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:34 2022] PUT /identity/v3/projects/5a3047dd19b0419892fe0579549c6d92/users/54456ce5f68d46b3bba5554e21bf36c4/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:34.987232 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aee67-4f7e-4029-b399-58e258879a88 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:34.988420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aee67-4f7e-4029-b399-58e258879a88 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:34.988726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aee67-4f7e-4029-b399-58e258879a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:35.003213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453014e0b03f44d6bf1fcf5a71920f5a', 'request_id': 'req-4e236f32-f4a4-4771-a201-668a1c110ab1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.019754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453014e0b03f44d6bf1fcf5a71920f5a', 'request_id': 'req-4e236f32-f4a4-4771-a201-668a1c110ab1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.023127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-339aee67-4f7e-4029-b399-58e258879a88 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:35.024418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-339aee67-4f7e-4029-b399-58e258879a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:35.045879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] The token cache is being invalidate because project 453014e0b03f44d6bf1fcf5a71920f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:35.046172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.046855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.051830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 862/1721] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:34 2022] DELETE /identity/v3/projects/453014e0b03f44d6bf1fcf5a71920f5a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:35.056805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:35.061485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:35.181223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 860/1722] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:35.182406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aee67-4f7e-4029-b399-58e258879a88 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:35.187011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-339aee67-4f7e-4029-b399-58e258879a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:35.215111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aee67-4f7e-4029-b399-58e258879a88 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:35.232330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:35.233368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:35.233659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:35.233965 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] PATH_INFO: `/v3/projects/b2990149be8d4171b3426390edae6435` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:35.239133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2990149be8d4171b3426390edae6435)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:35.241124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:35.291360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e236f32-f4a4-4771-a201-668a1c110ab1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:35.305086 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6a51d-663f-451c-9df4-8a7ce36cfeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:35.306148 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6a51d-663f-451c-9df4-8a7ce36cfeb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:35.306447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6a51d-663f-451c-9df4-8a7ce36cfeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:35.306729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6a51d-663f-451c-9df4-8a7ce36cfeb8 admin admin] PATH_INFO: `/v3/users/3c3ec9ad702f4e94a4a00fa25020ffae` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:35.312257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6a51d-663f-451c-9df4-8a7ce36cfeb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3ec9ad702f4e94a4a00fa25020ffae)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:35.319291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6a51d-663f-451c-9df4-8a7ce36cfeb8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:35.360713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2990149be8d4171b3426390edae6435', 'request_id': 'req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.380772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2990149be8d4171b3426390edae6435', 'request_id': 'req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.391589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2990149be8d4171b3426390edae6435', 'request_id': 'req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.417544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] The token cache is being invalidate because project b2990149be8d4171b3426390edae6435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:35.417831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.419481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.422066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 861/1723] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:35 2022] DELETE /identity/v3/projects/b2990149be8d4171b3426390edae6435 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:35.423065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:35.428092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:35.448698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c6f6a51d-663f-451c-9df4-8a7ce36cfeb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3ec9ad702f4e94a4a00fa25020ffae'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.477039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c6f6a51d-663f-451c-9df4-8a7ce36cfeb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3ec9ad702f4e94a4a00fa25020ffae'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.495455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c6f6a51d-663f-451c-9df4-8a7ce36cfeb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3ec9ad702f4e94a4a00fa25020ffae'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.496631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c6f6a51d-663f-451c-9df4-8a7ce36cfeb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3ec9ad702f4e94a4a00fa25020ffae'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.517090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c6f6a51d-663f-451c-9df4-8a7ce36cfeb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3ec9ad702f4e94a4a00fa25020ffae'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:35.532771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 863/1724] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:35 2022] DELETE /identity/v3/users/3c3ec9ad702f4e94a4a00fa25020ffae => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:35.536981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719b8bc-5fdc-4516-8981-33e23591e172 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:35.537281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719b8bc-5fdc-4516-8981-33e23591e172 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:35.537568 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719b8bc-5fdc-4516-8981-33e23591e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:35.583708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a719b8bc-5fdc-4516-8981-33e23591e172 None None] MFA Rules not processed for user `7f78f3daa4744f41a914c0563982b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:35.589728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a719b8bc-5fdc-4516-8981-33e23591e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:35.632211 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:35.646632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9c89b-fb4a-44f2-b62f-dccb72f37d58 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:35.719193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:35.761892 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 864/1725] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:35.767502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719b8bc-5fdc-4516-8981-33e23591e172 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:35.774875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a719b8bc-5fdc-4516-8981-33e23591e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:35.797536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd82dd0-39ec-4b08-ac1e-b160b45f9710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:35.798392 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd82dd0-39ec-4b08-ac1e-b160b45f9710 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:35.798825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd82dd0-39ec-4b08-ac1e-b160b45f9710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:35.799822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd82dd0-39ec-4b08-ac1e-b160b45f9710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:35.805119 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dfd82dd0-39ec-4b08-ac1e-b160b45f9710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:35.998986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719b8bc-5fdc-4516-8981-33e23591e172 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:36.033756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd82dd0-39ec-4b08-ac1e-b160b45f9710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:36.038709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bf8d3-f0b8-4c78-94fb-8a9ec5f998c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:36.039669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bf8d3-f0b8-4c78-94fb-8a9ec5f998c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:36.039960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bf8d3-f0b8-4c78-94fb-8a9ec5f998c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:36.040283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bf8d3-f0b8-4c78-94fb-8a9ec5f998c1 admin admin] PATH_INFO: `/v3/users/f1e1d9bb26fe47f284f091eebe5c3184` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:36.040712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd82dd0-39ec-4b08-ac1e-b160b45f9710 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:36.051505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bf8d3-f0b8-4c78-94fb-8a9ec5f998c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e1d9bb26fe47f284f091eebe5c3184)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:36.062441 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bf8d3-f0b8-4c78-94fb-8a9ec5f998c1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:36.087888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 862/1726] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:36.089913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd82dd0-39ec-4b08-ac1e-b160b45f9710 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:36.092672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dfd82dd0-39ec-4b08-ac1e-b160b45f9710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:36.124399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd82dd0-39ec-4b08-ac1e-b160b45f9710 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:36.145996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:36.146995 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:36.147257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-402bf8d3-f0b8-4c78-94fb-8a9ec5f998c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e1d9bb26fe47f284f091eebe5c3184'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:36.147559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:36.148195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] PATH_INFO: `/v3/projects/3d383fc5bea34fd598b33a8a811b04ce` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:36.151005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d383fc5bea34fd598b33a8a811b04ce)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:36.155258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:36.167583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-402bf8d3-f0b8-4c78-94fb-8a9ec5f998c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e1d9bb26fe47f284f091eebe5c3184'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:36.180186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-402bf8d3-f0b8-4c78-94fb-8a9ec5f998c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e1d9bb26fe47f284f091eebe5c3184'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:36.181564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-402bf8d3-f0b8-4c78-94fb-8a9ec5f998c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e1d9bb26fe47f284f091eebe5c3184'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:36.195002 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-402bf8d3-f0b8-4c78-94fb-8a9ec5f998c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e1d9bb26fe47f284f091eebe5c3184'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:36.203644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 865/1727] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:35 2022] DELETE /identity/v3/users/f1e1d9bb26fe47f284f091eebe5c3184 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:36.357929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d383fc5bea34fd598b33a8a811b04ce', 'request_id': 'req-4eae21be-5ac7-44e7-ab34-9e13dada7016'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:36.382789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d383fc5bea34fd598b33a8a811b04ce', 'request_id': 'req-4eae21be-5ac7-44e7-ab34-9e13dada7016'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:36.411274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d383fc5bea34fd598b33a8a811b04ce', 'request_id': 'req-4eae21be-5ac7-44e7-ab34-9e13dada7016'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:36.457517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] The token cache is being invalidate because project 3d383fc5bea34fd598b33a8a811b04ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:36.457517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:36.459033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4eae21be-5ac7-44e7-ab34-9e13dada7016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:36.461963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 863/1728] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:36 2022] DELETE /identity/v3/projects/3d383fc5bea34fd598b33a8a811b04ce => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:36.469004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59e725-6bca-4e56-aae2-c4ad3d1f31ea None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:36.471126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59e725-6bca-4e56-aae2-c4ad3d1f31ea None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:36.471428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59e725-6bca-4e56-aae2-c4ad3d1f31ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:36.538169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5d59e725-6bca-4e56-aae2-c4ad3d1f31ea None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:36.543642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5d59e725-6bca-4e56-aae2-c4ad3d1f31ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:36.719004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 866/1729] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:36.727032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486cb82-f785-44fa-afa0-f6e6dc49d0d3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:36.727551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486cb82-f785-44fa-afa0-f6e6dc49d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:36.727732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486cb82-f785-44fa-afa0-f6e6dc49d0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:36.782078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59e725-6bca-4e56-aae2-c4ad3d1f31ea None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:36.783447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5d59e725-6bca-4e56-aae2-c4ad3d1f31ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:36.786711 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8486cb82-f785-44fa-afa0-f6e6dc49d0d3 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:36.789372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8486cb82-f785-44fa-afa0-f6e6dc49d0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:36.809452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59e725-6bca-4e56-aae2-c4ad3d1f31ea None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:36.811696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 864/1730] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:36.813036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486cb82-f785-44fa-afa0-f6e6dc49d0d3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:36.824062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486cb82-f785-44fa-afa0-f6e6dc49d0d3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:36.827579 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:36.832209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:36.834967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:36.835284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] PATH_INFO: `/v3/projects/169417e964c14cf28a9381a23d56017e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:36.835885 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56706064-0fb4-4e66-8604-e9a7546b6151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:36.836991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56706064-0fb4-4e66-8604-e9a7546b6151 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:36.837305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56706064-0fb4-4e66-8604-e9a7546b6151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:36.837768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56706064-0fb4-4e66-8604-e9a7546b6151 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:36.838658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56706064-0fb4-4e66-8604-e9a7546b6151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:36.839153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56706064-0fb4-4e66-8604-e9a7546b6151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:36.841181 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=169417e964c14cf28a9381a23d56017e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:36.844736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56706064-0fb4-4e66-8604-e9a7546b6151 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:36.846838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:36.884515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:36.969445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 865/1731] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:36.971805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56706064-0fb4-4e66-8604-e9a7546b6151 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:36.999810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56706064-0fb4-4e66-8604-e9a7546b6151 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:37.021702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:37.021973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169417e964c14cf28a9381a23d56017e', 'request_id': 'req-cfdda011-d152-44e0-86c0-56401a2b8a8c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:37.036859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169417e964c14cf28a9381a23d56017e', 'request_id': 'req-cfdda011-d152-44e0-86c0-56401a2b8a8c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:37.047114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169417e964c14cf28a9381a23d56017e', 'request_id': 'req-cfdda011-d152-44e0-86c0-56401a2b8a8c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:37.069768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] The token cache is being invalidate because project 169417e964c14cf28a9381a23d56017e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:37.070042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:37.071909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cfdda011-d152-44e0-86c0-56401a2b8a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:37.075065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 867/1732] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:36 2022] DELETE /identity/v3/projects/169417e964c14cf28a9381a23d56017e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:37.079026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970d4a-2543-4b19-a83d-cd65567b62f7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.082380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970d4a-2543-4b19-a83d-cd65567b62f7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.082380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970d4a-2543-4b19-a83d-cd65567b62f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.126291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3f970d4a-2543-4b19-a83d-cd65567b62f7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:37.127691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3f970d4a-2543-4b19-a83d-cd65567b62f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:37.161468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b16b65-b2c6-4b1b-ad15-378331034512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:37.162196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16b65-b2c6-4b1b-ad15-378331034512 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.163444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16b65-b2c6-4b1b-ad15-378331034512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.164425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16b65-b2c6-4b1b-ad15-378331034512 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.165283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b16b65-b2c6-4b1b-ad15-378331034512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:37.169488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b16b65-b2c6-4b1b-ad15-378331034512 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:37.235754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 866/1733] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:36 2022] POST /identity/v3/projects => generated 379 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:37.237217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b16b65-b2c6-4b1b-ad15-378331034512 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:37.240341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-30b16b65-b2c6-4b1b-ad15-378331034512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:37.385014 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 868/1734] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:37.393282 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1103e-78dd-43ce-928f-85ce00491945 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.393604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1103e-78dd-43ce-928f-85ce00491945 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.394532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1103e-78dd-43ce-928f-85ce00491945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.438242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-17e1103e-78dd-43ce-928f-85ce00491945 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:37.439815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-17e1103e-78dd-43ce-928f-85ce00491945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:37.461008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 869/1735] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:23:37.462725 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1103e-78dd-43ce-928f-85ce00491945 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:37.467813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b16b65-b2c6-4b1b-ad15-378331034512 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:37.484537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d5951-1cef-48eb-84e1-9bb147d9fcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:37.485967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d5951-1cef-48eb-84e1-9bb147d9fcaf admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.486290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d5951-1cef-48eb-84e1-9bb147d9fcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.486594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d5951-1cef-48eb-84e1-9bb147d9fcaf admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.486710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1103e-78dd-43ce-928f-85ce00491945 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:37.488514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d5951-1cef-48eb-84e1-9bb147d9fcaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:37.494834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d5951-1cef-48eb-84e1-9bb147d9fcaf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:37.502137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e38bb-479c-4358-87df-c6c50d3e85e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:37.503209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e38bb-479c-4358-87df-c6c50d3e85e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.503209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e38bb-479c-4358-87df-c6c50d3e85e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.504129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e38bb-479c-4358-87df-c6c50d3e85e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.505178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e38bb-479c-4358-87df-c6c50d3e85e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:37.505472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e38bb-479c-4358-87df-c6c50d3e85e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:37.513477 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e38bb-479c-4358-87df-c6c50d3e85e4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:37.542648 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 870/1736] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:37.546763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e38bb-479c-4358-87df-c6c50d3e85e4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:37.551776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 867/1737] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:37 2022] POST /identity/v3/users => generated 290 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:37.557207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d5951-1cef-48eb-84e1-9bb147d9fcaf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:37.571224 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e38bb-479c-4358-87df-c6c50d3e85e4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:37.578143 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d5951-1cef-48eb-84e1-9bb147d9fcaf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:37.584373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949e71c-fbde-4b40-bc4a-4140f7cbc56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:37.585361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949e71c-fbde-4b40-bc4a-4140f7cbc56e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.585765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949e71c-fbde-4b40-bc4a-4140f7cbc56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.586051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949e71c-fbde-4b40-bc4a-4140f7cbc56e admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.587732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949e71c-fbde-4b40-bc4a-4140f7cbc56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:37.588007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb201b75-1956-42c8-bff7-d6ce64693d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:37.589857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb201b75-1956-42c8-bff7-d6ce64693d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.589984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949e71c-fbde-4b40-bc4a-4140f7cbc56e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:37.590148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb201b75-1956-42c8-bff7-d6ce64693d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.590436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb201b75-1956-42c8-bff7-d6ce64693d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.591173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb201b75-1956-42c8-bff7-d6ce64693d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:37.594962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb201b75-1956-42c8-bff7-d6ce64693d4d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:37.627518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 868/1738] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:23:37.632384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb201b75-1956-42c8-bff7-d6ce64693d4d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:37.653418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb201b75-1956-42c8-bff7-d6ce64693d4d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:37.656447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 871/1739] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:37 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:37.660976 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949e71c-fbde-4b40-bc4a-4140f7cbc56e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:37.794397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e46e-6036-4da0-91f6-99892cbce8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:37.797227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e46e-6036-4da0-91f6-99892cbce8bc admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.802400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e46e-6036-4da0-91f6-99892cbce8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.802772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e46e-6036-4da0-91f6-99892cbce8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.804758 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6e46e-6036-4da0-91f6-99892cbce8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:37.806605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6e46e-6036-4da0-91f6-99892cbce8bc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:37.821247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 869/1740] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:37.825875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e46e-6036-4da0-91f6-99892cbce8bc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:37.836953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:37.849895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949e71c-fbde-4b40-bc4a-4140f7cbc56e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:37.860887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e46e-6036-4da0-91f6-99892cbce8bc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:37.862965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdef67-f65f-40a5-8088-fb2013610a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:37.863836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdef67-f65f-40a5-8088-fb2013610a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.864332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdef67-f65f-40a5-8088-fb2013610a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.864787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdef67-f65f-40a5-8088-fb2013610a1a admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.865802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdef67-f65f-40a5-8088-fb2013610a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:37.868703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdef67-f65f-40a5-8088-fb2013610a1a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:37.871972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba10692-5a3b-4803-8ee7-008d7617af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:37.873642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba10692-5a3b-4803-8ee7-008d7617af37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.877747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba10692-5a3b-4803-8ee7-008d7617af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.878676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba10692-5a3b-4803-8ee7-008d7617af37 admin admin] PATH_INFO: `/v3/projects/5809199775384da5821f28464d6daa6a/users/ade4f4074fa44fab9d6b7c669a82021d/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.902136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 872/1741] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:37 2022] POST /identity/v3/users => generated 296 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:37.906562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:37.907345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdef67-f65f-40a5-8088-fb2013610a1a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:37.916285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba10692-5a3b-4803-8ee7-008d7617af37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5809199775384da5821f28464d6daa6a, user_id=ade4f4074fa44fab9d6b7c669a82021d, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:37.920177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba10692-5a3b-4803-8ee7-008d7617af37 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:37.925197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdef67-f65f-40a5-8088-fb2013610a1a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:37.931751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f05aa-c97d-483b-ab4e-5d4917759302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:37.932565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f05aa-c97d-483b-ab4e-5d4917759302 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.932919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f05aa-c97d-483b-ab4e-5d4917759302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.933580 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f05aa-c97d-483b-ab4e-5d4917759302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.934223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f05aa-c97d-483b-ab4e-5d4917759302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:37.936299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f05aa-c97d-483b-ab4e-5d4917759302 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:37.954686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 873/1742] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:37.959666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f05aa-c97d-483b-ab4e-5d4917759302 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:37.960216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 870/1743] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:37 2022] PUT /identity/v3/projects/5809199775384da5821f28464d6daa6a/users/ade4f4074fa44fab9d6b7c669a82021d/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:37.970521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce976558-9800-4ee8-9d55-4276ceadb82c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:37.970889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce976558-9800-4ee8-9d55-4276ceadb82c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:37.971259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce976558-9800-4ee8-9d55-4276ceadb82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:37.984982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f05aa-c97d-483b-ab4e-5d4917759302 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:38.046269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ce976558-9800-4ee8-9d55-4276ceadb82c None None] MFA Rules not processed for user `ade4f4074fa44fab9d6b7c669a82021d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:38.047861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ce976558-9800-4ee8-9d55-4276ceadb82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:38.083950 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831cfaf-37fc-4ce5-9e0b-bcc7a54619c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:38.084768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831cfaf-37fc-4ce5-9e0b-bcc7a54619c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:38.085246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831cfaf-37fc-4ce5-9e0b-bcc7a54619c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:38.085619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831cfaf-37fc-4ce5-9e0b-bcc7a54619c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:38.086853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831cfaf-37fc-4ce5-9e0b-bcc7a54619c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:38.089081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831cfaf-37fc-4ce5-9e0b-bcc7a54619c8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:38.107632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 874/1744] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:38.109332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831cfaf-37fc-4ce5-9e0b-bcc7a54619c8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:38.123705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831cfaf-37fc-4ce5-9e0b-bcc7a54619c8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:38.147123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d0978-f78d-4270-8f2c-85dfe8ad01b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:38.148365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d0978-f78d-4270-8f2c-85dfe8ad01b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:38.149665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d0978-f78d-4270-8f2c-85dfe8ad01b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:38.149979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d0978-f78d-4270-8f2c-85dfe8ad01b4 admin admin] PATH_INFO: `/v3/projects/045b75164f65435da5bc351a5c8fdf00/users/45a5f664cc6d4bcba166ca67925277b3/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:38.184591 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d0978-f78d-4270-8f2c-85dfe8ad01b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=045b75164f65435da5bc351a5c8fdf00, user_id=45a5f664cc6d4bcba166ca67925277b3, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:38.188829 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d0978-f78d-4270-8f2c-85dfe8ad01b4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:38.231344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 875/1745] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:38 2022] PUT /identity/v3/projects/045b75164f65435da5bc351a5c8fdf00/users/45a5f664cc6d4bcba166ca67925277b3/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:38.234514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 871/1746] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:23:38.240286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce976558-9800-4ee8-9d55-4276ceadb82c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:38.241201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f37d5f-7116-4562-8d8e-5bdf599566f7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:38.241201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f37d5f-7116-4562-8d8e-5bdf599566f7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:38.241201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f37d5f-7116-4562-8d8e-5bdf599566f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:38.276442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce976558-9800-4ee8-9d55-4276ceadb82c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:38.370907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-04f37d5f-7116-4562-8d8e-5bdf599566f7 None None] MFA Rules not processed for user `45a5f664cc6d4bcba166ca67925277b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:38.379293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-04f37d5f-7116-4562-8d8e-5bdf599566f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:38.530601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa77f3e-a850-41c1-9bd8-30109bb24181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:38.531301 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77f3e-a850-41c1-9bd8-30109bb24181 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:38.532424 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77f3e-a850-41c1-9bd8-30109bb24181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:38.532713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77f3e-a850-41c1-9bd8-30109bb24181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:38.533903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa77f3e-a850-41c1-9bd8-30109bb24181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:38.550218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa77f3e-a850-41c1-9bd8-30109bb24181 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:38.641389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 872/1747] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:38 2022] POST /identity/v3/projects => generated 379 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:23:38.646636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc911-b554-4dc9-85f5-70d92f4781a7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:38.647533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc911-b554-4dc9-85f5-70d92f4781a7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:38.647533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc911-b554-4dc9-85f5-70d92f4781a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:38.669033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 876/1748] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:38.669797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f37d5f-7116-4562-8d8e-5bdf599566f7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:38.718447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f37d5f-7116-4562-8d8e-5bdf599566f7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:38.721185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-341dc911-b554-4dc9-85f5-70d92f4781a7 None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:38.722524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-341dc911-b554-4dc9-85f5-70d92f4781a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:38.801202 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:38.889911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e90ef-2581-4c23-a32d-9d7e253bd44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:38.894469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e90ef-2581-4c23-a32d-9d7e253bd44f admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:38.895304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e90ef-2581-4c23-a32d-9d7e253bd44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:38.896555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e90ef-2581-4c23-a32d-9d7e253bd44f admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:38.897905 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e90ef-2581-4c23-a32d-9d7e253bd44f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:38.918634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 873/1749] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:38.919504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dc911-b554-4dc9-85f5-70d92f4781a7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:38.933249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e90ef-2581-4c23-a32d-9d7e253bd44f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:38.973038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dc911-b554-4dc9-85f5-70d92f4781a7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:38.979654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980d06-3ad7-4564-b164-dc5d30ad6459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:38.980389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980d06-3ad7-4564-b164-dc5d30ad6459 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:38.980791 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980d06-3ad7-4564-b164-dc5d30ad6459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:38.981066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980d06-3ad7-4564-b164-dc5d30ad6459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:38.982117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16980d06-3ad7-4564-b164-dc5d30ad6459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:38.997883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16980d06-3ad7-4564-b164-dc5d30ad6459 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:39.009466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 877/1750] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:38 2022] POST /identity/v3/users => generated 290 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:39.010138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e90ef-2581-4c23-a32d-9d7e253bd44f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:39.016430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-504e90ef-2581-4c23-a32d-9d7e253bd44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:39.030032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:39.057165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e90ef-2581-4c23-a32d-9d7e253bd44f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:39.080232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:39.081348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:39.081791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:39.081947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] PATH_INFO: `/v3/projects/3a8b48bac7334698bac4ed83d8c03c6d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:39.088117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8b48bac7334698bac4ed83d8c03c6d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:39.090146 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:39.091435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 874/1751] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:38 2022] POST /identity/v3/projects => generated 391 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:39.092458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980d06-3ad7-4564-b164-dc5d30ad6459 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:39.259460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8b48bac7334698bac4ed83d8c03c6d', 'request_id': 'req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:39.270312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8b48bac7334698bac4ed83d8c03c6d', 'request_id': 'req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:39.278050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8b48bac7334698bac4ed83d8c03c6d', 'request_id': 'req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:39.300673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] The token cache is being invalidate because project 3a8b48bac7334698bac4ed83d8c03c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:39.301550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:39.302465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:39.309114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 878/1752] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:39 2022] DELETE /identity/v3/projects/3a8b48bac7334698bac4ed83d8c03c6d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:39.318659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:39.319811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980d06-3ad7-4564-b164-dc5d30ad6459 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:39.322069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:39.448109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2eb3ac-402c-46bc-9ac0-8acb9b257fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:39.450056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eb3ac-402c-46bc-9ac0-8acb9b257fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:39.450717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eb3ac-402c-46bc-9ac0-8acb9b257fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:39.452232 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eb3ac-402c-46bc-9ac0-8acb9b257fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:39.453812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2eb3ac-402c-46bc-9ac0-8acb9b257fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:39.458298 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2eb3ac-402c-46bc-9ac0-8acb9b257fdb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:39.488491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 875/1753] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:39.489863 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2eb3ac-402c-46bc-9ac0-8acb9b257fdb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:39.495645 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-aa2eb3ac-402c-46bc-9ac0-8acb9b257fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:39.507147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6744ded-dd56-4d0d-b584-6b9a39a95b1e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:39.523591 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005d26d-5486-4f92-8467-4233bd50ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:39.524571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d26d-5486-4f92-8467-4233bd50ae92 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:39.526293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d26d-5486-4f92-8467-4233bd50ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:39.526741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d26d-5486-4f92-8467-4233bd50ae92 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:39.528814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d26d-5486-4f92-8467-4233bd50ae92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:39.534095 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d26d-5486-4f92-8467-4233bd50ae92 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:39.583534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 879/1754] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:39 2022] POST /identity/v3/users => generated 302 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:39.583534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6569157-787f-43f5-8b41-ce7318036690 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:39.583534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6569157-787f-43f5-8b41-ce7318036690 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:39.583534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6569157-787f-43f5-8b41-ce7318036690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:39.627313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2eb3ac-402c-46bc-9ac0-8acb9b257fdb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:39.633942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b193cc-b86e-4daa-bf07-64cce245e74c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:39.635269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b193cc-b86e-4daa-bf07-64cce245e74c service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:39.635719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b193cc-b86e-4daa-bf07-64cce245e74c service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:39.636786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b193cc-b86e-4daa-bf07-64cce245e74c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:39.639002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-54b193cc-b86e-4daa-bf07-64cce245e74c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:39.645131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e6569157-787f-43f5-8b41-ce7318036690 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:39.650355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e6569157-787f-43f5-8b41-ce7318036690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:39.667418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 880/1755] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:39.667866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6569157-787f-43f5-8b41-ce7318036690 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:39.677643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e6569157-787f-43f5-8b41-ce7318036690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:39.702119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6569157-787f-43f5-8b41-ce7318036690 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:39.710404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:39.720671 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273830-5d24-469a-ae29-7fe5a4c9560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:39.725079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273830-5d24-469a-ae29-7fe5a4c9560a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:39.725376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273830-5d24-469a-ae29-7fe5a4c9560a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:39.725661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273830-5d24-469a-ae29-7fe5a4c9560a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:39.726612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273830-5d24-469a-ae29-7fe5a4c9560a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:39.730365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273830-5d24-469a-ae29-7fe5a4c9560a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:39.761584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 881/1756] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:39.763487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273830-5d24-469a-ae29-7fe5a4c9560a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:39.780924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b193cc-b86e-4daa-bf07-64cce245e74c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:39.782589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b193cc-b86e-4daa-bf07-64cce245e74c service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:39.791741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273830-5d24-469a-ae29-7fe5a4c9560a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:39.803412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f2b7-16f2-465b-a621-8af7f8bc7160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:39.811247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f2b7-16f2-465b-a621-8af7f8bc7160 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:39.811874 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f2b7-16f2-465b-a621-8af7f8bc7160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:39.812355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f2b7-16f2-465b-a621-8af7f8bc7160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:39.830599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91f2b7-16f2-465b-a621-8af7f8bc7160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:39.831556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 876/1757] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:23:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:23:39.833369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd19e7-729b-407b-b68b-13e32fa0bd63 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:39.833725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd19e7-729b-407b-b68b-13e32fa0bd63 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:39.834013 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd19e7-729b-407b-b68b-13e32fa0bd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:39.836673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91f2b7-16f2-465b-a621-8af7f8bc7160 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:39.867386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 882/1758] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:39.869871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f2b7-16f2-465b-a621-8af7f8bc7160 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:39.890129 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4ccd19e7-729b-407b-b68b-13e32fa0bd63 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:39.891718 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4ccd19e7-729b-407b-b68b-13e32fa0bd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:39.929522 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f2b7-16f2-465b-a621-8af7f8bc7160 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:39.951884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 877/1759] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:39.956543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d137de1-3f07-435e-804e-95ee61787d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:39.956720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd19e7-729b-407b-b68b-13e32fa0bd63 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:39.957636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137de1-3f07-435e-804e-95ee61787d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:39.957925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137de1-3f07-435e-804e-95ee61787d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:39.958205 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137de1-3f07-435e-804e-95ee61787d62 admin admin] PATH_INFO: `/v3/projects/3c1868ad463042bebe13609293b1ee99/users/88fd5f15e70c466e91d3d1d378a203c5/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:39.969342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:39.994022 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d137de1-3f07-435e-804e-95ee61787d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1868ad463042bebe13609293b1ee99, user_id=88fd5f15e70c466e91d3d1d378a203c5, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:39.996762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d137de1-3f07-435e-804e-95ee61787d62 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:40.021522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd19e7-729b-407b-b68b-13e32fa0bd63 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:40.034276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 883/1760] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:39 2022] PUT /identity/v3/projects/3c1868ad463042bebe13609293b1ee99/users/88fd5f15e70c466e91d3d1d378a203c5/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:40.035848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d137de1-3f07-435e-804e-95ee61787d62 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:40.166039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d137de1-3f07-435e-804e-95ee61787d62 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:40.185840 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f3e2b-64e7-4132-a660-3675e428640f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:40.186799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f3e2b-64e7-4132-a660-3675e428640f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:40.187835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f3e2b-64e7-4132-a660-3675e428640f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:40.188715 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f3e2b-64e7-4132-a660-3675e428640f admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:40.192162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f3e2b-64e7-4132-a660-3675e428640f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:40.192849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f3e2b-64e7-4132-a660-3675e428640f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:40.194669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f3e2b-64e7-4132-a660-3675e428640f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:40.241899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23997d-f9a8-4984-942c-ca2a059d721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:40.242927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23997d-f9a8-4984-942c-ca2a059d721f admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:40.243349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23997d-f9a8-4984-942c-ca2a059d721f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:40.243718 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23997d-f9a8-4984-942c-ca2a059d721f admin admin] PATH_INFO: `/v3/projects/315b97234ef5430f8652f423b1eeee5e/users/d0e78669b7b84a87abb3ddb07721639c/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:40.261919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 884/1761] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:40.264821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0fec-631c-4d9a-94cd-6090198b4682 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:40.265990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0fec-631c-4d9a-94cd-6090198b4682 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:40.267805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0fec-631c-4d9a-94cd-6090198b4682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:40.279460 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23997d-f9a8-4984-942c-ca2a059d721f admin admin] RBAC: Authorizing `identity:create_grant(project_id=315b97234ef5430f8652f423b1eeee5e, user_id=d0e78669b7b84a87abb3ddb07721639c, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:40.283333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23997d-f9a8-4984-942c-ca2a059d721f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:40.338951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 878/1762] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:39 2022] PUT /identity/v3/projects/315b97234ef5430f8652f423b1eeee5e/users/d0e78669b7b84a87abb3ddb07721639c/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:40.342510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312b5c-741a-4091-ab6e-95192351fcb9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:40.345164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312b5c-741a-4091-ab6e-95192351fcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:40.345531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312b5c-741a-4091-ab6e-95192351fcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:40.388510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-62cf0fec-631c-4d9a-94cd-6090198b4682 None None] MFA Rules not processed for user `54456ce5f68d46b3bba5554e21bf36c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:40.395741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-62cf0fec-631c-4d9a-94cd-6090198b4682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:40.415607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-69312b5c-741a-4091-ab6e-95192351fcb9 None None] MFA Rules not processed for user `88fd5f15e70c466e91d3d1d378a203c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:40.418186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-69312b5c-741a-4091-ab6e-95192351fcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:40.691088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 879/1763] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:40.696223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312b5c-741a-4091-ab6e-95192351fcb9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:40.726170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 885/1764] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:40.727271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf0fec-631c-4d9a-94cd-6090198b4682 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:40.813127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:40.868766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312b5c-741a-4091-ab6e-95192351fcb9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:40.883705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6217f93-bd75-4b56-bde7-74830fbe25b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:40.884441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6217f93-bd75-4b56-bde7-74830fbe25b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:40.884729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6217f93-bd75-4b56-bde7-74830fbe25b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:40.885026 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6217f93-bd75-4b56-bde7-74830fbe25b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:40.885734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6217f93-bd75-4b56-bde7-74830fbe25b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:40.891686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6217f93-bd75-4b56-bde7-74830fbe25b9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:40.936766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf0fec-631c-4d9a-94cd-6090198b4682 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:40.951208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1a0aa-0a47-4d1b-b90a-b13f9a2e2123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:40.951981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a0aa-0a47-4d1b-b90a-b13f9a2e2123 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:40.952301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a0aa-0a47-4d1b-b90a-b13f9a2e2123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:40.952583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a0aa-0a47-4d1b-b90a-b13f9a2e2123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:40.953388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1a0aa-0a47-4d1b-b90a-b13f9a2e2123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:40.955056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1a0aa-0a47-4d1b-b90a-b13f9a2e2123 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:40.981194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 880/1765] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:40 2022] POST /identity/v3/projects => generated 389 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:40.982267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6217f93-bd75-4b56-bde7-74830fbe25b9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:40.985634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 886/1766] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:40.985634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1a0aa-0a47-4d1b-b90a-b13f9a2e2123 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:40.989653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f3f1a0aa-0a47-4d1b-b90a-b13f9a2e2123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:41.015311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:41.021912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1a0aa-0a47-4d1b-b90a-b13f9a2e2123 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:41.148081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6217f93-bd75-4b56-bde7-74830fbe25b9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:41.163517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47297ef0-59dd-4225-94b1-e91e1665e40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:41.165517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47297ef0-59dd-4225-94b1-e91e1665e40f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:41.167047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47297ef0-59dd-4225-94b1-e91e1665e40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:41.167653 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47297ef0-59dd-4225-94b1-e91e1665e40f admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:41.169075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47297ef0-59dd-4225-94b1-e91e1665e40f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:41.177914 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47297ef0-59dd-4225-94b1-e91e1665e40f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:41.188004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaf7c4-02ec-431a-b416-339ee85a483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:41.188774 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaf7c4-02ec-431a-b416-339ee85a483d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:41.189073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaf7c4-02ec-431a-b416-339ee85a483d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:41.189361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaf7c4-02ec-431a-b416-339ee85a483d admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:41.190081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfaf7c4-02ec-431a-b416-339ee85a483d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:41.192710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfaf7c4-02ec-431a-b416-339ee85a483d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:41.238581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 881/1767] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:40 2022] POST /identity/v3/projects => generated 379 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:41.239610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47297ef0-59dd-4225-94b1-e91e1665e40f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:41.267817 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 887/1768] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:40 2022] POST /identity/v3/projects => generated 405 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:41.277070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaf7c4-02ec-431a-b416-339ee85a483d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:41.346607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47297ef0-59dd-4225-94b1-e91e1665e40f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:41.428903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:41.444180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727e6bc-3b3d-4ff2-95b2-84923357a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:41.447055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727e6bc-3b3d-4ff2-95b2-84923357a783 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:41.447352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727e6bc-3b3d-4ff2-95b2-84923357a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:41.447639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727e6bc-3b3d-4ff2-95b2-84923357a783 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:41.453274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727e6bc-3b3d-4ff2-95b2-84923357a783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:41.461660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727e6bc-3b3d-4ff2-95b2-84923357a783 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:41.550795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 882/1769] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:41 2022] POST /identity/v3/users => generated 295 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:41.551752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727e6bc-3b3d-4ff2-95b2-84923357a783 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:41.575385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaf7c4-02ec-431a-b416-339ee85a483d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:41.586355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727e6bc-3b3d-4ff2-95b2-84923357a783 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:41.605267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaf813-4485-4fb4-a6b1-a1fd751c411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:41.607074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf813-4485-4fb4-a6b1-a1fd751c411e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:41.607365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf813-4485-4fb4-a6b1-a1fd751c411e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:41.607651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf813-4485-4fb4-a6b1-a1fd751c411e admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:41.612962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ff2d8-9987-49ce-921a-cd30b12a5850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:41.613167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfaf813-4485-4fb4-a6b1-a1fd751c411e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:41.613891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ff2d8-9987-49ce-921a-cd30b12a5850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:41.614182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ff2d8-9987-49ce-921a-cd30b12a5850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:41.614506 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ff2d8-9987-49ce-921a-cd30b12a5850 admin admin] PATH_INFO: `/v3/projects/315b97234ef5430f8652f423b1eeee5e/users/d0e78669b7b84a87abb3ddb07721639c/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:41.619729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfaf813-4485-4fb4-a6b1-a1fd751c411e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:41.625125 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ff2d8-9987-49ce-921a-cd30b12a5850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=315b97234ef5430f8652f423b1eeee5e, user_id=d0e78669b7b84a87abb3ddb07721639c, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:41.635771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ff2d8-9987-49ce-921a-cd30b12a5850 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:41.688293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 883/1770] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:41 2022] POST /identity/v3/users => generated 296 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:41.702075 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 888/1771] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:41 2022] PUT /identity/v3/projects/315b97234ef5430f8652f423b1eeee5e/users/d0e78669b7b84a87abb3ddb07721639c/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:41.702290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaf813-4485-4fb4-a6b1-a1fd751c411e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:41.702378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ff2d8-9987-49ce-921a-cd30b12a5850 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:41.738275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaf813-4485-4fb4-a6b1-a1fd751c411e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:41.943873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ff2d8-9987-49ce-921a-cd30b12a5850 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:41.954973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c648c-9644-4701-a355-e6ef628935fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:41.956380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c648c-9644-4701-a355-e6ef628935fe admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:41.956960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c648c-9644-4701-a355-e6ef628935fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:41.957636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c648c-9644-4701-a355-e6ef628935fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:41.958775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c648c-9644-4701-a355-e6ef628935fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:41.961541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c648c-9644-4701-a355-e6ef628935fe admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:41.986576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 889/1772] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:41.991036 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c648c-9644-4701-a355-e6ef628935fe admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:42.008442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c648c-9644-4701-a355-e6ef628935fe admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:42.017857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57698e7-8128-4814-af4a-accb5e440645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:42.019430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57698e7-8128-4814-af4a-accb5e440645 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:42.019868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57698e7-8128-4814-af4a-accb5e440645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:42.020911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57698e7-8128-4814-af4a-accb5e440645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:42.022502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57698e7-8128-4814-af4a-accb5e440645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:42.038101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57698e7-8128-4814-af4a-accb5e440645 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:42.068914 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 890/1773] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:42.070814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44036838-fae1-4003-a72c-4f7522554bde None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:42.071808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44036838-fae1-4003-a72c-4f7522554bde None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:42.072391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44036838-fae1-4003-a72c-4f7522554bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:42.119445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:42.162427 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-44036838-fae1-4003-a72c-4f7522554bde None None] MFA Rules not processed for user `d0e78669b7b84a87abb3ddb07721639c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:42.171383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-44036838-fae1-4003-a72c-4f7522554bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:42.242164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae543792-005a-4a0d-a686-09f15999af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:42.242877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae543792-005a-4a0d-a686-09f15999af18 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:42.246834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae543792-005a-4a0d-a686-09f15999af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:42.247182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae543792-005a-4a0d-a686-09f15999af18 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:42.248340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae543792-005a-4a0d-a686-09f15999af18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:42.297226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae543792-005a-4a0d-a686-09f15999af18 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:42.392880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 884/1774] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:41 2022] POST /identity/v3/users => generated 309 bytes in 704 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:42.403505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae543792-005a-4a0d-a686-09f15999af18 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:42.415595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 891/1775] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:42.430976 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44036838-fae1-4003-a72c-4f7522554bde None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:42.447264 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae543792-005a-4a0d-a686-09f15999af18 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:42.457879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44036838-fae1-4003-a72c-4f7522554bde None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:42.464110 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f394a-139c-4490-b1f3-e902d1eb5141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:42.468946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f394a-139c-4490-b1f3-e902d1eb5141 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:42.471812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab051cd-c464-42b1-ad0a-78c85ea28c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:42.473169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab051cd-c464-42b1-ad0a-78c85ea28c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:42.473676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f394a-139c-4490-b1f3-e902d1eb5141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:42.474037 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f394a-139c-4490-b1f3-e902d1eb5141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:42.474952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f394a-139c-4490-b1f3-e902d1eb5141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:42.475065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab051cd-c464-42b1-ad0a-78c85ea28c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:42.476435 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab051cd-c464-42b1-ad0a-78c85ea28c1a admin admin] PATH_INFO: `/v3/projects/8fb470f1869e4eac9dbf81ce636f2c40/users/943639d87aea4f688b5caaf5e3a19c1d/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:42.481540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f394a-139c-4490-b1f3-e902d1eb5141 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:42.521529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab051cd-c464-42b1-ad0a-78c85ea28c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb470f1869e4eac9dbf81ce636f2c40, user_id=943639d87aea4f688b5caaf5e3a19c1d, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:42.523556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 885/1776] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:42.525082 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f394a-139c-4490-b1f3-e902d1eb5141 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:42.530495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab051cd-c464-42b1-ad0a-78c85ea28c1a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:42.568859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f394a-139c-4490-b1f3-e902d1eb5141 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:42.570796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 892/1777] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:42 2022] PUT /identity/v3/projects/8fb470f1869e4eac9dbf81ce636f2c40/users/943639d87aea4f688b5caaf5e3a19c1d/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:42.572361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab051cd-c464-42b1-ad0a-78c85ea28c1a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:42.577907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ab051cd-c464-42b1-ad0a-78c85ea28c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:42.705800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a21e9-9131-42f9-a961-fbb5b97eb513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:42.707307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a21e9-9131-42f9-a961-fbb5b97eb513 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:42.707534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a21e9-9131-42f9-a961-fbb5b97eb513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:42.707880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a21e9-9131-42f9-a961-fbb5b97eb513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:42.708776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a21e9-9131-42f9-a961-fbb5b97eb513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:42.710678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a21e9-9131-42f9-a961-fbb5b97eb513 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:42.752607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 886/1778] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:42.755425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a21e9-9131-42f9-a961-fbb5b97eb513 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:42.758832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab051cd-c464-42b1-ad0a-78c85ea28c1a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:42.769483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a21e9-9131-42f9-a961-fbb5b97eb513 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:42.775759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bc832-9922-4872-bfc0-64952138ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:42.776974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc832-9922-4872-bfc0-64952138ec2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:42.777395 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc832-9922-4872-bfc0-64952138ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:42.777896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc832-9922-4872-bfc0-64952138ec2a admin admin] PATH_INFO: `/v3/projects/e71beaa31d184ea2b9efd1da56e67692/users/1b403436b4d248f9aa742d3083175c50/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:42.791568 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b8d5e-a5cb-4e7b-ac2e-90ab4269626b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:42.797435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bc832-9922-4872-bfc0-64952138ec2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71beaa31d184ea2b9efd1da56e67692, user_id=1b403436b4d248f9aa742d3083175c50, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:42.797773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b8d5e-a5cb-4e7b-ac2e-90ab4269626b service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:42.799915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b8d5e-a5cb-4e7b-ac2e-90ab4269626b service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:42.800400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b8d5e-a5cb-4e7b-ac2e-90ab4269626b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:42.801196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bc832-9922-4872-bfc0-64952138ec2a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:42.838445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 887/1779] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:42 2022] PUT /identity/v3/projects/e71beaa31d184ea2b9efd1da56e67692/users/1b403436b4d248f9aa742d3083175c50/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:42.839892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bc832-9922-4872-bfc0-64952138ec2a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:42.867132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:42.930367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bc832-9922-4872-bfc0-64952138ec2a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:42.937456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecac18-5a3d-4655-b885-7b960cac7030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:42.938446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecac18-5a3d-4655-b885-7b960cac7030 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:42.938934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecac18-5a3d-4655-b885-7b960cac7030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:42.939419 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecac18-5a3d-4655-b885-7b960cac7030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:42.940935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecac18-5a3d-4655-b885-7b960cac7030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:42.945524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecac18-5a3d-4655-b885-7b960cac7030 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:42.984040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 888/1780] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:42.985607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecac18-5a3d-4655-b885-7b960cac7030 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:43.007573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecac18-5a3d-4655-b885-7b960cac7030 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:43.015123 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fb982-32dd-4a5f-9a62-6a4ee7544606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:43.016914 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fb982-32dd-4a5f-9a62-6a4ee7544606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:43.017443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fb982-32dd-4a5f-9a62-6a4ee7544606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:43.018094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fb982-32dd-4a5f-9a62-6a4ee7544606 admin admin] PATH_INFO: `/v3/projects/c2c76169c88d41668459e06d4b5d0601/users/a26c582b69ae406ab7acdda01a332b94/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:43.021432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b8d5e-a5cb-4e7b-ac2e-90ab4269626b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:43.029603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b8d5e-a5cb-4e7b-ac2e-90ab4269626b service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:43.039048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fb982-32dd-4a5f-9a62-6a4ee7544606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c76169c88d41668459e06d4b5d0601, user_id=a26c582b69ae406ab7acdda01a332b94, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:43.042887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fb982-32dd-4a5f-9a62-6a4ee7544606 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:43.058554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 893/1781] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:43.067284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 889/1782] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:42 2022] PUT /identity/v3/projects/c2c76169c88d41668459e06d4b5d0601/users/a26c582b69ae406ab7acdda01a332b94/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:43.069195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea4b3-488f-4d50-9c88-4d2ecb752396 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:43.070035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea4b3-488f-4d50-9c88-4d2ecb752396 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:43.070409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea4b3-488f-4d50-9c88-4d2ecb752396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:43.074992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b8d5e-a5cb-4e7b-ac2e-90ab4269626b service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:43.117562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b2dea4b3-488f-4d50-9c88-4d2ecb752396 None None] MFA Rules not processed for user `1b403436b4d248f9aa742d3083175c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:43.119725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b2dea4b3-488f-4d50-9c88-4d2ecb752396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:43.123543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b8d5e-a5cb-4e7b-ac2e-90ab4269626b service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:43.194501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:43.254128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 890/1783] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:43.254128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dea4b3-488f-4d50-9c88-4d2ecb752396 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:43.334345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd477-d83b-4bbb-8d4c-6423283ea280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:43.335628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd477-d83b-4bbb-8d4c-6423283ea280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:43.337520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd477-d83b-4bbb-8d4c-6423283ea280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:43.338071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd477-d83b-4bbb-8d4c-6423283ea280 admin admin] PATH_INFO: `/v3/projects/8fb470f1869e4eac9dbf81ce636f2c40/users/943639d87aea4f688b5caaf5e3a19c1d/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:43.346621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdd477-d83b-4bbb-8d4c-6423283ea280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb470f1869e4eac9dbf81ce636f2c40, user_id=943639d87aea4f688b5caaf5e3a19c1d, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:43.369657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdd477-d83b-4bbb-8d4c-6423283ea280 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:43.402223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dea4b3-488f-4d50-9c88-4d2ecb752396 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:43.426047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 894/1784] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:43 2022] PUT /identity/v3/projects/8fb470f1869e4eac9dbf81ce636f2c40/users/943639d87aea4f688b5caaf5e3a19c1d/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:43.432197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd477-d83b-4bbb-8d4c-6423283ea280 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:43.438700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9fbdd477-d83b-4bbb-8d4c-6423283ea280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:43.442268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:43.494747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78625bb-5525-42ad-8955-72892cbde3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:43.496486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78625bb-5525-42ad-8955-72892cbde3ac admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:43.496926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78625bb-5525-42ad-8955-72892cbde3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:43.497383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78625bb-5525-42ad-8955-72892cbde3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:43.501553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78625bb-5525-42ad-8955-72892cbde3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:43.504714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78625bb-5525-42ad-8955-72892cbde3ac admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:43.523285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 891/1785] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:43.524813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78625bb-5525-42ad-8955-72892cbde3ac admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:43.545608 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78625bb-5525-42ad-8955-72892cbde3ac admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:43.551721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5f6e3-dee3-4214-8fc4-88519938fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:43.552431 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f6e3-dee3-4214-8fc4-88519938fa95 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:43.552764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f6e3-dee3-4214-8fc4-88519938fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:43.553894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f6e3-dee3-4214-8fc4-88519938fa95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:43.554772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5f6e3-dee3-4214-8fc4-88519938fa95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:43.556985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5f6e3-dee3-4214-8fc4-88519938fa95 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:43.581749 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd477-d83b-4bbb-8d4c-6423283ea280 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:43.591037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a667db-a41a-489b-858f-c8060e274d74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:43.591791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a667db-a41a-489b-858f-c8060e274d74 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:43.592105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a667db-a41a-489b-858f-c8060e274d74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:43.592464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a667db-a41a-489b-858f-c8060e274d74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:43.597780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c0a667db-a41a-489b-858f-c8060e274d74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:43.618654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 892/1786] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:43 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:43.618654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e7e2-2ef8-4c67-adf2-f71cf78442f4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:43.618654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e7e2-2ef8-4c67-adf2-f71cf78442f4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:43.618966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e7e2-2ef8-4c67-adf2-f71cf78442f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:43.677402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-de52e7e2-2ef8-4c67-adf2-f71cf78442f4 None None] MFA Rules not processed for user `943639d87aea4f688b5caaf5e3a19c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:43.704740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-de52e7e2-2ef8-4c67-adf2-f71cf78442f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:43.754890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a667db-a41a-489b-858f-c8060e274d74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:43.757711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a667db-a41a-489b-858f-c8060e274d74 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:43.785779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 895/1787] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:43.786950 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a667db-a41a-489b-858f-c8060e274d74 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:43.812094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a667db-a41a-489b-858f-c8060e274d74 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:43.886205 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da65a48-05e1-4ba3-afcb-f6bed1b82305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:43.887167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da65a48-05e1-4ba3-afcb-f6bed1b82305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:43.887460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da65a48-05e1-4ba3-afcb-f6bed1b82305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:43.887742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da65a48-05e1-4ba3-afcb-f6bed1b82305 admin admin] PATH_INFO: `/v3/projects/c2c76169c88d41668459e06d4b5d0601/users/a26c582b69ae406ab7acdda01a332b94/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:43.890406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da65a48-05e1-4ba3-afcb-f6bed1b82305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c76169c88d41668459e06d4b5d0601, user_id=a26c582b69ae406ab7acdda01a332b94, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:43.894589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da65a48-05e1-4ba3-afcb-f6bed1b82305 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:43.908128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 896/1788] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:43 2022] PUT /identity/v3/projects/c2c76169c88d41668459e06d4b5d0601/users/a26c582b69ae406ab7acdda01a332b94/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:43.908974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da65a48-05e1-4ba3-afcb-f6bed1b82305 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:43.915323 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:43.988564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da65a48-05e1-4ba3-afcb-f6bed1b82305 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:43.997234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f9a0d-0ccb-4341-9b65-fd0261f27571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:43.997937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f9a0d-0ccb-4341-9b65-fd0261f27571 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:43.998494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f9a0d-0ccb-4341-9b65-fd0261f27571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:43.998645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f9a0d-0ccb-4341-9b65-fd0261f27571 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:43.999359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f9a0d-0ccb-4341-9b65-fd0261f27571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:44.002149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f9a0d-0ccb-4341-9b65-fd0261f27571 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:44.006179 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 893/1789] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:44.017916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52e7e2-2ef8-4c67-adf2-f71cf78442f4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:44.053088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 897/1790] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:43 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:44.054359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f9a0d-0ccb-4341-9b65-fd0261f27571 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:44.078622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f9a0d-0ccb-4341-9b65-fd0261f27571 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:44.090596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79cc07-7612-4f4f-8486-910d3934643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:44.091395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79cc07-7612-4f4f-8486-910d3934643d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:44.091683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79cc07-7612-4f4f-8486-910d3934643d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:44.091963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79cc07-7612-4f4f-8486-910d3934643d admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:44.095194 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79cc07-7612-4f4f-8486-910d3934643d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:44.098301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79cc07-7612-4f4f-8486-910d3934643d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:44.135365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 898/1791] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:44.135365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79cc07-7612-4f4f-8486-910d3934643d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:44.143301 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52e7e2-2ef8-4c67-adf2-f71cf78442f4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:44.148992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79cc07-7612-4f4f-8486-910d3934643d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:44.162754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216df7a4-9cee-4a7a-92df-2fc018fbab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:44.163671 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216df7a4-9cee-4a7a-92df-2fc018fbab60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:44.163957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216df7a4-9cee-4a7a-92df-2fc018fbab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:44.164263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216df7a4-9cee-4a7a-92df-2fc018fbab60 admin admin] PATH_INFO: `/v3/projects/f01fea00cef84af1a57a15cbe9fc3c0c/users/25433127cb184dcfa6280d6a39d95e0b/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:44.207581 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216df7a4-9cee-4a7a-92df-2fc018fbab60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01fea00cef84af1a57a15cbe9fc3c0c, user_id=25433127cb184dcfa6280d6a39d95e0b, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:44.212493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216df7a4-9cee-4a7a-92df-2fc018fbab60 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:44.250184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 899/1792] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:44 2022] PUT /identity/v3/projects/f01fea00cef84af1a57a15cbe9fc3c0c/users/25433127cb184dcfa6280d6a39d95e0b/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:44.251353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216df7a4-9cee-4a7a-92df-2fc018fbab60 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:44.259658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:44.276766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38748e4f-e3d3-45bd-84ea-274f54333e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:44.278770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38748e4f-e3d3-45bd-84ea-274f54333e8b service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:44.279069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38748e4f-e3d3-45bd-84ea-274f54333e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:44.279353 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38748e4f-e3d3-45bd-84ea-274f54333e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:44.514561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216df7a4-9cee-4a7a-92df-2fc018fbab60 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:44.544964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65984c6-e208-40c2-94c5-029b726903fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:44.546691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65984c6-e208-40c2-94c5-029b726903fe admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:44.546986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65984c6-e208-40c2-94c5-029b726903fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:44.548168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65984c6-e208-40c2-94c5-029b726903fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:44.549966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65984c6-e208-40c2-94c5-029b726903fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:44.567049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65984c6-e208-40c2-94c5-029b726903fe admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:44.571538 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38748e4f-e3d3-45bd-84ea-274f54333e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:44.579443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38748e4f-e3d3-45bd-84ea-274f54333e8b service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:44.601693 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 900/1793] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:44.602606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65984c6-e208-40c2-94c5-029b726903fe admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:44.615308 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 894/1794] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:23:44.626488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65984c6-e208-40c2-94c5-029b726903fe admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:44.646346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836c293-80c9-4b6c-adc3-ecaeb0456aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:44.647283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836c293-80c9-4b6c-adc3-ecaeb0456aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:44.647571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836c293-80c9-4b6c-adc3-ecaeb0456aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:44.647923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836c293-80c9-4b6c-adc3-ecaeb0456aa8 admin admin] PATH_INFO: `/v3/projects/f01fea00cef84af1a57a15cbe9fc3c0c/users/25433127cb184dcfa6280d6a39d95e0b/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:44.655806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836c293-80c9-4b6c-adc3-ecaeb0456aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01fea00cef84af1a57a15cbe9fc3c0c, user_id=25433127cb184dcfa6280d6a39d95e0b, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:44.666550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836c293-80c9-4b6c-adc3-ecaeb0456aa8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:44.698458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 901/1795] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:44 2022] PUT /identity/v3/projects/f01fea00cef84af1a57a15cbe9fc3c0c/users/25433127cb184dcfa6280d6a39d95e0b/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:44.710433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4f102-2ef4-46eb-abab-335abffc3117 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:44.710978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4f102-2ef4-46eb-abab-335abffc3117 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:44.711414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4f102-2ef4-46eb-abab-335abffc3117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:44.735857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836c293-80c9-4b6c-adc3-ecaeb0456aa8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:44.783839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-20e4f102-2ef4-46eb-abab-335abffc3117 None None] MFA Rules not processed for user `25433127cb184dcfa6280d6a39d95e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:44.786209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-20e4f102-2ef4-46eb-abab-335abffc3117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:44.835761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:44.864881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836c293-80c9-4b6c-adc3-ecaeb0456aa8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:44.874302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22449d64-7f2f-4b61-9747-59f014fd25d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:44.879898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22449d64-7f2f-4b61-9747-59f014fd25d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:44.880654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22449d64-7f2f-4b61-9747-59f014fd25d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:44.881088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22449d64-7f2f-4b61-9747-59f014fd25d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:44.885609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-22449d64-7f2f-4b61-9747-59f014fd25d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:44.963364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 895/1796] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:23:44.973712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4f102-2ef4-46eb-abab-335abffc3117 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:44.989004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4f102-2ef4-46eb-abab-335abffc3117 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:44.996599 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba46123-a879-4434-9561-d90252cd407d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:44.997266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba46123-a879-4434-9561-d90252cd407d service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:44.997551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba46123-a879-4434-9561-d90252cd407d service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:44.997830 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba46123-a879-4434-9561-d90252cd407d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:45.022111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba46123-a879-4434-9561-d90252cd407d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:45.023585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba46123-a879-4434-9561-d90252cd407d service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:45.024900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22449d64-7f2f-4b61-9747-59f014fd25d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:45.026363 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22449d64-7f2f-4b61-9747-59f014fd25d1 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:45.051597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 902/1797] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:45.052344 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 896/1798] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:45.053206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa7fbf-c6c0-4c90-ad60-99f8775f983d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:45.053687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa7fbf-c6c0-4c90-ad60-99f8775f983d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:45.053762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa7fbf-c6c0-4c90-ad60-99f8775f983d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:45.073313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-48fa7fbf-c6c0-4c90-ad60-99f8775f983d None None] MFA Rules not processed for user `b37002ecc6384dc08fca3ddf6ca2f9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:45.074572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-48fa7fbf-c6c0-4c90-ad60-99f8775f983d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:45.142763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 903/1799] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jun 22 12:23:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:45.276897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba46123-a879-4434-9561-d90252cd407d service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:45.278839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bba46123-a879-4434-9561-d90252cd407d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:45.298395 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba46123-a879-4434-9561-d90252cd407d service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:45.306569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab603d-0c95-4342-986a-c6c917322986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:45.307383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab603d-0c95-4342-986a-c6c917322986 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:45.307746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab603d-0c95-4342-986a-c6c917322986 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:45.308121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab603d-0c95-4342-986a-c6c917322986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:45.318088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab603d-0c95-4342-986a-c6c917322986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:45.320839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab603d-0c95-4342-986a-c6c917322986 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:45.348105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 897/1800] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:45.455073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa7fbf-c6c0-4c90-ad60-99f8775f983d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:45.681259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa7fbf-c6c0-4c90-ad60-99f8775f983d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:45.695921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:45.696975 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:45.697264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:45.708032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] PATH_INFO: `/v3/users/1b403436b4d248f9aa742d3083175c50` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:45.713059 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b403436b4d248f9aa742d3083175c50)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:45.716939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:45.960727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:45.971141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b403436b4d248f9aa742d3083175c50'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:46.058861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b403436b4d248f9aa742d3083175c50'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:46.101551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b403436b4d248f9aa742d3083175c50'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:46.104444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b403436b4d248f9aa742d3083175c50'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:46.135743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b403436b4d248f9aa742d3083175c50'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:46.162991 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 904/1801] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:45 2022] DELETE /identity/v3/users/1b403436b4d248f9aa742d3083175c50 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:46.165030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63581f01-261d-4e5a-a736-bba7540828f8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:46.165354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63581f01-261d-4e5a-a736-bba7540828f8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:46.166199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63581f01-261d-4e5a-a736-bba7540828f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:46.220875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-63581f01-261d-4e5a-a736-bba7540828f8 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:46.223142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-63581f01-261d-4e5a-a736-bba7540828f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:46.362999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:46.392908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 898/1802] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:46.720334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:46.722906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:46.917679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a6a72-53d1-40be-997c-21111f91b6ba admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:46.923574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ae883-8ec6-4f85-a4b5-9bf18da1aebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:46.924683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ae883-8ec6-4f85-a4b5-9bf18da1aebf service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:46.925615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ae883-8ec6-4f85-a4b5-9bf18da1aebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:46.925997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ae883-8ec6-4f85-a4b5-9bf18da1aebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:46.954790 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ae883-8ec6-4f85-a4b5-9bf18da1aebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:46.957462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ae883-8ec6-4f85-a4b5-9bf18da1aebf service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:46.976365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 905/1803] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:49.484519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63581f01-261d-4e5a-a736-bba7540828f8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:49.487200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-63581f01-261d-4e5a-a736-bba7540828f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:49.518889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63581f01-261d-4e5a-a736-bba7540828f8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:49.525305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f64649-14e8-4282-9f6f-a462a16d774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:49.527423 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64649-14e8-4282-9f6f-a462a16d774d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:49.528050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64649-14e8-4282-9f6f-a462a16d774d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:49.528603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f64649-14e8-4282-9f6f-a462a16d774d admin admin] PATH_INFO: `/v3/users/ade4f4074fa44fab9d6b7c669a82021d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:49.542802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f64649-14e8-4282-9f6f-a462a16d774d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade4f4074fa44fab9d6b7c669a82021d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:49.554348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f64649-14e8-4282-9f6f-a462a16d774d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:49.700767 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ae883-8ec6-4f85-a4b5-9bf18da1aebf service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:49.702475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d54ae883-8ec6-4f85-a4b5-9bf18da1aebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:49.724448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ae883-8ec6-4f85-a4b5-9bf18da1aebf service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:49.736535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-92f64649-14e8-4282-9f6f-a462a16d774d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade4f4074fa44fab9d6b7c669a82021d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:49.746787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7786f-d5f2-4759-92af-aa33d93aa87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:49.747683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7786f-d5f2-4759-92af-aa33d93aa87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:49.747967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7786f-d5f2-4759-92af-aa33d93aa87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:49.748274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7786f-d5f2-4759-92af-aa33d93aa87d admin admin] PATH_INFO: `/v3/users/45a5f664cc6d4bcba166ca67925277b3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:49.753817 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7786f-d5f2-4759-92af-aa33d93aa87d admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a5f664cc6d4bcba166ca67925277b3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:49.755815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7786f-d5f2-4759-92af-aa33d93aa87d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:49.759142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-92f64649-14e8-4282-9f6f-a462a16d774d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade4f4074fa44fab9d6b7c669a82021d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:49.812056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-92f64649-14e8-4282-9f6f-a462a16d774d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade4f4074fa44fab9d6b7c669a82021d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:49.812056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-92f64649-14e8-4282-9f6f-a462a16d774d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade4f4074fa44fab9d6b7c669a82021d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:49.869959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-92f64649-14e8-4282-9f6f-a462a16d774d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade4f4074fa44fab9d6b7c669a82021d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:49.890862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 899/1804] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:49 2022] DELETE /identity/v3/users/ade4f4074fa44fab9d6b7c669a82021d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:49.893362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-27d7786f-d5f2-4759-92af-aa33d93aa87d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a5f664cc6d4bcba166ca67925277b3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:49.895101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434952ac-9fd8-4ed7-9e0b-3ec2e6f248b3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:49.895343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434952ac-9fd8-4ed7-9e0b-3ec2e6f248b3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:49.895640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434952ac-9fd8-4ed7-9e0b-3ec2e6f248b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:49.924998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-434952ac-9fd8-4ed7-9e0b-3ec2e6f248b3 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:49.926485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-434952ac-9fd8-4ed7-9e0b-3ec2e6f248b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:49.936112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-27d7786f-d5f2-4759-92af-aa33d93aa87d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a5f664cc6d4bcba166ca67925277b3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:49.962130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-27d7786f-d5f2-4759-92af-aa33d93aa87d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a5f664cc6d4bcba166ca67925277b3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:49.965424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-27d7786f-d5f2-4759-92af-aa33d93aa87d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a5f664cc6d4bcba166ca67925277b3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:49.991973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-27d7786f-d5f2-4759-92af-aa33d93aa87d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a5f664cc6d4bcba166ca67925277b3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:50.013356 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 906/1805] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:49 2022] DELETE /identity/v3/users/45a5f664cc6d4bcba166ca67925277b3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:23:50.019556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b488a85-6aa6-42d9-8955-195c4fafd355 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:50.020000 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b488a85-6aa6-42d9-8955-195c4fafd355 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:50.020946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b488a85-6aa6-42d9-8955-195c4fafd355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:50.050937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1b488a85-6aa6-42d9-8955-195c4fafd355 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:50.053156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1b488a85-6aa6-42d9-8955-195c4fafd355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:50.078452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 900/1806] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:50.113284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:50.125333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434952ac-9fd8-4ed7-9e0b-3ec2e6f248b3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:50.127081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-434952ac-9fd8-4ed7-9e0b-3ec2e6f248b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:50.165098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 907/1807] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:50.247419 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434952ac-9fd8-4ed7-9e0b-3ec2e6f248b3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:50.278252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b488a85-6aa6-42d9-8955-195c4fafd355 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:50.322391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:50.411449 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b488a85-6aa6-42d9-8955-195c4fafd355 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:50.417917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e05e43-7f0b-44e7-bc03-10132bf7ac0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:50.418597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e05e43-7f0b-44e7-bc03-10132bf7ac0a service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:50.418883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e05e43-7f0b-44e7-bc03-10132bf7ac0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:50.419172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e05e43-7f0b-44e7-bc03-10132bf7ac0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:50.421306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233fa2e-66b0-456b-8aca-62eb6b9a7e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:50.423103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233fa2e-66b0-456b-8aca-62eb6b9a7e5e service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:50.425292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233fa2e-66b0-456b-8aca-62eb6b9a7e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:50.425717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233fa2e-66b0-456b-8aca-62eb6b9a7e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:50.441491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e05e43-7f0b-44e7-bc03-10132bf7ac0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:50.442965 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e05e43-7f0b-44e7-bc03-10132bf7ac0a service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:50.451233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233fa2e-66b0-456b-8aca-62eb6b9a7e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:50.458112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233fa2e-66b0-456b-8aca-62eb6b9a7e5e service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:50.470619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 901/1808] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:50.472195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e05e43-7f0b-44e7-bc03-10132bf7ac0a service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:50.476926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-68e05e43-7f0b-44e7-bc03-10132bf7ac0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:50.479168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 908/1809] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:50.502189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e05e43-7f0b-44e7-bc03-10132bf7ac0a service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:50.518926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:50.519818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:50.520131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:50.520417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] PATH_INFO: `/v3/projects/e71beaa31d184ea2b9efd1da56e67692` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:50.524887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71beaa31d184ea2b9efd1da56e67692)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:50.526902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:50.652141 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71beaa31d184ea2b9efd1da56e67692', 'request_id': 'req-c88f86b8-f813-490c-b242-7e4722c2a964'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:50.664514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71beaa31d184ea2b9efd1da56e67692', 'request_id': 'req-c88f86b8-f813-490c-b242-7e4722c2a964'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:50.683644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71beaa31d184ea2b9efd1da56e67692', 'request_id': 'req-c88f86b8-f813-490c-b242-7e4722c2a964'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:50.703686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] The token cache is being invalidate because project e71beaa31d184ea2b9efd1da56e67692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:50.703988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:50.706978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c88f86b8-f813-490c-b242-7e4722c2a964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:50.712369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 902/1810] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:50 2022] DELETE /identity/v3/projects/e71beaa31d184ea2b9efd1da56e67692 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:50.714496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233fa2e-66b0-456b-8aca-62eb6b9a7e5e service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:50.743068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233fa2e-66b0-456b-8aca-62eb6b9a7e5e service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:50.778453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eee45-545f-47be-803c-134297bd373e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:50.778745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eee45-545f-47be-803c-134297bd373e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:50.779030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eee45-545f-47be-803c-134297bd373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:50.837635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-837eee45-545f-47be-803c-134297bd373e None None] MFA Rules not processed for user `a26c582b69ae406ab7acdda01a332b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:50.838889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-837eee45-545f-47be-803c-134297bd373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:51.007252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 903/1811] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:51.071014 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44687fad-ee8b-4cab-aec4-83afe738c206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:51.073615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44687fad-ee8b-4cab-aec4-83afe738c206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:51.073886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44687fad-ee8b-4cab-aec4-83afe738c206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:51.074916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44687fad-ee8b-4cab-aec4-83afe738c206 admin admin] PATH_INFO: `/v3/users/25433127cb184dcfa6280d6a39d95e0b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:51.082449 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44687fad-ee8b-4cab-aec4-83afe738c206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25433127cb184dcfa6280d6a39d95e0b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:51.093504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44687fad-ee8b-4cab-aec4-83afe738c206 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:51.258609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-44687fad-ee8b-4cab-aec4-83afe738c206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25433127cb184dcfa6280d6a39d95e0b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:51.288402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-44687fad-ee8b-4cab-aec4-83afe738c206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25433127cb184dcfa6280d6a39d95e0b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:51.304076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-44687fad-ee8b-4cab-aec4-83afe738c206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25433127cb184dcfa6280d6a39d95e0b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:51.305631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-44687fad-ee8b-4cab-aec4-83afe738c206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25433127cb184dcfa6280d6a39d95e0b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:51.319890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-44687fad-ee8b-4cab-aec4-83afe738c206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25433127cb184dcfa6280d6a39d95e0b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:51.322995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:51.330694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 909/1812] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:50 2022] DELETE /identity/v3/users/25433127cb184dcfa6280d6a39d95e0b => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:51.713987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995938-a229-4a18-b21c-df7f52212c29 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:51.714556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995938-a229-4a18-b21c-df7f52212c29 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:51.714782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995938-a229-4a18-b21c-df7f52212c29 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:51.716951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 904/1813] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:23:51.755871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4559-c07e-4361-a6a0-929c0afe651d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:51.756535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4559-c07e-4361-a6a0-929c0afe651d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:51.756535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4559-c07e-4361-a6a0-929c0afe651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:51.791799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2b6e4559-c07e-4361-a6a0-929c0afe651d None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:51.793100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2b6e4559-c07e-4361-a6a0-929c0afe651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:51.981328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 910/1814] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:52.685401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83995938-a229-4a18-b21c-df7f52212c29 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:52.687609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-83995938-a229-4a18-b21c-df7f52212c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:52.728927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83995938-a229-4a18-b21c-df7f52212c29 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:52.749311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5e4bb-2647-4078-8a07-d33715a664d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:52.751679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5e4bb-2647-4078-8a07-d33715a664d7 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:52.752132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5e4bb-2647-4078-8a07-d33715a664d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:52.753052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5e4bb-2647-4078-8a07-d33715a664d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:52.777500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5e4bb-2647-4078-8a07-d33715a664d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:52.781115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5e4bb-2647-4078-8a07-d33715a664d7 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:52.786669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ba53-b863-4696-9d92-f48ee16176cc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:52.787240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ba53-b863-4696-9d92-f48ee16176cc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:52.787240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ba53-b863-4696-9d92-f48ee16176cc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:52.788716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 911/1815] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:23:52.797443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 905/1816] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:52.859080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f02e2-6b43-4fc7-ab00-ffda3e0ad8cf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:52.859371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f02e2-6b43-4fc7-ab00-ffda3e0ad8cf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:52.859656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f02e2-6b43-4fc7-ab00-ffda3e0ad8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:52.910973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5c4f02e2-6b43-4fc7-ab00-ffda3e0ad8cf None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:52.912477 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5c4f02e2-6b43-4fc7-ab00-ffda3e0ad8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:52.923186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 912/1817] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:23:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:52.958725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5e4bb-2647-4078-8a07-d33715a664d7 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:52.960255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7ae5e4bb-2647-4078-8a07-d33715a664d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:52.983117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5e4bb-2647-4078-8a07-d33715a664d7 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:53.003962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a353e-7605-4d59-913d-e78be1a450df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:53.004849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a353e-7605-4d59-913d-e78be1a450df service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:53.005283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a353e-7605-4d59-913d-e78be1a450df service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:53.005978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a353e-7605-4d59-913d-e78be1a450df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:53.026079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a353e-7605-4d59-913d-e78be1a450df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:53.029858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a353e-7605-4d59-913d-e78be1a450df service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:53.049022 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 906/1818] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:53.241225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f02e2-6b43-4fc7-ab00-ffda3e0ad8cf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:53.243186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5c4f02e2-6b43-4fc7-ab00-ffda3e0ad8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:53.392500 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f02e2-6b43-4fc7-ab00-ffda3e0ad8cf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:53.398039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:53.399279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:53.399867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:53.400342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] PATH_INFO: `/v3/projects/045b75164f65435da5bc351a5c8fdf00` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:53.401838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=045b75164f65435da5bc351a5c8fdf00)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:53.404204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:53.483957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045b75164f65435da5bc351a5c8fdf00', 'request_id': 'req-30c59a2b-33ee-41c2-b364-151a43933f54'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.492394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045b75164f65435da5bc351a5c8fdf00', 'request_id': 'req-30c59a2b-33ee-41c2-b364-151a43933f54'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.499531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045b75164f65435da5bc351a5c8fdf00', 'request_id': 'req-30c59a2b-33ee-41c2-b364-151a43933f54'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.519938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] The token cache is being invalidate because project 045b75164f65435da5bc351a5c8fdf00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:53.520273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.520946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.523299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 913/1819] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:53 2022] DELETE /identity/v3/projects/045b75164f65435da5bc351a5c8fdf00 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:53.527091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a353e-7605-4d59-913d-e78be1a450df service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:53.543092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a353e-7605-4d59-913d-e78be1a450df service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:53.548701 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:53.626921 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:53.628777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:53.629159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:53.629537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] PATH_INFO: `/v3/users/d0e78669b7b84a87abb3ddb07721639c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:53.630958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e78669b7b84a87abb3ddb07721639c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:53.632944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:53.712275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:53.713822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:53.721430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e78669b7b84a87abb3ddb07721639c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.732409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c59a2b-33ee-41c2-b364-151a43933f54 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:53.738096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:53.738547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e78669b7b84a87abb3ddb07721639c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.739450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:53.739837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:53.740261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] PATH_INFO: `/v3/projects/5809199775384da5821f28464d6daa6a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:53.741653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5809199775384da5821f28464d6daa6a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:53.743861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:53.747268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e78669b7b84a87abb3ddb07721639c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.748321 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e78669b7b84a87abb3ddb07721639c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.756255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:53.757456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e78669b7b84a87abb3ddb07721639c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.766342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 907/1820] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:53 2022] DELETE /identity/v3/users/d0e78669b7b84a87abb3ddb07721639c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:53.797760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5809199775384da5821f28464d6daa6a', 'request_id': 'req-b1519fdb-d4c5-4475-abcb-6acf207658c0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.807102 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5809199775384da5821f28464d6daa6a', 'request_id': 'req-b1519fdb-d4c5-4475-abcb-6acf207658c0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.813508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5809199775384da5821f28464d6daa6a', 'request_id': 'req-b1519fdb-d4c5-4475-abcb-6acf207658c0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.837419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] The token cache is being invalidate because project 5809199775384da5821f28464d6daa6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:53.837723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.838454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1519fdb-d4c5-4475-abcb-6acf207658c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:53.840091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 914/1821] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:53 2022] DELETE /identity/v3/projects/5809199775384da5821f28464d6daa6a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:53.844102 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:53.845485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:53.910100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252069a-5714-424d-b1d6-3ef3288728be admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:53.941853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:53.974057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fb682-4faf-4a42-8408-4b42eeef1e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:53.975039 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fb682-4faf-4a42-8408-4b42eeef1e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:53.975395 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fb682-4faf-4a42-8408-4b42eeef1e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:53.975744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fb682-4faf-4a42-8408-4b42eeef1e94 admin admin] PATH_INFO: `/v3/users/88fd5f15e70c466e91d3d1d378a203c5` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:53.977074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fb682-4faf-4a42-8408-4b42eeef1e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88fd5f15e70c466e91d3d1d378a203c5)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:53.979082 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fb682-4faf-4a42-8408-4b42eeef1e94 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:54.055370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d76fb682-4faf-4a42-8408-4b42eeef1e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88fd5f15e70c466e91d3d1d378a203c5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:54.083356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d76fb682-4faf-4a42-8408-4b42eeef1e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88fd5f15e70c466e91d3d1d378a203c5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:54.093840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d76fb682-4faf-4a42-8408-4b42eeef1e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88fd5f15e70c466e91d3d1d378a203c5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:54.094733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d76fb682-4faf-4a42-8408-4b42eeef1e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88fd5f15e70c466e91d3d1d378a203c5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:54.105016 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d76fb682-4faf-4a42-8408-4b42eeef1e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88fd5f15e70c466e91d3d1d378a203c5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:54.122821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 908/1822] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:53 2022] DELETE /identity/v3/users/88fd5f15e70c466e91d3d1d378a203c5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:54.219979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c026-97c6-4d40-a21d-4d1c063078b6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:54.220404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c026-97c6-4d40-a21d-4d1c063078b6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:54.220697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c026-97c6-4d40-a21d-4d1c063078b6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:54.222927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 915/1823] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:23:54.245944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4045-c4d7-4c5a-97f4-2e42610a98f2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:54.246274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4045-c4d7-4c5a-97f4-2e42610a98f2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:54.247907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4045-c4d7-4c5a-97f4-2e42610a98f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:54.275622 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7d9c4045-c4d7-4c5a-97f4-2e42610a98f2 None None] MFA Rules not processed for user `c89ae81d49214b75a747a6cfa3ddf0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:54.276892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7d9c4045-c4d7-4c5a-97f4-2e42610a98f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:54.309171 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51c026-97c6-4d40-a21d-4d1c063078b6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:54.311747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0e51c026-97c6-4d40-a21d-4d1c063078b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:54.461849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 909/1824] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:23:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:54.488172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c4045-c4d7-4c5a-97f4-2e42610a98f2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:54.489946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7d9c4045-c4d7-4c5a-97f4-2e42610a98f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:54.508824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c4045-c4d7-4c5a-97f4-2e42610a98f2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:54.521955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f38d9-07df-4e60-b0a9-c6455af61c8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:54.522737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f38d9-07df-4e60-b0a9-c6455af61c8a service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:54.523050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f38d9-07df-4e60-b0a9-c6455af61c8a service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:54.523362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f38d9-07df-4e60-b0a9-c6455af61c8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:54.528057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51c026-97c6-4d40-a21d-4d1c063078b6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:54.534679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:54.535883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:54.536470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:54.536973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f38d9-07df-4e60-b0a9-c6455af61c8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:54.537350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] PATH_INFO: `/v3/projects/f01fea00cef84af1a57a15cbe9fc3c0c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:54.539350 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f38d9-07df-4e60-b0a9-c6455af61c8a service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:54.554784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 910/1825] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:23:54.556390 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01fea00cef84af1a57a15cbe9fc3c0c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:54.559529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:54.758090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01fea00cef84af1a57a15cbe9fc3c0c', 'request_id': 'req-8948097f-9950-42ea-9494-042a499e8184'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:54.766387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01fea00cef84af1a57a15cbe9fc3c0c', 'request_id': 'req-8948097f-9950-42ea-9494-042a499e8184'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:54.778952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01fea00cef84af1a57a15cbe9fc3c0c', 'request_id': 'req-8948097f-9950-42ea-9494-042a499e8184'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:54.797185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] The token cache is being invalidate because project f01fea00cef84af1a57a15cbe9fc3c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:54.797537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:54.798337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f38d9-07df-4e60-b0a9-c6455af61c8a service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:54.798776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8948097f-9950-42ea-9494-042a499e8184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:54.799916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2b6f38d9-07df-4e60-b0a9-c6455af61c8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:54.801240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 916/1826] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:54 2022] DELETE /identity/v3/projects/f01fea00cef84af1a57a15cbe9fc3c0c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:54.813576 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490417fe-6f75-4367-91b9-12df01bb9be5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:54.813898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490417fe-6f75-4367-91b9-12df01bb9be5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:54.814162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490417fe-6f75-4367-91b9-12df01bb9be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:54.832424 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f38d9-07df-4e60-b0a9-c6455af61c8a service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:54.848536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-490417fe-6f75-4367-91b9-12df01bb9be5 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:54.849902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-490417fe-6f75-4367-91b9-12df01bb9be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:54.880111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:54.899562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:54.921564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 917/1827] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:54.922824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490417fe-6f75-4367-91b9-12df01bb9be5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:54.924417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-490417fe-6f75-4367-91b9-12df01bb9be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:54.933035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:54.933953 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:54.934393 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:54.934877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] PATH_INFO: `/v3/projects/315b97234ef5430f8652f423b1eeee5e` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:54.936431 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=315b97234ef5430f8652f423b1eeee5e)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:54.936885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490417fe-6f75-4367-91b9-12df01bb9be5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:54.939787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:54.947494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:54.948649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:54.949137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:54.949743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] PATH_INFO: `/v3/projects/3c1868ad463042bebe13609293b1ee99` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:54.951447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1868ad463042bebe13609293b1ee99)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:54.953980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:55.010612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315b97234ef5430f8652f423b1eeee5e', 'request_id': 'req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.013940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1868ad463042bebe13609293b1ee99', 'request_id': 'req-fb777a54-8054-49fb-9dbb-391ab89bbb42'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.019000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315b97234ef5430f8652f423b1eeee5e', 'request_id': 'req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.020561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1868ad463042bebe13609293b1ee99', 'request_id': 'req-fb777a54-8054-49fb-9dbb-391ab89bbb42'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.025936 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315b97234ef5430f8652f423b1eeee5e', 'request_id': 'req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.027153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1868ad463042bebe13609293b1ee99', 'request_id': 'req-fb777a54-8054-49fb-9dbb-391ab89bbb42'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.042168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] The token cache is being invalidate because project 315b97234ef5430f8652f423b1eeee5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:55.042463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.043105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d77f927d-9e2e-4c4d-9a7b-259ba1b81022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.048071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 911/1828] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:54 2022] DELETE /identity/v3/projects/315b97234ef5430f8652f423b1eeee5e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:55.048211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] The token cache is being invalidate because project 3c1868ad463042bebe13609293b1ee99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:55.048211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.048370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3a89a-7e5d-4b3a-9eab-9f15af5e4c37 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.048370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3a89a-7e5d-4b3a-9eab-9f15af5e4c37 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.048490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fb777a54-8054-49fb-9dbb-391ab89bbb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.048561 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3a89a-7e5d-4b3a-9eab-9f15af5e4c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.049733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 918/1829] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:54 2022] DELETE /identity/v3/projects/3c1868ad463042bebe13609293b1ee99 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:55.051100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ca6aa-a555-49b2-ae3c-b18a7bcee6fd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.051457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ca6aa-a555-49b2-ae3c-b18a7bcee6fd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.051808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ca6aa-a555-49b2-ae3c-b18a7bcee6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.071688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b7f3a89a-7e5d-4b3a-9eab-9f15af5e4c37 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:55.073238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b7f3a89a-7e5d-4b3a-9eab-9f15af5e4c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:55.084286 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-415ca6aa-a555-49b2-ae3c-b18a7bcee6fd None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:55.085252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-415ca6aa-a555-49b2-ae3c-b18a7bcee6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:55.149405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 912/1830] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:55.149828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3a89a-7e5d-4b3a-9eab-9f15af5e4c37 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:55.151365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b7f3a89a-7e5d-4b3a-9eab-9f15af5e4c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:55.170021 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3a89a-7e5d-4b3a-9eab-9f15af5e4c37 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:55.175574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:55.176940 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.177341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.177728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] PATH_INFO: `/v3/users/943639d87aea4f688b5caaf5e3a19c1d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.179573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=943639d87aea4f688b5caaf5e3a19c1d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:55.182065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:55.184170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 919/1831] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:55.185133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ca6aa-a555-49b2-ae3c-b18a7bcee6fd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:55.187054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-415ca6aa-a555-49b2-ae3c-b18a7bcee6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:55.222719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ca6aa-a555-49b2-ae3c-b18a7bcee6fd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:55.228566 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78d99f-943d-4d2e-b3f7-b8203ad402c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:55.229556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d99f-943d-4d2e-b3f7-b8203ad402c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.229748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d99f-943d-4d2e-b3f7-b8203ad402c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.230078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d99f-943d-4d2e-b3f7-b8203ad402c7 admin admin] PATH_INFO: `/v3/users/54456ce5f68d46b3bba5554e21bf36c4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.231234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78d99f-943d-4d2e-b3f7-b8203ad402c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54456ce5f68d46b3bba5554e21bf36c4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:55.233223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78d99f-943d-4d2e-b3f7-b8203ad402c7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:55.247673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943639d87aea4f688b5caaf5e3a19c1d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.260535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:55.264399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943639d87aea4f688b5caaf5e3a19c1d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.301344 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943639d87aea4f688b5caaf5e3a19c1d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.303356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943639d87aea4f688b5caaf5e3a19c1d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.318031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943639d87aea4f688b5caaf5e3a19c1d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.326772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 913/1832] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:55 2022] DELETE /identity/v3/users/943639d87aea4f688b5caaf5e3a19c1d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:55.327613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:55.328358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ad78d99f-943d-4d2e-b3f7-b8203ad402c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54456ce5f68d46b3bba5554e21bf36c4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.329028 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:55.330269 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:55.348739 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ad78d99f-943d-4d2e-b3f7-b8203ad402c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54456ce5f68d46b3bba5554e21bf36c4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.359370 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ad78d99f-943d-4d2e-b3f7-b8203ad402c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54456ce5f68d46b3bba5554e21bf36c4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.360396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ad78d99f-943d-4d2e-b3f7-b8203ad402c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54456ce5f68d46b3bba5554e21bf36c4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.371206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ad78d99f-943d-4d2e-b3f7-b8203ad402c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54456ce5f68d46b3bba5554e21bf36c4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:55.383385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 920/1833] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:55 2022] DELETE /identity/v3/users/54456ce5f68d46b3bba5554e21bf36c4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:55.386382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb344f-0306-470d-b95d-1c45352595ee None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.387195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb344f-0306-470d-b95d-1c45352595ee None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.387618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb344f-0306-470d-b95d-1c45352595ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.414339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-98fb344f-0306-470d-b95d-1c45352595ee None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:55.415971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-98fb344f-0306-470d-b95d-1c45352595ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:55.456969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22df9e-a894-456e-ae02-74e5cfdb63e6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:55.523544 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 921/1834] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:55.542640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af6272-f85e-4034-8af8-6c1e035ad225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:55.543500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af6272-f85e-4034-8af8-6c1e035ad225 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.543792 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af6272-f85e-4034-8af8-6c1e035ad225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.544509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af6272-f85e-4034-8af8-6c1e035ad225 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.545616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af6272-f85e-4034-8af8-6c1e035ad225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:55.545933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af6272-f85e-4034-8af8-6c1e035ad225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:55.548072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af6272-f85e-4034-8af8-6c1e035ad225 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:55.551337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb344f-0306-470d-b95d-1c45352595ee None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:55.566769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 914/1835] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:55.567870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af6272-f85e-4034-8af8-6c1e035ad225 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:55.569695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-36af6272-f85e-4034-8af8-6c1e035ad225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:55.574416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb344f-0306-470d-b95d-1c45352595ee None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:55.579736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadc0b7-b6ee-4173-bc3a-d6c389391a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:55.580727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadc0b7-b6ee-4173-bc3a-d6c389391a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.581164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadc0b7-b6ee-4173-bc3a-d6c389391a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.581628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadc0b7-b6ee-4173-bc3a-d6c389391a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.582565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadc0b7-b6ee-4173-bc3a-d6c389391a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:55.583062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadc0b7-b6ee-4173-bc3a-d6c389391a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:55.583279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af6272-f85e-4034-8af8-6c1e035ad225 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:55.585214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadc0b7-b6ee-4173-bc3a-d6c389391a4b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:55.589604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929970f-b728-4320-a788-c1178bfc59b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:55.590276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929970f-b728-4320-a788-c1178bfc59b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.590562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929970f-b728-4320-a788-c1178bfc59b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.590898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929970f-b728-4320-a788-c1178bfc59b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.591605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929970f-b728-4320-a788-c1178bfc59b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:55.593544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929970f-b728-4320-a788-c1178bfc59b8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:55.602356 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 922/1836] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:55.610203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadc0b7-b6ee-4173-bc3a-d6c389391a4b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:55.634355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadc0b7-b6ee-4173-bc3a-d6c389391a4b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:55.640577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 915/1837] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:55 2022] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:55.642045 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929970f-b728-4320-a788-c1178bfc59b8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:55.732687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6bfd5-ec1b-4d25-84e1-cb9a0b76a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:55.734101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6bfd5-ec1b-4d25-84e1-cb9a0b76a19b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.734621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6bfd5-ec1b-4d25-84e1-cb9a0b76a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.734906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6bfd5-ec1b-4d25-84e1-cb9a0b76a19b admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.735784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6bfd5-ec1b-4d25-84e1-cb9a0b76a19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:55.738519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6bfd5-ec1b-4d25-84e1-cb9a0b76a19b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:55.746611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:55.752893 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929970f-b728-4320-a788-c1178bfc59b8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:55.763405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd07e34-4ec9-481f-a491-ec04d553748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:55.763405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd07e34-4ec9-481f-a491-ec04d553748a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.763405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd07e34-4ec9-481f-a491-ec04d553748a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.763959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd07e34-4ec9-481f-a491-ec04d553748a admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.765617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd07e34-4ec9-481f-a491-ec04d553748a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:55.769072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd07e34-4ec9-481f-a491-ec04d553748a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:55.790209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 923/1838] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:55 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:55.790209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6bfd5-ec1b-4d25-84e1-cb9a0b76a19b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:55.790209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-13d6bfd5-ec1b-4d25-84e1-cb9a0b76a19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:55.812194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 916/1839] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:55 2022] POST /identity/v3/users => generated 305 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:55.812194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd07e34-4ec9-481f-a491-ec04d553748a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:55.849102 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd07e34-4ec9-481f-a491-ec04d553748a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:55.855554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:55.911584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6bfd5-ec1b-4d25-84e1-cb9a0b76a19b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:55.921795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:55.923031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.923476 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.924660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] PATH_INFO: `/v3/projects/5a3047dd19b0419892fe0579549c6d92` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.928329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3047dd19b0419892fe0579549c6d92)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:55.930464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:55.960845 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66df43-aa51-420c-a63e-e821ede2da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:55.961555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66df43-aa51-420c-a63e-e821ede2da8e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:55.962217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66df43-aa51-420c-a63e-e821ede2da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:55.962504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66df43-aa51-420c-a63e-e821ede2da8e admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:55.964385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66df43-aa51-420c-a63e-e821ede2da8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:55.966408 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66df43-aa51-420c-a63e-e821ede2da8e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.001128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 917/1840] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:55 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:56.002144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66df43-aa51-420c-a63e-e821ede2da8e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.031808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66df43-aa51-420c-a63e-e821ede2da8e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:56.046109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3047dd19b0419892fe0579549c6d92', 'request_id': 'req-475c2e8c-4541-4a9c-8725-f50c0921935f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.061692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3047dd19b0419892fe0579549c6d92', 'request_id': 'req-475c2e8c-4541-4a9c-8725-f50c0921935f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.073482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3047dd19b0419892fe0579549c6d92', 'request_id': 'req-475c2e8c-4541-4a9c-8725-f50c0921935f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.098501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] The token cache is being invalidate because project 5a3047dd19b0419892fe0579549c6d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:56.098703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.099483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.102609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 924/1841] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:55 2022] DELETE /identity/v3/projects/5a3047dd19b0419892fe0579549c6d92 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:56.106083 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.110096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.115680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf81d5c-2290-450c-a7fa-20d779d88f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:56.127352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf81d5c-2290-450c-a7fa-20d779d88f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.127768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf81d5c-2290-450c-a7fa-20d779d88f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.128110 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf81d5c-2290-450c-a7fa-20d779d88f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.129059 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf81d5c-2290-450c-a7fa-20d779d88f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:56.131710 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf81d5c-2290-450c-a7fa-20d779d88f88 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.132521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c2e8c-4541-4a9c-8725-f50c0921935f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:56.139259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:56.140754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.141412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.141755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] PATH_INFO: `/v3/projects/8fb470f1869e4eac9dbf81ce636f2c40` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.143634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb470f1869e4eac9dbf81ce636f2c40)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:56.146228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 918/1842] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:56.147117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf81d5c-2290-450c-a7fa-20d779d88f88 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.149069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.149906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2bf81d5c-2290-450c-a7fa-20d779d88f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.166140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf81d5c-2290-450c-a7fa-20d779d88f88 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:56.172476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621feb2-31a9-461d-9cc4-9c22eb3cd207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:56.173159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621feb2-31a9-461d-9cc4-9c22eb3cd207 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.173448 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621feb2-31a9-461d-9cc4-9c22eb3cd207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.173729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621feb2-31a9-461d-9cc4-9c22eb3cd207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.174997 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621feb2-31a9-461d-9cc4-9c22eb3cd207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:56.176651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621feb2-31a9-461d-9cc4-9c22eb3cd207 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.190705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 919/1843] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:56.191666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621feb2-31a9-461d-9cc4-9c22eb3cd207 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.193986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d621feb2-31a9-461d-9cc4-9c22eb3cd207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.208882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621feb2-31a9-461d-9cc4-9c22eb3cd207 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:56.209073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb470f1869e4eac9dbf81ce636f2c40', 'request_id': 'req-f6e2ff40-3a9c-41ff-b354-c2312184f77b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.216497 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb470f1869e4eac9dbf81ce636f2c40', 'request_id': 'req-f6e2ff40-3a9c-41ff-b354-c2312184f77b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.223624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb470f1869e4eac9dbf81ce636f2c40', 'request_id': 'req-f6e2ff40-3a9c-41ff-b354-c2312184f77b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.240149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] The token cache is being invalidate because project 8fb470f1869e4eac9dbf81ce636f2c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:56.240444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.241113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.242915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 925/1844] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:56 2022] DELETE /identity/v3/projects/8fb470f1869e4eac9dbf81ce636f2c40 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:56.247858 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.249318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.277757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b89f3f-0cf6-46d5-9d3e-ac3b1ba95a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:56.278639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b89f3f-0cf6-46d5-9d3e-ac3b1ba95a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.278926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b89f3f-0cf6-46d5-9d3e-ac3b1ba95a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.279204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b89f3f-0cf6-46d5-9d3e-ac3b1ba95a1f admin admin] PATH_INFO: `/v3/users/a26c582b69ae406ab7acdda01a332b94` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.280428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b89f3f-0cf6-46d5-9d3e-ac3b1ba95a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26c582b69ae406ab7acdda01a332b94)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:56.282365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b89f3f-0cf6-46d5-9d3e-ac3b1ba95a1f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.285787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:56.311578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:56.331257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2ff40-3a9c-41ff-b354-c2312184f77b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:56.336906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f807811-66d5-4fd6-a7ff-6bd971f7aebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:56.337633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f807811-66d5-4fd6-a7ff-6bd971f7aebc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.337977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f807811-66d5-4fd6-a7ff-6bd971f7aebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.338133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f807811-66d5-4fd6-a7ff-6bd971f7aebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.339243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f807811-66d5-4fd6-a7ff-6bd971f7aebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:56.340889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f807811-66d5-4fd6-a7ff-6bd971f7aebc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.342657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-95b89f3f-0cf6-46d5-9d3e-ac3b1ba95a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26c582b69ae406ab7acdda01a332b94'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.352164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 926/1845] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:56.352782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f807811-66d5-4fd6-a7ff-6bd971f7aebc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.354494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1f807811-66d5-4fd6-a7ff-6bd971f7aebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.358681 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-95b89f3f-0cf6-46d5-9d3e-ac3b1ba95a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26c582b69ae406ab7acdda01a332b94'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.366455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-95b89f3f-0cf6-46d5-9d3e-ac3b1ba95a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26c582b69ae406ab7acdda01a332b94'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.366939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f807811-66d5-4fd6-a7ff-6bd971f7aebc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:56.367266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-95b89f3f-0cf6-46d5-9d3e-ac3b1ba95a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26c582b69ae406ab7acdda01a332b94'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.371980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9526d-e3cf-42ef-a8eb-4eb50993c29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:56.372661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9526d-e3cf-42ef-a8eb-4eb50993c29e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.372951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9526d-e3cf-42ef-a8eb-4eb50993c29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.373232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9526d-e3cf-42ef-a8eb-4eb50993c29e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.373956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9526d-e3cf-42ef-a8eb-4eb50993c29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:56.374418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-95b89f3f-0cf6-46d5-9d3e-ac3b1ba95a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26c582b69ae406ab7acdda01a332b94'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.375549 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9526d-e3cf-42ef-a8eb-4eb50993c29e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.381189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 920/1846] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:56 2022] DELETE /identity/v3/users/a26c582b69ae406ab7acdda01a332b94 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:56.382736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f76f70-2be3-43cb-90e1-ad63943cbcc7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.382999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f76f70-2be3-43cb-90e1-ad63943cbcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.383282 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f76f70-2be3-43cb-90e1-ad63943cbcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.389303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 927/1847] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:56.389303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9526d-e3cf-42ef-a8eb-4eb50993c29e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.390897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ae9526d-e3cf-42ef-a8eb-4eb50993c29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.405840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-39f76f70-2be3-43cb-90e1-ad63943cbcc7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:56.407161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-39f76f70-2be3-43cb-90e1-ad63943cbcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.407321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9526d-e3cf-42ef-a8eb-4eb50993c29e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:56.476896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5ef45-5f83-487a-9113-394c1b4dea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:56.477364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 921/1848] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:56.477812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5ef45-5f83-487a-9113-394c1b4dea00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.478106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5ef45-5f83-487a-9113-394c1b4dea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.478225 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f76f70-2be3-43cb-90e1-ad63943cbcc7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.478408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5ef45-5f83-487a-9113-394c1b4dea00 admin admin] PATH_INFO: `/v3/projects/2c8be4622e744ee5974de1f268d8f1dd/users/6f1ecfc2d9034c75a095f1e1b3bec8b7/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.479919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-39f76f70-2be3-43cb-90e1-ad63943cbcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.492743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f76f70-2be3-43cb-90e1-ad63943cbcc7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:56.499405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f7b10-a861-4ea7-b94a-6d20f2f65bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:56.500362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f7b10-a861-4ea7-b94a-6d20f2f65bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.500650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f7b10-a861-4ea7-b94a-6d20f2f65bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.500926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f7b10-a861-4ea7-b94a-6d20f2f65bb5 admin admin] PATH_INFO: `/v3/projects/29f165a13de3459884e2a6738d25c898/users/1ee54c493b724df69b464d02b4f1fcb5/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.511406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5ef45-5f83-487a-9113-394c1b4dea00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8be4622e744ee5974de1f268d8f1dd, user_id=6f1ecfc2d9034c75a095f1e1b3bec8b7, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:56.514855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5ef45-5f83-487a-9113-394c1b4dea00 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.527667 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f7b10-a861-4ea7-b94a-6d20f2f65bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f165a13de3459884e2a6738d25c898, user_id=1ee54c493b724df69b464d02b4f1fcb5, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:56.531611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 928/1849] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:56 2022] PUT /identity/v3/projects/2c8be4622e744ee5974de1f268d8f1dd/users/6f1ecfc2d9034c75a095f1e1b3bec8b7/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:56.535141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58502e1-3e54-40f3-a374-c0fe545d39ea None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.535437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58502e1-3e54-40f3-a374-c0fe545d39ea None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.535721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58502e1-3e54-40f3-a374-c0fe545d39ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.536180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f7b10-a861-4ea7-b94a-6d20f2f65bb5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.557277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 922/1850] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:56 2022] PUT /identity/v3/projects/29f165a13de3459884e2a6738d25c898/users/1ee54c493b724df69b464d02b4f1fcb5/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:56.559158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51aad8-2d1c-40c7-9e2e-27522eab69f9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.559461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51aad8-2d1c-40c7-9e2e-27522eab69f9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.559746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51aad8-2d1c-40c7-9e2e-27522eab69f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.566138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e58502e1-3e54-40f3-a374-c0fe545d39ea None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:56.567813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e58502e1-3e54-40f3-a374-c0fe545d39ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.603268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fd51aad8-2d1c-40c7-9e2e-27522eab69f9 None None] MFA Rules not processed for user `6f1ecfc2d9034c75a095f1e1b3bec8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:56.618331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fd51aad8-2d1c-40c7-9e2e-27522eab69f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.685844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 929/1851] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:56.687469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2f84b-2e22-4ae8-a289-efb3176adaca None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.687909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2f84b-2e22-4ae8-a289-efb3176adaca None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.688345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2f84b-2e22-4ae8-a289-efb3176adaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.728361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:56.745616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-50f2f84b-2e22-4ae8-a289-efb3176adaca None None] MFA Rules not processed for user `1ee54c493b724df69b464d02b4f1fcb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:56.746882 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-50f2f84b-2e22-4ae8-a289-efb3176adaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.784844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 923/1852] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:56.788717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51aad8-2d1c-40c7-9e2e-27522eab69f9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.809691 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51aad8-2d1c-40c7-9e2e-27522eab69f9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:56.817620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:56.818795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3113-2971-4e81-93f7-555616a284e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:56.819792 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3113-2971-4e81-93f7-555616a284e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.820332 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3113-2971-4e81-93f7-555616a284e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.820723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3113-2971-4e81-93f7-555616a284e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.821726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff3113-2971-4e81-93f7-555616a284e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:56.822135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff3113-2971-4e81-93f7-555616a284e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:56.825155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff3113-2971-4e81-93f7-555616a284e5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.848801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 924/1853] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:56.848801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3113-2971-4e81-93f7-555616a284e5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.860379 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 930/1854] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:56.862982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2f84b-2e22-4ae8-a289-efb3176adaca None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.864695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-50f2f84b-2e22-4ae8-a289-efb3176adaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.868266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3113-2971-4e81-93f7-555616a284e5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:56.881879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8d46c-44a2-40a9-9e31-2459568f1eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:56.882558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8d46c-44a2-40a9-9e31-2459568f1eba admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.882649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2f84b-2e22-4ae8-a289-efb3176adaca None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:56.883008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8d46c-44a2-40a9-9e31-2459568f1eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.883302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8d46c-44a2-40a9-9e31-2459568f1eba admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.883996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8d46c-44a2-40a9-9e31-2459568f1eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:56.885941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8d46c-44a2-40a9-9e31-2459568f1eba admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.887839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:56.889313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:56.889313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:56.889528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] PATH_INFO: `/v3/projects/c2c76169c88d41668459e06d4b5d0601` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:56.890717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c76169c88d41668459e06d4b5d0601)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:56.892954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:56.926273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 925/1855] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:56 2022] POST /identity/v3/projects => generated 409 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:56.926273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8d46c-44a2-40a9-9e31-2459568f1eba admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.965929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c76169c88d41668459e06d4b5d0601', 'request_id': 'req-9e4d1b0e-4211-4498-b236-932548e825ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.973100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c76169c88d41668459e06d4b5d0601', 'request_id': 'req-9e4d1b0e-4211-4498-b236-932548e825ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.978767 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c76169c88d41668459e06d4b5d0601', 'request_id': 'req-9e4d1b0e-4211-4498-b236-932548e825ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.991255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] The token cache is being invalidate because project c2c76169c88d41668459e06d4b5d0601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:23:56.991527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.992225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:56.993815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 931/1856] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:23:56 2022] DELETE /identity/v3/projects/c2c76169c88d41668459e06d4b5d0601 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:56.994607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:56.995935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:56.997543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8d46c-44a2-40a9-9e31-2459568f1eba admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.071195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d1b0e-4211-4498-b236-932548e825ef admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.079195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bebc8-9890-4273-bd52-111d75e8d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.079674 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee9442-7925-4629-8699-5eda94c25bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.080069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bebc8-9890-4273-bd52-111d75e8d159 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.080380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee9442-7925-4629-8699-5eda94c25bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.080527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bebc8-9890-4273-bd52-111d75e8d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.081348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bebc8-9890-4273-bd52-111d75e8d159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.081453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee9442-7925-4629-8699-5eda94c25bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.081646 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee9442-7925-4629-8699-5eda94c25bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.082231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bebc8-9890-4273-bd52-111d75e8d159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.082337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee9442-7925-4629-8699-5eda94c25bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.084289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee9442-7925-4629-8699-5eda94c25bb5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.084420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bebc8-9890-4273-bd52-111d75e8d159 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.116044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 932/1857] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:56 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:57.116945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bebc8-9890-4273-bd52-111d75e8d159 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.118851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-198bebc8-9890-4273-bd52-111d75e8d159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:57.124990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 926/1858] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:56 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:57.128142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be0c7-3ffe-4b03-bbde-0689b4f8ab60 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.128679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be0c7-3ffe-4b03-bbde-0689b4f8ab60 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.130083 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be0c7-3ffe-4b03-bbde-0689b4f8ab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.161832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2b6be0c7-3ffe-4b03-bbde-0689b4f8ab60 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:57.162928 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2b6be0c7-3ffe-4b03-bbde-0689b4f8ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:57.201019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bebc8-9890-4273-bd52-111d75e8d159 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.202282 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:57.211247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:57.238831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 927/1859] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:57.239743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6be0c7-3ffe-4b03-bbde-0689b4f8ab60 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.260464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6be0c7-3ffe-4b03-bbde-0689b4f8ab60 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.273976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f205e6-2327-4a42-b225-036ce6808122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.274690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f205e6-2327-4a42-b225-036ce6808122 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.274969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f205e6-2327-4a42-b225-036ce6808122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.275250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f205e6-2327-4a42-b225-036ce6808122 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.275954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f205e6-2327-4a42-b225-036ce6808122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.277931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f205e6-2327-4a42-b225-036ce6808122 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.288580 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61892bed-7718-4bde-a7a5-557185b92d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.289258 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61892bed-7718-4bde-a7a5-557185b92d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.289546 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61892bed-7718-4bde-a7a5-557185b92d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.289823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61892bed-7718-4bde-a7a5-557185b92d82 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.290520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61892bed-7718-4bde-a7a5-557185b92d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.292458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61892bed-7718-4bde-a7a5-557185b92d82 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.298890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 928/1860] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:57 2022] POST /identity/v3/users => generated 290 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:57.299955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f205e6-2327-4a42-b225-036ce6808122 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.303475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-14f205e6-2327-4a42-b225-036ce6808122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:57.315431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 933/1861] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:57 2022] POST /identity/v3/users => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:57.315431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4154-7ab7-4cb4-ab98-28302564042b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.315431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4154-7ab7-4cb4-ab98-28302564042b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.315431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4154-7ab7-4cb4-ab98-28302564042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.315792 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f205e6-2327-4a42-b225-036ce6808122 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.319852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86875b2a-9ba6-4c98-be93-8708e9f76b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.320562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86875b2a-9ba6-4c98-be93-8708e9f76b2b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.320851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86875b2a-9ba6-4c98-be93-8708e9f76b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.321133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86875b2a-9ba6-4c98-be93-8708e9f76b2b admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.321819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86875b2a-9ba6-4c98-be93-8708e9f76b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.323749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86875b2a-9ba6-4c98-be93-8708e9f76b2b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.332588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-994d4154-7ab7-4cb4-ab98-28302564042b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:57.333760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-994d4154-7ab7-4cb4-ab98-28302564042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:57.341988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 934/1862] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:57.345703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 929/1863] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:57 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:57.345831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d4154-7ab7-4cb4-ab98-28302564042b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.345923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86875b2a-9ba6-4c98-be93-8708e9f76b2b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.353359 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86875b2a-9ba6-4c98-be93-8708e9f76b2b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.355560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d4154-7ab7-4cb4-ab98-28302564042b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.358252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d9668-68f3-43c3-9977-4d51416e3fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.359085 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d9668-68f3-43c3-9977-4d51416e3fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.359376 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d9668-68f3-43c3-9977-4d51416e3fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.359660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d9668-68f3-43c3-9977-4d51416e3fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.360187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b914-9d02-40c7-a5d9-3d73121a56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.360433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d9668-68f3-43c3-9977-4d51416e3fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.360841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b914-9d02-40c7-a5d9-3d73121a56c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.361127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b914-9d02-40c7-a5d9-3d73121a56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.361408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b914-9d02-40c7-a5d9-3d73121a56c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.362192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d9668-68f3-43c3-9977-4d51416e3fd4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.362299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838b914-9d02-40c7-a5d9-3d73121a56c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.363771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838b914-9d02-40c7-a5d9-3d73121a56c1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.373670 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 930/1864] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:57.374045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 935/1865] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:57.374952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b914-9d02-40c7-a5d9-3d73121a56c1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.378317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d9668-68f3-43c3-9977-4d51416e3fd4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.385095 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b914-9d02-40c7-a5d9-3d73121a56c1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.387983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d9668-68f3-43c3-9977-4d51416e3fd4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.389800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc4dab-edfb-47b2-8a45-618af8169174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.390445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc4dab-edfb-47b2-8a45-618af8169174 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.390727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc4dab-edfb-47b2-8a45-618af8169174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.391256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc4dab-edfb-47b2-8a45-618af8169174 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.391973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc4dab-edfb-47b2-8a45-618af8169174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:23:57.392312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc4dab-edfb-47b2-8a45-618af8169174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.392863 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe0734-feb6-4622-ba4e-5a429172efb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.393566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0734-feb6-4622-ba4e-5a429172efb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.393854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0734-feb6-4622-ba4e-5a429172efb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.393955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc4dab-edfb-47b2-8a45-618af8169174 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.394139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0734-feb6-4622-ba4e-5a429172efb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.394855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe0734-feb6-4622-ba4e-5a429172efb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.396465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe0734-feb6-4622-ba4e-5a429172efb9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.406205 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 936/1866] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:23:57.407078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc4dab-edfb-47b2-8a45-618af8169174 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.408187 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 931/1867] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:57.409896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe0734-feb6-4622-ba4e-5a429172efb9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.419907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc4dab-edfb-47b2-8a45-618af8169174 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.421544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe0734-feb6-4622-ba4e-5a429172efb9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.424679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e195ea4-4f3c-484a-ab7b-eb1acb0d3511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.425556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e195ea4-4f3c-484a-ab7b-eb1acb0d3511 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.425842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e195ea4-4f3c-484a-ab7b-eb1acb0d3511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.426118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e195ea4-4f3c-484a-ab7b-eb1acb0d3511 admin admin] PATH_INFO: `/v3/projects/eb318bb531954b89aea620dcdcf6290d/users/9d7c2ed9a9674d9caa45d83c7107692a/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.426359 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9878f8-0eba-4874-8655-3e23e77efc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.427236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9878f8-0eba-4874-8655-3e23e77efc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.427518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9878f8-0eba-4874-8655-3e23e77efc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.427796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9878f8-0eba-4874-8655-3e23e77efc2c admin admin] PATH_INFO: `/v3/projects/6626b6a64b5b41b599463af5f985674d/users/3619d771217946999534a0d70e54a99c/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.440781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e195ea4-4f3c-484a-ab7b-eb1acb0d3511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb318bb531954b89aea620dcdcf6290d, user_id=9d7c2ed9a9674d9caa45d83c7107692a, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.443609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e195ea4-4f3c-484a-ab7b-eb1acb0d3511 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.444666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9878f8-0eba-4874-8655-3e23e77efc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6626b6a64b5b41b599463af5f985674d, user_id=3619d771217946999534a0d70e54a99c, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.447340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9878f8-0eba-4874-8655-3e23e77efc2c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.458751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 937/1868] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:57 2022] PUT /identity/v3/projects/eb318bb531954b89aea620dcdcf6290d/users/9d7c2ed9a9674d9caa45d83c7107692a/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:57.459557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e195ea4-4f3c-484a-ab7b-eb1acb0d3511 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.464165 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 932/1869] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:57 2022] PUT /identity/v3/projects/6626b6a64b5b41b599463af5f985674d/users/3619d771217946999534a0d70e54a99c/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:57.465351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9878f8-0eba-4874-8655-3e23e77efc2c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.524261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e195ea4-4f3c-484a-ab7b-eb1acb0d3511 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.526552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9878f8-0eba-4874-8655-3e23e77efc2c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.529115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc5774-807f-41ce-8aa2-b789e12784d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.529780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc5774-807f-41ce-8aa2-b789e12784d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.530068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc5774-807f-41ce-8aa2-b789e12784d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.530349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc5774-807f-41ce-8aa2-b789e12784d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.531047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc5774-807f-41ce-8aa2-b789e12784d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.531147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebab722-af49-48d2-b832-b3cfce7609e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.531784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab722-af49-48d2-b832-b3cfce7609e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.532099 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab722-af49-48d2-b832-b3cfce7609e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.532381 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab722-af49-48d2-b832-b3cfce7609e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.532999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc5774-807f-41ce-8aa2-b789e12784d9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.533115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebab722-af49-48d2-b832-b3cfce7609e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.534723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebab722-af49-48d2-b832-b3cfce7609e6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.545030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 933/1870] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:57.545986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebab722-af49-48d2-b832-b3cfce7609e6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.556583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebab722-af49-48d2-b832-b3cfce7609e6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.561237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1634fa-3682-478f-b8a6-03788d022563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.561888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1634fa-3682-478f-b8a6-03788d022563 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.562198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1634fa-3682-478f-b8a6-03788d022563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.562476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1634fa-3682-478f-b8a6-03788d022563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.566195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 938/1871] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:23:57 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:57.566352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1634fa-3682-478f-b8a6-03788d022563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.566433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc5774-807f-41ce-8aa2-b789e12784d9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.566505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1634fa-3682-478f-b8a6-03788d022563 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.575869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 934/1872] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:57.576757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1634fa-3682-478f-b8a6-03788d022563 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.586951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1634fa-3682-478f-b8a6-03788d022563 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.594049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:57.630122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc5774-807f-41ce-8aa2-b789e12784d9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.631420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:57.635427 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030b1eb-baa9-4f3f-ba67-fa84c544bbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.636138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030b1eb-baa9-4f3f-ba67-fa84c544bbcc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.636436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030b1eb-baa9-4f3f-ba67-fa84c544bbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.636738 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030b1eb-baa9-4f3f-ba67-fa84c544bbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.637570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030b1eb-baa9-4f3f-ba67-fa84c544bbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.639536 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030b1eb-baa9-4f3f-ba67-fa84c544bbcc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.646546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3b6e7-a508-4c44-abb4-77a8de52ef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.647436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3b6e7-a508-4c44-abb4-77a8de52ef0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.647743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3b6e7-a508-4c44-abb4-77a8de52ef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.648052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3b6e7-a508-4c44-abb4-77a8de52ef0c admin admin] PATH_INFO: `/v3/projects/1b8732e1b4a54473b770a8b4d479fb1b/users/3587d3735e4a4317a52cf2ae0cd4fecf/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.650482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 939/1873] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:57.651281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030b1eb-baa9-4f3f-ba67-fa84c544bbcc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.660697 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030b1eb-baa9-4f3f-ba67-fa84c544bbcc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.665425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd141a-a216-46c2-a5d6-639783aba47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.666084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd141a-a216-46c2-a5d6-639783aba47d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.666338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3b6e7-a508-4c44-abb4-77a8de52ef0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8732e1b4a54473b770a8b4d479fb1b, user_id=3587d3735e4a4317a52cf2ae0cd4fecf, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.666459 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd141a-a216-46c2-a5d6-639783aba47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.666648 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd141a-a216-46c2-a5d6-639783aba47d admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.667334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd141a-a216-46c2-a5d6-639783aba47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.669093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3b6e7-a508-4c44-abb4-77a8de52ef0c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.669256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd141a-a216-46c2-a5d6-639783aba47d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.683892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 935/1874] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:57 2022] PUT /identity/v3/projects/1b8732e1b4a54473b770a8b4d479fb1b/users/3587d3735e4a4317a52cf2ae0cd4fecf/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:57.684974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3b6e7-a508-4c44-abb4-77a8de52ef0c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.690574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 940/1875] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:23:57 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:23:57.691228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd141a-a216-46c2-a5d6-639783aba47d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.702940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd141a-a216-46c2-a5d6-639783aba47d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.756151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3b6e7-a508-4c44-abb4-77a8de52ef0c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.760930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeaf52-0d00-4f2f-8891-1dc8fe049cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.761317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30e235-eb04-4ae8-b76d-816888222aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.761988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeaf52-0d00-4f2f-8891-1dc8fe049cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.762209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30e235-eb04-4ae8-b76d-816888222aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.762394 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeaf52-0d00-4f2f-8891-1dc8fe049cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.762484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30e235-eb04-4ae8-b76d-816888222aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.762782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30e235-eb04-4ae8-b76d-816888222aa0 admin admin] PATH_INFO: `/v3/projects/6626b6a64b5b41b599463af5f985674d/users/3619d771217946999534a0d70e54a99c/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.762873 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeaf52-0d00-4f2f-8891-1dc8fe049cdc admin admin] PATH_INFO: `/v3/projects/eb318bb531954b89aea620dcdcf6290d/users/9d7c2ed9a9674d9caa45d83c7107692a/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.764792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30e235-eb04-4ae8-b76d-816888222aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6626b6a64b5b41b599463af5f985674d, user_id=3619d771217946999534a0d70e54a99c, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.765523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeaf52-0d00-4f2f-8891-1dc8fe049cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb318bb531954b89aea620dcdcf6290d, user_id=9d7c2ed9a9674d9caa45d83c7107692a, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.767868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30e235-eb04-4ae8-b76d-816888222aa0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.769149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeaf52-0d00-4f2f-8891-1dc8fe049cdc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.779104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 941/1876] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:57 2022] PUT /identity/v3/projects/6626b6a64b5b41b599463af5f985674d/users/3619d771217946999534a0d70e54a99c/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:57.779908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30e235-eb04-4ae8-b76d-816888222aa0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:57.780398 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 936/1877] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:57 2022] PUT /identity/v3/projects/eb318bb531954b89aea620dcdcf6290d/users/9d7c2ed9a9674d9caa45d83c7107692a/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:57.781684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af760-f1ba-4acc-816a-bcb2cf0f1b84 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.781976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af760-f1ba-4acc-816a-bcb2cf0f1b84 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.782261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af760-f1ba-4acc-816a-bcb2cf0f1b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.808449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bd9af760-f1ba-4acc-816a-bcb2cf0f1b84 None None] MFA Rules not processed for user `3587d3735e4a4317a52cf2ae0cd4fecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:57.809711 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bd9af760-f1ba-4acc-816a-bcb2cf0f1b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:57.858286 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30e235-eb04-4ae8-b76d-816888222aa0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:57.878494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 937/1878] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:57.884251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a714c-9b7d-41e0-bd75-ca2291e50898 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.884251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a714c-9b7d-41e0-bd75-ca2291e50898 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.884251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a714c-9b7d-41e0-bd75-ca2291e50898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.907786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:57.931877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cf6a714c-9b7d-41e0-bd75-ca2291e50898 None None] MFA Rules not processed for user `3619d771217946999534a0d70e54a99c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:57.932721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70398b2-ddac-47de-a2db-065e9bbb6972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:57.933145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cf6a714c-9b7d-41e0-bd75-ca2291e50898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:57.933419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70398b2-ddac-47de-a2db-065e9bbb6972 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.933882 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70398b2-ddac-47de-a2db-065e9bbb6972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.934178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70398b2-ddac-47de-a2db-065e9bbb6972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:57.934929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70398b2-ddac-47de-a2db-065e9bbb6972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:57.936598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70398b2-ddac-47de-a2db-065e9bbb6972 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:57.966233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 942/1879] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:57.967871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2c8bf-9e9e-4563-ab37-4e1eda8b4b6b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:57.967871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2c8bf-9e9e-4563-ab37-4e1eda8b4b6b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:57.968206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2c8bf-9e9e-4563-ab37-4e1eda8b4b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:58.000513 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-44a2c8bf-9e9e-4563-ab37-4e1eda8b4b6b None None] MFA Rules not processed for user `9d7c2ed9a9674d9caa45d83c7107692a`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:58.001826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-44a2c8bf-9e9e-4563-ab37-4e1eda8b4b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:58.004397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:58.062780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 938/1880] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:58.062780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a714c-9b7d-41e0-bd75-ca2291e50898 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:58.062780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cf6a714c-9b7d-41e0-bd75-ca2291e50898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:58.091220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 943/1881] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:58.092642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2c8bf-9e9e-4563-ab37-4e1eda8b4b6b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:58.107156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2c8bf-9e9e-4563-ab37-4e1eda8b4b6b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:58.113822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052329dc-0bd5-4e15-adf3-108644353d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:58.115122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052329dc-0bd5-4e15-adf3-108644353d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:58.115612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052329dc-0bd5-4e15-adf3-108644353d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:58.116265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052329dc-0bd5-4e15-adf3-108644353d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:58.117415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052329dc-0bd5-4e15-adf3-108644353d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:58.119261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052329dc-0bd5-4e15-adf3-108644353d00 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:58.133252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 944/1882] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:23:58.135009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052329dc-0bd5-4e15-adf3-108644353d00 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:58.137625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-052329dc-0bd5-4e15-adf3-108644353d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:58.152621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052329dc-0bd5-4e15-adf3-108644353d00 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:58.157363 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22370-f38f-4413-8774-6dd8e11a648e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:58.159204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22370-f38f-4413-8774-6dd8e11a648e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:58.162079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22370-f38f-4413-8774-6dd8e11a648e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:58.162631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22370-f38f-4413-8774-6dd8e11a648e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:58.168891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a714c-9b7d-41e0-bd75-ca2291e50898 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:58.174445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df22370-f38f-4413-8774-6dd8e11a648e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:58.176604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df22370-f38f-4413-8774-6dd8e11a648e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:58.177726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830d26a-76bc-4584-a44c-90fadf42ac95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:58.178406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830d26a-76bc-4584-a44c-90fadf42ac95 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:58.178696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830d26a-76bc-4584-a44c-90fadf42ac95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:58.178977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830d26a-76bc-4584-a44c-90fadf42ac95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:58.191527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 945/1883] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:58.192840 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22370-f38f-4413-8774-6dd8e11a648e service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:58.207317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22370-f38f-4413-8774-6dd8e11a648e service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:58.209930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830d26a-76bc-4584-a44c-90fadf42ac95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:58.211425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830d26a-76bc-4584-a44c-90fadf42ac95 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:58.213118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131069-7e5d-4999-a6ed-7e62aff11965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:58.214307 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131069-7e5d-4999-a6ed-7e62aff11965 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:58.214946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131069-7e5d-4999-a6ed-7e62aff11965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:58.215614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131069-7e5d-4999-a6ed-7e62aff11965 admin admin] PATH_INFO: `/v3/projects/a1cc32ba001a4fdfae961ba6987dc9f2/users/b29a43cb697341ab8d1f9d7723ea5435/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:58.238054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86131069-7e5d-4999-a6ed-7e62aff11965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cc32ba001a4fdfae961ba6987dc9f2, user_id=b29a43cb697341ab8d1f9d7723ea5435, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:58.242922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86131069-7e5d-4999-a6ed-7e62aff11965 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:58.248089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 939/1884] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:58.287596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 946/1885] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:23:58 2022] PUT /identity/v3/projects/a1cc32ba001a4fdfae961ba6987dc9f2/users/b29a43cb697341ab8d1f9d7723ea5435/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:23:58.297797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534364db-5aa5-43ae-80ec-6fb6873843b6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:58.298170 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534364db-5aa5-43ae-80ec-6fb6873843b6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:58.298466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534364db-5aa5-43ae-80ec-6fb6873843b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:58.311634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131069-7e5d-4999-a6ed-7e62aff11965 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:58.375720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-534364db-5aa5-43ae-80ec-6fb6873843b6 None None] MFA Rules not processed for user `b29a43cb697341ab8d1f9d7723ea5435`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:58.376758 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-534364db-5aa5-43ae-80ec-6fb6873843b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:58.462718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131069-7e5d-4999-a6ed-7e62aff11965 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:58.474213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9b22c-ab4f-492f-a935-acb4af669da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:58.475144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9b22c-ab4f-492f-a935-acb4af669da0 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:58.475579 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9b22c-ab4f-492f-a935-acb4af669da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:58.475921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9b22c-ab4f-492f-a935-acb4af669da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:58.556425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 940/1886] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:58.559087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:58.635852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9b22c-ab4f-492f-a935-acb4af669da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:58.638105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9b22c-ab4f-492f-a935-acb4af669da0 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:58.675850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 947/1887] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:58.732712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534364db-5aa5-43ae-80ec-6fb6873843b6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:58.749731 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534364db-5aa5-43ae-80ec-6fb6873843b6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:58.758755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569a243-c288-4b33-824c-ccbeb022e40b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:58.760363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569a243-c288-4b33-824c-ccbeb022e40b service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:58.761117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569a243-c288-4b33-824c-ccbeb022e40b service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:58.761117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569a243-c288-4b33-824c-ccbeb022e40b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:58.793157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569a243-c288-4b33-824c-ccbeb022e40b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:58.796606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569a243-c288-4b33-824c-ccbeb022e40b service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:58.823198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b59b59-e1c8-4875-a745-c33693feab52 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:58.823953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b59b59-e1c8-4875-a745-c33693feab52 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:58.824462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b59b59-e1c8-4875-a745-c33693feab52 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:58.827392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 948/1888] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:23:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:23:58.835658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 941/1889] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:58.873618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b59b59-e1c8-4875-a745-c33693feab52 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:58.875346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569a243-c288-4b33-824c-ccbeb022e40b service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:58.895894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b59b59-e1c8-4875-a745-c33693feab52 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:58.912713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7216f-d7eb-4ff9-b68d-0076bee91ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:58.913386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7216f-d7eb-4ff9-b68d-0076bee91ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:58.916008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7216f-d7eb-4ff9-b68d-0076bee91ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:58.916328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7216f-d7eb-4ff9-b68d-0076bee91ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:58.922128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2bf7216f-d7eb-4ff9-b68d-0076bee91ee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:59.042205 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569a243-c288-4b33-824c-ccbeb022e40b service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:59.053822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdec10-acdf-4666-be51-681bafaa05d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:59.055801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdec10-acdf-4666-be51-681bafaa05d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:59.056116 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdec10-acdf-4666-be51-681bafaa05d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:59.056399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdec10-acdf-4666-be51-681bafaa05d0 admin admin] PATH_INFO: `/v3/users/b29a43cb697341ab8d1f9d7723ea5435` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:59.058744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdec10-acdf-4666-be51-681bafaa05d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29a43cb697341ab8d1f9d7723ea5435)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:59.074354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdec10-acdf-4666-be51-681bafaa05d0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:59.077555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:59.106501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7216f-d7eb-4ff9-b68d-0076bee91ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:59.108188 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7216f-d7eb-4ff9-b68d-0076bee91ee2 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:59.120585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 949/1890] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:59.121997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38a426-ef53-4962-a582-a29be16465a3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:59.122297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38a426-ef53-4962-a582-a29be16465a3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:59.122582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38a426-ef53-4962-a582-a29be16465a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:59.147984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3b38a426-ef53-4962-a582-a29be16465a3 None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:59.149432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3b38a426-ef53-4962-a582-a29be16465a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:59.223336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-56bdec10-acdf-4666-be51-681bafaa05d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29a43cb697341ab8d1f9d7723ea5435'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:59.253986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-56bdec10-acdf-4666-be51-681bafaa05d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29a43cb697341ab8d1f9d7723ea5435'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:59.291600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-56bdec10-acdf-4666-be51-681bafaa05d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29a43cb697341ab8d1f9d7723ea5435'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:59.294325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-56bdec10-acdf-4666-be51-681bafaa05d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29a43cb697341ab8d1f9d7723ea5435'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:59.301012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 950/1891] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:23:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:23:59.301907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38a426-ef53-4962-a582-a29be16465a3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:59.323340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-56bdec10-acdf-4666-be51-681bafaa05d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29a43cb697341ab8d1f9d7723ea5435'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:23:59.328360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38a426-ef53-4962-a582-a29be16465a3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:59.334438 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e1ef-d075-4038-8092-370988ea28fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:59.335111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e1ef-d075-4038-8092-370988ea28fd service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:59.335405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e1ef-d075-4038-8092-370988ea28fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:59.336582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e1ef-d075-4038-8092-370988ea28fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:59.339606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dbe7e1ef-d075-4038-8092-370988ea28fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:59.344496 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 942/1892] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:23:58 2022] DELETE /identity/v3/users/b29a43cb697341ab8d1f9d7723ea5435 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:23:59.351043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9109-7439-4c13-a0c9-dd0e52558f93 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:59.351136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9109-7439-4c13-a0c9-dd0e52558f93 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:59.351548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9109-7439-4c13-a0c9-dd0e52558f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:59.388959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3e8d9109-7439-4c13-a0c9-dd0e52558f93 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:23:59.390279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3e8d9109-7439-4c13-a0c9-dd0e52558f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:59.444206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:23:59.447946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e1ef-d075-4038-8092-370988ea28fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:59.452240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e1ef-d075-4038-8092-370988ea28fd service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:59.466761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 951/1893] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:23:59.529583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 943/1894] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:23:59.545900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e1ef-d075-4038-8092-370988ea28fd service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:59.548050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dbe7e1ef-d075-4038-8092-370988ea28fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:59.692050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e1ef-d075-4038-8092-370988ea28fd service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:23:59.817327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd45427-0318-4440-bb05-036bcb9ceea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:23:59.818049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd45427-0318-4440-bb05-036bcb9ceea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:23:59.818407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd45427-0318-4440-bb05-036bcb9ceea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:23:59.818737 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd45427-0318-4440-bb05-036bcb9ceea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:23:59.821157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9109-7439-4c13-a0c9-dd0e52558f93 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:23:59.823139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3e8d9109-7439-4c13-a0c9-dd0e52558f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:23:59.849482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd45427-0318-4440-bb05-036bcb9ceea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:23:59.852746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd45427-0318-4440-bb05-036bcb9ceea8 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:23:59.872708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 952/1895] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:00.016548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9109-7439-4c13-a0c9-dd0e52558f93 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:00.024510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cb2e9-6571-484b-af7c-460305d7fbf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:00.025568 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cb2e9-6571-484b-af7c-460305d7fbf2 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:00.027150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cb2e9-6571-484b-af7c-460305d7fbf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:00.027785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cb2e9-6571-484b-af7c-460305d7fbf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:00.030215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ea3cb2e9-6571-484b-af7c-460305d7fbf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:00.047350 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cb2e9-6571-484b-af7c-460305d7fbf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:00.049066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cb2e9-6571-484b-af7c-460305d7fbf2 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:00.063718 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 944/1896] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:23:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:00.956209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd45427-0318-4440-bb05-036bcb9ceea8 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:00.957763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bcd45427-0318-4440-bb05-036bcb9ceea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:01.001353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd45427-0318-4440-bb05-036bcb9ceea8 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:01.022526 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:01.026071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:01.029583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:01.031425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] PATH_INFO: `/v3/projects/a1cc32ba001a4fdfae961ba6987dc9f2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:01.036528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1cc32ba001a4fdfae961ba6987dc9f2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:01.042888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:01.172387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1cc32ba001a4fdfae961ba6987dc9f2', 'request_id': 'req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:01.194954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1cc32ba001a4fdfae961ba6987dc9f2', 'request_id': 'req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:01.204212 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1cc32ba001a4fdfae961ba6987dc9f2', 'request_id': 'req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:01.230525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] The token cache is being invalidate because project a1cc32ba001a4fdfae961ba6987dc9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:01.231878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:01.234959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c2e41d0c-ff5e-4f44-b770-ffa01b9255b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:01.239616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 953/1897] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:00 2022] DELETE /identity/v3/projects/a1cc32ba001a4fdfae961ba6987dc9f2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:01.244985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34860c59-0b11-4278-b4ba-37e1812f8605 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:01.245853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34860c59-0b11-4278-b4ba-37e1812f8605 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:01.246146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34860c59-0b11-4278-b4ba-37e1812f8605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:01.260753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:01.278984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-34860c59-0b11-4278-b4ba-37e1812f8605 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:01.287034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-34860c59-0b11-4278-b4ba-37e1812f8605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:01.367266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 945/1898] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:01.375660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882555cd-48f6-4875-b383-0e75e4fa2af5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:01.375995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882555cd-48f6-4875-b383-0e75e4fa2af5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:01.376343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882555cd-48f6-4875-b383-0e75e4fa2af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:01.399461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-882555cd-48f6-4875-b383-0e75e4fa2af5 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:01.400746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-882555cd-48f6-4875-b383-0e75e4fa2af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:01.411998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 954/1899] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:01.416365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34860c59-0b11-4278-b4ba-37e1812f8605 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:01.427155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34860c59-0b11-4278-b4ba-37e1812f8605 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:01.432293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6c3ff-b22b-4103-b844-450b0a0010a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:01.433009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6c3ff-b22b-4103-b844-450b0a0010a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:01.433296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6c3ff-b22b-4103-b844-450b0a0010a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:01.433575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6c3ff-b22b-4103-b844-450b0a0010a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:01.434311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6c3ff-b22b-4103-b844-450b0a0010a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:01.434641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6c3ff-b22b-4103-b844-450b0a0010a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:01.436331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6c3ff-b22b-4103-b844-450b0a0010a6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:01.449094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 946/1900] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:01.453941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882555cd-48f6-4875-b383-0e75e4fa2af5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:01.465159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882555cd-48f6-4875-b383-0e75e4fa2af5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:01.469822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d5fdb-7221-4362-b7d0-1946af742ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:01.470559 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5fdb-7221-4362-b7d0-1946af742ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:01.471987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5fdb-7221-4362-b7d0-1946af742ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:01.472378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5fdb-7221-4362-b7d0-1946af742ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:01.473372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d5fdb-7221-4362-b7d0-1946af742ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:01.475883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d5fdb-7221-4362-b7d0-1946af742ae5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:01.504455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 955/1901] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:01 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:01.508725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6c3ff-b22b-4103-b844-450b0a0010a6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:01.519908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6c3ff-b22b-4103-b844-450b0a0010a6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:01.576814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69a817-c987-4889-9d44-51a997d55d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:01.577481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69a817-c987-4889-9d44-51a997d55d8a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:01.577770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69a817-c987-4889-9d44-51a997d55d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:01.578055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69a817-c987-4889-9d44-51a997d55d8a admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:01.578752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69a817-c987-4889-9d44-51a997d55d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:01.581332 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69a817-c987-4889-9d44-51a997d55d8a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:01.603405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 947/1902] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:01 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:01.607542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d5fdb-7221-4362-b7d0-1946af742ae5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:01.618342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d5fdb-7221-4362-b7d0-1946af742ae5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:01.623381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f493b1-9af7-447a-b516-18daaefe3a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:01.624090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f493b1-9af7-447a-b516-18daaefe3a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:01.624389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f493b1-9af7-447a-b516-18daaefe3a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:01.624670 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f493b1-9af7-447a-b516-18daaefe3a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:01.625459 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f493b1-9af7-447a-b516-18daaefe3a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:01.627888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f493b1-9af7-447a-b516-18daaefe3a50 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:01.630847 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:01.645495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 956/1903] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:01.649404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69a817-c987-4889-9d44-51a997d55d8a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:01.660069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69a817-c987-4889-9d44-51a997d55d8a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:01.665281 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968516f1-0a99-4bb9-bf90-21222ebe7bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:01.665986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968516f1-0a99-4bb9-bf90-21222ebe7bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:01.666242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968516f1-0a99-4bb9-bf90-21222ebe7bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:01.666529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968516f1-0a99-4bb9-bf90-21222ebe7bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:01.667461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968516f1-0a99-4bb9-bf90-21222ebe7bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:01.669122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968516f1-0a99-4bb9-bf90-21222ebe7bcd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:01.680165 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 948/1904] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:01.684428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f493b1-9af7-447a-b516-18daaefe3a50 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:01.695294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f493b1-9af7-447a-b516-18daaefe3a50 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:01.700090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229e6bd-94b7-4b9e-8db1-2785cefca353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:01.700981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229e6bd-94b7-4b9e-8db1-2785cefca353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:01.701267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229e6bd-94b7-4b9e-8db1-2785cefca353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:01.701547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229e6bd-94b7-4b9e-8db1-2785cefca353 admin admin] PATH_INFO: `/v3/projects/60f78592473842d1adad5a5c39f5a4fd/users/9be8334176b742e7a8eec30d92641b12/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:01.726931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229e6bd-94b7-4b9e-8db1-2785cefca353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f78592473842d1adad5a5c39f5a4fd, user_id=9be8334176b742e7a8eec30d92641b12, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:01.729958 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229e6bd-94b7-4b9e-8db1-2785cefca353 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:01.746875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 957/1905] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:01 2022] PUT /identity/v3/projects/60f78592473842d1adad5a5c39f5a4fd/users/9be8334176b742e7a8eec30d92641b12/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:01.758550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ca559-14d5-4bc6-945e-8aec5409ad6f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:01.759526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ca559-14d5-4bc6-945e-8aec5409ad6f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:01.760067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ca559-14d5-4bc6-945e-8aec5409ad6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:01.789268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c58ca559-14d5-4bc6-945e-8aec5409ad6f None None] MFA Rules not processed for user `9be8334176b742e7a8eec30d92641b12`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:01.790795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c58ca559-14d5-4bc6-945e-8aec5409ad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:01.860084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:01.866382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 949/1906] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:01.876917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229e6bd-94b7-4b9e-8db1-2785cefca353 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:01.879143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2229e6bd-94b7-4b9e-8db1-2785cefca353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:01.936272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229e6bd-94b7-4b9e-8db1-2785cefca353 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:01.939964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebbd04-7f83-42fb-9d2e-982eaaee5fa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:01.940646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebbd04-7f83-42fb-9d2e-982eaaee5fa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:01.940932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebbd04-7f83-42fb-9d2e-982eaaee5fa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:01.941214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebbd04-7f83-42fb-9d2e-982eaaee5fa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:01.949692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebbd04-7f83-42fb-9d2e-982eaaee5fa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:01.951130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebbd04-7f83-42fb-9d2e-982eaaee5fa6 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:01.960820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 958/1907] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:02.249084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ca559-14d5-4bc6-945e-8aec5409ad6f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:02.250610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c58ca559-14d5-4bc6-945e-8aec5409ad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:02.393030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ca559-14d5-4bc6-945e-8aec5409ad6f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:02.398713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:02.399612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:02.399898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:02.400223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] PATH_INFO: `/v3/users/3587d3735e4a4317a52cf2ae0cd4fecf` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:02.401461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3587d3735e4a4317a52cf2ae0cd4fecf)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:02.403855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:02.530560 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3587d3735e4a4317a52cf2ae0cd4fecf'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:02.551502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3587d3735e4a4317a52cf2ae0cd4fecf'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:02.565739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3587d3735e4a4317a52cf2ae0cd4fecf'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:02.569245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3587d3735e4a4317a52cf2ae0cd4fecf'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:02.591235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3587d3735e4a4317a52cf2ae0cd4fecf'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:02.598583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 950/1908] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:02 2022] DELETE /identity/v3/users/3587d3735e4a4317a52cf2ae0cd4fecf => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:02.602993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27187a96-5647-4906-b692-5928dc0092a0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:02.603291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27187a96-5647-4906-b692-5928dc0092a0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:02.603621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27187a96-5647-4906-b692-5928dc0092a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:02.626270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-27187a96-5647-4906-b692-5928dc0092a0 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:02.637515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-27187a96-5647-4906-b692-5928dc0092a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:02.712686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 959/1909] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:02.723423 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:02.725030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:02.823774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966e262-4f58-4473-ba6b-e4ea044dadbf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:02.827815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57becbe0-dc7c-426d-aae8-d552647405ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:02.828775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57becbe0-dc7c-426d-aae8-d552647405ed service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:02.829191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57becbe0-dc7c-426d-aae8-d552647405ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:02.829577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57becbe0-dc7c-426d-aae8-d552647405ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:02.844325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57becbe0-dc7c-426d-aae8-d552647405ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:02.846384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57becbe0-dc7c-426d-aae8-d552647405ed service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:02.860053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 951/1910] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:03.217841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27187a96-5647-4906-b692-5928dc0092a0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:03.220089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-27187a96-5647-4906-b692-5928dc0092a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:03.234092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27187a96-5647-4906-b692-5928dc0092a0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:03.240324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:03.241609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:03.242026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:03.242395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] PATH_INFO: `/v3/projects/1b8732e1b4a54473b770a8b4d479fb1b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:03.243643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8732e1b4a54473b770a8b4d479fb1b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:03.245744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:03.295242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8732e1b4a54473b770a8b4d479fb1b', 'request_id': 'req-5a34b18a-86aa-421c-bb26-87bc4a4f700e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:03.302379 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8732e1b4a54473b770a8b4d479fb1b', 'request_id': 'req-5a34b18a-86aa-421c-bb26-87bc4a4f700e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:03.308382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8732e1b4a54473b770a8b4d479fb1b', 'request_id': 'req-5a34b18a-86aa-421c-bb26-87bc4a4f700e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:03.322646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:03.327502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] The token cache is being invalidate because project 1b8732e1b4a54473b770a8b4d479fb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:03.327502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:03.328241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5a34b18a-86aa-421c-bb26-87bc4a4f700e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:03.330578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 960/1911] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:03 2022] DELETE /identity/v3/projects/1b8732e1b4a54473b770a8b4d479fb1b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:03.335802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ba2c3-ccfd-4401-a597-58777d74bf34 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:03.336302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ba2c3-ccfd-4401-a597-58777d74bf34 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:03.336414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ba2c3-ccfd-4401-a597-58777d74bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:03.355023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-181ba2c3-ccfd-4401-a597-58777d74bf34 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:03.356289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-181ba2c3-ccfd-4401-a597-58777d74bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:03.387018 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:03.443161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 952/1912] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:03.451808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6a0bd-4569-486f-ad80-7db566886fc8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:03.452396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6a0bd-4569-486f-ad80-7db566886fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:03.452699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6a0bd-4569-486f-ad80-7db566886fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:03.480320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cfc6a0bd-4569-486f-ad80-7db566886fc8 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:03.481936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cfc6a0bd-4569-486f-ad80-7db566886fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:03.495696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 961/1913] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:03.500676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ba2c3-ccfd-4401-a597-58777d74bf34 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:03.513369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ba2c3-ccfd-4401-a597-58777d74bf34 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:03.520951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e736dc-ba5b-42e8-8bd6-7155757b2125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:03.522151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e736dc-ba5b-42e8-8bd6-7155757b2125 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:03.522629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e736dc-ba5b-42e8-8bd6-7155757b2125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:03.523075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e736dc-ba5b-42e8-8bd6-7155757b2125 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:03.524086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e736dc-ba5b-42e8-8bd6-7155757b2125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:03.524985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e736dc-ba5b-42e8-8bd6-7155757b2125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:03.532101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e736dc-ba5b-42e8-8bd6-7155757b2125 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:03.549151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 953/1914] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:03.557549 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6a0bd-4569-486f-ad80-7db566886fc8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:03.572678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6a0bd-4569-486f-ad80-7db566886fc8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:03.589112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d685f-558b-483c-8026-ba441687951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:03.589776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d685f-558b-483c-8026-ba441687951c admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:03.590129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d685f-558b-483c-8026-ba441687951c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:03.590348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d685f-558b-483c-8026-ba441687951c admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:03.591063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d685f-558b-483c-8026-ba441687951c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:03.593296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d685f-558b-483c-8026-ba441687951c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:03.633708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 962/1915] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:03 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:03.636565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e736dc-ba5b-42e8-8bd6-7155757b2125 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:03.647852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e736dc-ba5b-42e8-8bd6-7155757b2125 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:03.708380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3ec7-88f8-497b-bc88-08044f9cb31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:03.708897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3ec7-88f8-497b-bc88-08044f9cb31c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:03.709284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3ec7-88f8-497b-bc88-08044f9cb31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:03.709637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3ec7-88f8-497b-bc88-08044f9cb31c admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:03.710404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc3ec7-88f8-497b-bc88-08044f9cb31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:03.712628 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc3ec7-88f8-497b-bc88-08044f9cb31c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:03.734277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 954/1916] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:03 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:03.739342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d685f-558b-483c-8026-ba441687951c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:03.750391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d685f-558b-483c-8026-ba441687951c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:03.755978 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c00e1-73b7-4f2e-912f-68cd1ad278f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:03.756465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c00e1-73b7-4f2e-912f-68cd1ad278f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:03.756891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c00e1-73b7-4f2e-912f-68cd1ad278f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:03.757177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c00e1-73b7-4f2e-912f-68cd1ad278f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:03.757913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c00e1-73b7-4f2e-912f-68cd1ad278f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:03.759545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c00e1-73b7-4f2e-912f-68cd1ad278f2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:03.770751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 963/1917] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:03.774638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3ec7-88f8-497b-bc88-08044f9cb31c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:03.784943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3ec7-88f8-497b-bc88-08044f9cb31c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:03.789452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b327cb-c348-422e-9e0e-da9b8dac0c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:03.790097 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b327cb-c348-422e-9e0e-da9b8dac0c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:03.790379 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b327cb-c348-422e-9e0e-da9b8dac0c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:03.790656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b327cb-c348-422e-9e0e-da9b8dac0c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:03.791370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b327cb-c348-422e-9e0e-da9b8dac0c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:03.792991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b327cb-c348-422e-9e0e-da9b8dac0c87 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:03.803262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 955/1918] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:03.807269 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c00e1-73b7-4f2e-912f-68cd1ad278f2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:03.817562 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c00e1-73b7-4f2e-912f-68cd1ad278f2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:03.822305 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c7f1b-cc5d-4bb0-a31b-d4cb877acf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:03.823182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c7f1b-cc5d-4bb0-a31b-d4cb877acf05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:03.823473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c7f1b-cc5d-4bb0-a31b-d4cb877acf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:03.824223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c7f1b-cc5d-4bb0-a31b-d4cb877acf05 admin admin] PATH_INFO: `/v3/projects/5a68866c7d2d41e98fb602341321d483/users/f6f512c88a6b4a39b4159715dd78fac5/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:03.838918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c7f1b-cc5d-4bb0-a31b-d4cb877acf05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a68866c7d2d41e98fb602341321d483, user_id=f6f512c88a6b4a39b4159715dd78fac5, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:03.841620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c7f1b-cc5d-4bb0-a31b-d4cb877acf05 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:03.855231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 964/1919] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:03 2022] PUT /identity/v3/projects/5a68866c7d2d41e98fb602341321d483/users/f6f512c88a6b4a39b4159715dd78fac5/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:03.866593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f1b19-fd14-40a6-9f48-70645beca1b0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:03.866912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f1b19-fd14-40a6-9f48-70645beca1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:03.867202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f1b19-fd14-40a6-9f48-70645beca1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:03.895764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-900f1b19-fd14-40a6-9f48-70645beca1b0 None None] MFA Rules not processed for user `f6f512c88a6b4a39b4159715dd78fac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:03.897030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-900f1b19-fd14-40a6-9f48-70645beca1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:03.958903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 956/1920] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:03.963477 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c7f1b-cc5d-4bb0-a31b-d4cb877acf05 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.025243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c7f1b-cc5d-4bb0-a31b-d4cb877acf05 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:04.029761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cfe4d-7b3d-4a05-bcbc-54453d0fe3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:04.030417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cfe4d-7b3d-4a05-bcbc-54453d0fe3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.030700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cfe4d-7b3d-4a05-bcbc-54453d0fe3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.030974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cfe4d-7b3d-4a05-bcbc-54453d0fe3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.031664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cfe4d-7b3d-4a05-bcbc-54453d0fe3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:04.033607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cfe4d-7b3d-4a05-bcbc-54453d0fe3a6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:04.059411 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 965/1921] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:03 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:04.063536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f1b19-fd14-40a6-9f48-70645beca1b0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.075457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f1b19-fd14-40a6-9f48-70645beca1b0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:04.088540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:04.135765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae15ba2-9007-486f-99e6-6d36adc0c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:04.136536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae15ba2-9007-486f-99e6-6d36adc0c8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.137080 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae15ba2-9007-486f-99e6-6d36adc0c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.137080 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae15ba2-9007-486f-99e6-6d36adc0c8c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.137795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae15ba2-9007-486f-99e6-6d36adc0c8c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:04.140853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae15ba2-9007-486f-99e6-6d36adc0c8c8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:04.166173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 957/1922] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:04 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:04.167354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cfe4d-7b3d-4a05-bcbc-54453d0fe3a6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.179797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cfe4d-7b3d-4a05-bcbc-54453d0fe3a6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:04.185370 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda94f8c-694d-493c-a1c0-2b45102d9517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:04.186043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda94f8c-694d-493c-a1c0-2b45102d9517 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.186329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda94f8c-694d-493c-a1c0-2b45102d9517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.186608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda94f8c-694d-493c-a1c0-2b45102d9517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.187346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda94f8c-694d-493c-a1c0-2b45102d9517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:04.189017 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda94f8c-694d-493c-a1c0-2b45102d9517 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:04.204063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 966/1923] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:04.208536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae15ba2-9007-486f-99e6-6d36adc0c8c8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.218917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae15ba2-9007-486f-99e6-6d36adc0c8c8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:04.223729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65590c04-e908-4647-9449-d393cfd05f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:04.224429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65590c04-e908-4647-9449-d393cfd05f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.224721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65590c04-e908-4647-9449-d393cfd05f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.225001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65590c04-e908-4647-9449-d393cfd05f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.225761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65590c04-e908-4647-9449-d393cfd05f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:04.227369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65590c04-e908-4647-9449-d393cfd05f96 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:04.238183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 958/1924] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:04.242248 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda94f8c-694d-493c-a1c0-2b45102d9517 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.252895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda94f8c-694d-493c-a1c0-2b45102d9517 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:04.257488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b94c4-827c-4c7f-bcd1-cbaf5b12b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:04.258376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b94c4-827c-4c7f-bcd1-cbaf5b12b816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.258668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b94c4-827c-4c7f-bcd1-cbaf5b12b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.258946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b94c4-827c-4c7f-bcd1-cbaf5b12b816 admin admin] PATH_INFO: `/v3/projects/67be37d4f5914952b3450885c1901883/users/4da3833d9e6e42ce93e68d48b8ce1bc7/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.275054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b94c4-827c-4c7f-bcd1-cbaf5b12b816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67be37d4f5914952b3450885c1901883, user_id=4da3833d9e6e42ce93e68d48b8ce1bc7, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:04.277822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b94c4-827c-4c7f-bcd1-cbaf5b12b816 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:04.291513 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 967/1925] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:04 2022] PUT /identity/v3/projects/67be37d4f5914952b3450885c1901883/users/4da3833d9e6e42ce93e68d48b8ce1bc7/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:04.301802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5fbe-0986-48d6-b4af-e2d22c77ca78 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.302100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5fbe-0986-48d6-b4af-e2d22c77ca78 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.302910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5fbe-0986-48d6-b4af-e2d22c77ca78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.328526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7c4a5fbe-0986-48d6-b4af-e2d22c77ca78 None None] MFA Rules not processed for user `4da3833d9e6e42ce93e68d48b8ce1bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:04.329732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7c4a5fbe-0986-48d6-b4af-e2d22c77ca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:04.394076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 959/1926] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:04.398481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b94c4-827c-4c7f-bcd1-cbaf5b12b816 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.444530 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:04.459422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b94c4-827c-4c7f-bcd1-cbaf5b12b816 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:04.464253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df91bf5-ca49-4337-ad73-e2f48941be25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:04.464915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91bf5-ca49-4337-ad73-e2f48941be25 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.465204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91bf5-ca49-4337-ad73-e2f48941be25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.465485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91bf5-ca49-4337-ad73-e2f48941be25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.466185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df91bf5-ca49-4337-ad73-e2f48941be25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:04.468151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df91bf5-ca49-4337-ad73-e2f48941be25 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:04.492958 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 968/1927] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:04 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:04.496994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5fbe-0986-48d6-b4af-e2d22c77ca78 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.507848 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5fbe-0986-48d6-b4af-e2d22c77ca78 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:04.567632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e96f1-9f0d-4acd-bcdc-30b4e8445b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:04.568403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e96f1-9f0d-4acd-bcdc-30b4e8445b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.568796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e96f1-9f0d-4acd-bcdc-30b4e8445b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.568967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e96f1-9f0d-4acd-bcdc-30b4e8445b51 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.569631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e96f1-9f0d-4acd-bcdc-30b4e8445b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:04.571588 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e96f1-9f0d-4acd-bcdc-30b4e8445b51 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:04.596485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 960/1928] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:04 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:04.599437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df91bf5-ca49-4337-ad73-e2f48941be25 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.621084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df91bf5-ca49-4337-ad73-e2f48941be25 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:04.625804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea96e9-65d4-4d66-bf4c-c12041de96e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:04.626482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea96e9-65d4-4d66-bf4c-c12041de96e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.626773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea96e9-65d4-4d66-bf4c-c12041de96e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.627059 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea96e9-65d4-4d66-bf4c-c12041de96e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.628353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea96e9-65d4-4d66-bf4c-c12041de96e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:04.629956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea96e9-65d4-4d66-bf4c-c12041de96e7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:04.644577 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 969/1929] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:04.646107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e96f1-9f0d-4acd-bcdc-30b4e8445b51 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.655986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e96f1-9f0d-4acd-bcdc-30b4e8445b51 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:04.661077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b4034-9e6f-4677-8a2e-a1feb962da85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:04.662024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b4034-9e6f-4677-8a2e-a1feb962da85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.662309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b4034-9e6f-4677-8a2e-a1feb962da85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.662656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b4034-9e6f-4677-8a2e-a1feb962da85 admin admin] PATH_INFO: `/v3/projects/afc6fbe214134737895852acc71073a9/users/35640133f1e54286b0cea9b6fb3cda3e/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.675090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:04.678489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b4034-9e6f-4677-8a2e-a1feb962da85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc6fbe214134737895852acc71073a9, user_id=35640133f1e54286b0cea9b6fb3cda3e, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:04.681719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b4034-9e6f-4677-8a2e-a1feb962da85 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:04.695320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 961/1930] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:04 2022] PUT /identity/v3/projects/afc6fbe214134737895852acc71073a9/users/35640133f1e54286b0cea9b6fb3cda3e/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:04.699317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea96e9-65d4-4d66-bf4c-c12041de96e7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.710022 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea96e9-65d4-4d66-bf4c-c12041de96e7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:04.768538 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b01fa-1f68-41df-88f6-00982007d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:04.769220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b01fa-1f68-41df-88f6-00982007d6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.769500 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b01fa-1f68-41df-88f6-00982007d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.769776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b01fa-1f68-41df-88f6-00982007d6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.770504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b01fa-1f68-41df-88f6-00982007d6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:04.772118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b01fa-1f68-41df-88f6-00982007d6a5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:04.782886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 970/1931] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:04.787088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b4034-9e6f-4677-8a2e-a1feb962da85 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.797326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b4034-9e6f-4677-8a2e-a1feb962da85 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:04.802212 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ef301-a227-4383-8254-028534369c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:04.803102 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ef301-a227-4383-8254-028534369c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.803385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ef301-a227-4383-8254-028534369c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.803663 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ef301-a227-4383-8254-028534369c19 admin admin] PATH_INFO: `/v3/projects/afc6fbe214134737895852acc71073a9/users/35640133f1e54286b0cea9b6fb3cda3e/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.805747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ef301-a227-4383-8254-028534369c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc6fbe214134737895852acc71073a9, user_id=35640133f1e54286b0cea9b6fb3cda3e, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:04.808489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ef301-a227-4383-8254-028534369c19 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:04.820538 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 962/1932] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:04 2022] PUT /identity/v3/projects/afc6fbe214134737895852acc71073a9/users/35640133f1e54286b0cea9b6fb3cda3e/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:04.832250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36caf8-318a-4278-a746-25e0289da5bc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:04.832870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36caf8-318a-4278-a746-25e0289da5bc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:04.833349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36caf8-318a-4278-a746-25e0289da5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:04.862273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ad36caf8-318a-4278-a746-25e0289da5bc None None] MFA Rules not processed for user `35640133f1e54286b0cea9b6fb3cda3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:04.864241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ad36caf8-318a-4278-a746-25e0289da5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:04.935827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 971/1933] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:04.948519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ef301-a227-4383-8254-028534369c19 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:04.950434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-164ef301-a227-4383-8254-028534369c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:05.010259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ef301-a227-4383-8254-028534369c19 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:05.013844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1595d4-f41c-42e7-9e42-934a0118cf93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:05.014518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1595d4-f41c-42e7-9e42-934a0118cf93 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:05.014806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1595d4-f41c-42e7-9e42-934a0118cf93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:05.015086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1595d4-f41c-42e7-9e42-934a0118cf93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:05.071651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1595d4-f41c-42e7-9e42-934a0118cf93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:05.073030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1595d4-f41c-42e7-9e42-934a0118cf93 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:05.082378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 963/1934] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:09.768534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36caf8-318a-4278-a746-25e0289da5bc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:09.778273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36caf8-318a-4278-a746-25e0289da5bc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:09.781876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98555807-b10a-4b3e-b618-009e7a73b5b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:09.782523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98555807-b10a-4b3e-b618-009e7a73b5b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:09.782810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98555807-b10a-4b3e-b618-009e7a73b5b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:09.783603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98555807-b10a-4b3e-b618-009e7a73b5b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:09.824783 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:09.842815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98555807-b10a-4b3e-b618-009e7a73b5b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:09.844295 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98555807-b10a-4b3e-b618-009e7a73b5b1 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:09.853717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 972/1935] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:10.089039 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1595d4-f41c-42e7-9e42-934a0118cf93 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:10.091047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ad1595d4-f41c-42e7-9e42-934a0118cf93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:10.231677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1595d4-f41c-42e7-9e42-934a0118cf93 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:10.236879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:10.238635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:10.238820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:10.239098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] PATH_INFO: `/v3/users/1ee54c493b724df69b464d02b4f1fcb5` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:10.240454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee54c493b724df69b464d02b4f1fcb5)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:10.242438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:10.289289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:10.301867 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee54c493b724df69b464d02b4f1fcb5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:10.335204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee54c493b724df69b464d02b4f1fcb5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:10.356854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee54c493b724df69b464d02b4f1fcb5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:10.357850 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee54c493b724df69b464d02b4f1fcb5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:10.368346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee54c493b724df69b464d02b4f1fcb5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:10.379407 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 964/1936] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:10 2022] DELETE /identity/v3/users/1ee54c493b724df69b464d02b4f1fcb5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:10.382008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13161-a8c6-43c6-adc1-7fa0ab96a297 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:10.382555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13161-a8c6-43c6-adc1-7fa0ab96a297 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:10.383374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13161-a8c6-43c6-adc1-7fa0ab96a297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:10.409288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f0a13161-a8c6-43c6-adc1-7fa0ab96a297 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:10.410767 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f0a13161-a8c6-43c6-adc1-7fa0ab96a297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:10.500189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 973/1937] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:10.509146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:10.511047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:10.595737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc312b-a29d-41cf-a009-09d478aefedf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:10.600048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db0f6e-5fe2-4a85-bca4-ae4c3f732c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:10.601092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db0f6e-5fe2-4a85-bca4-ae4c3f732c48 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:10.601542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db0f6e-5fe2-4a85-bca4-ae4c3f732c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:10.602540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db0f6e-5fe2-4a85-bca4-ae4c3f732c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:10.609244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a13161-a8c6-43c6-adc1-7fa0ab96a297 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:10.610652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f0a13161-a8c6-43c6-adc1-7fa0ab96a297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:10.613885 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db0f6e-5fe2-4a85-bca4-ae4c3f732c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:10.616179 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db0f6e-5fe2-4a85-bca4-ae4c3f732c48 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:10.632207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 965/1938] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:10.633400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a13161-a8c6-43c6-adc1-7fa0ab96a297 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:10.639926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:10.641255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:10.641543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:10.641821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] PATH_INFO: `/v3/users/6f1ecfc2d9034c75a095f1e1b3bec8b7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:10.643150 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1ecfc2d9034c75a095f1e1b3bec8b7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:10.645853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:10.733793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1ecfc2d9034c75a095f1e1b3bec8b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:10.753259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1ecfc2d9034c75a095f1e1b3bec8b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:10.764537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1ecfc2d9034c75a095f1e1b3bec8b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:10.766467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1ecfc2d9034c75a095f1e1b3bec8b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:10.816585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1ecfc2d9034c75a095f1e1b3bec8b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:10.835748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 974/1939] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:10 2022] DELETE /identity/v3/users/6f1ecfc2d9034c75a095f1e1b3bec8b7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:10.841408 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902a78-00e9-4daf-b28c-ba7ac0e301e2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:10.843786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902a78-00e9-4daf-b28c-ba7ac0e301e2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:10.844547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902a78-00e9-4daf-b28c-ba7ac0e301e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:10.885265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-67902a78-00e9-4daf-b28c-ba7ac0e301e2 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:10.887456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-67902a78-00e9-4daf-b28c-ba7ac0e301e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:10.952934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:10.954482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:11.015247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 966/1940] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:11.027417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67902a78-00e9-4daf-b28c-ba7ac0e301e2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:11.029620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-67902a78-00e9-4daf-b28c-ba7ac0e301e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:11.086927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80ec98-1741-4d7e-a2aa-3df112054e54 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:11.095464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7a616-6853-4c26-9cc9-844ddc98fe6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:11.096229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7a616-6853-4c26-9cc9-844ddc98fe6e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:11.096539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7a616-6853-4c26-9cc9-844ddc98fe6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:11.096898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7a616-6853-4c26-9cc9-844ddc98fe6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:11.099369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-51d7a616-6853-4c26-9cc9-844ddc98fe6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:11.110916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:11.129952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67902a78-00e9-4daf-b28c-ba7ac0e301e2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:11.137502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdf81f-f3e1-47c2-a06e-6557532d6b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:11.138250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdf81f-f3e1-47c2-a06e-6557532d6b09 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:11.138569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdf81f-f3e1-47c2-a06e-6557532d6b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:11.138908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdf81f-f3e1-47c2-a06e-6557532d6b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:11.151382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdf81f-f3e1-47c2-a06e-6557532d6b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:11.153164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdf81f-f3e1-47c2-a06e-6557532d6b09 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:11.157586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:11.166546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 967/1941] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:11.167606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdf81f-f3e1-47c2-a06e-6557532d6b09 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:11.169690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-74cdf81f-f3e1-47c2-a06e-6557532d6b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:11.184065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdf81f-f3e1-47c2-a06e-6557532d6b09 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:11.185796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7a616-6853-4c26-9cc9-844ddc98fe6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:11.187457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7a616-6853-4c26-9cc9-844ddc98fe6e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:11.190885 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:11.191953 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:11.192360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:11.193221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] PATH_INFO: `/v3/projects/29f165a13de3459884e2a6738d25c898` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:11.194127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f165a13de3459884e2a6738d25c898)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:11.196067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:11.201819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 975/1942] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:11.252244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f165a13de3459884e2a6738d25c898', 'request_id': 'req-14394e77-769b-42e1-9b6b-4db40520fe3f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.258965 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f165a13de3459884e2a6738d25c898', 'request_id': 'req-14394e77-769b-42e1-9b6b-4db40520fe3f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.266629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f165a13de3459884e2a6738d25c898', 'request_id': 'req-14394e77-769b-42e1-9b6b-4db40520fe3f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.286225 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] The token cache is being invalidate because project 29f165a13de3459884e2a6738d25c898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:11.286527 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.287235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.292444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 968/1943] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:11 2022] DELETE /identity/v3/projects/29f165a13de3459884e2a6738d25c898 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:11.294471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7a616-6853-4c26-9cc9-844ddc98fe6e service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:11.308314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7a616-6853-4c26-9cc9-844ddc98fe6e service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:11.378671 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:11.379627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:11.379932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:11.380357 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] PATH_INFO: `/v3/users/3619d771217946999534a0d70e54a99c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:11.382018 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3619d771217946999534a0d70e54a99c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:11.384413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:11.441515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3619d771217946999534a0d70e54a99c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.461922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3619d771217946999534a0d70e54a99c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.473637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3619d771217946999534a0d70e54a99c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.474422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3619d771217946999534a0d70e54a99c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.479594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:11.481851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:11.499804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3619d771217946999534a0d70e54a99c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.505812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14394e77-769b-42e1-9b6b-4db40520fe3f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:11.512660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:11.513510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 976/1944] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:11 2022] DELETE /identity/v3/users/3619d771217946999534a0d70e54a99c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:11.513624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:11.513806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:11.514148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] PATH_INFO: `/v3/projects/2c8be4622e744ee5974de1f268d8f1dd` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:11.516293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8be4622e744ee5974de1f268d8f1dd)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:11.518684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:11.582952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8be4622e744ee5974de1f268d8f1dd', 'request_id': 'req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.592370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8be4622e744ee5974de1f268d8f1dd', 'request_id': 'req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.600888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8be4622e744ee5974de1f268d8f1dd', 'request_id': 'req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.613980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] The token cache is being invalidate because project 2c8be4622e744ee5974de1f268d8f1dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:11.614272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.614906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.616529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 969/1945] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:11 2022] DELETE /identity/v3/projects/2c8be4622e744ee5974de1f268d8f1dd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:11.620542 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:11.621987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:11.652227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:11.709468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4443e6-707f-4ae8-9a70-b1e4398958db admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:11.779561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:11.780817 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:11.780817 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:11.781077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] PATH_INFO: `/v3/users/9d7c2ed9a9674d9caa45d83c7107692a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:11.782287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7c2ed9a9674d9caa45d83c7107692a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:11.785367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:11.864796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7c2ed9a9674d9caa45d83c7107692a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.886014 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7c2ed9a9674d9caa45d83c7107692a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.897335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7c2ed9a9674d9caa45d83c7107692a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.898257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7c2ed9a9674d9caa45d83c7107692a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.908872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7c2ed9a9674d9caa45d83c7107692a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:11.917418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 977/1946] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:11 2022] DELETE /identity/v3/users/9d7c2ed9a9674d9caa45d83c7107692a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:11.959164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:11.960940 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:11.988137 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8923a-a13a-4cef-a8a3-efe2a613b5be admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:12.073754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:12.074620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.074909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.075241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] PATH_INFO: `/v3/projects/6626b6a64b5b41b599463af5f985674d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.078202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6626b6a64b5b41b599463af5f985674d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:12.079477 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:12.089097 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:12.116242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:12.119165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:12.147029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6626b6a64b5b41b599463af5f985674d', 'request_id': 'req-2a20f59f-589b-40ac-a06f-b79b263877a4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.154409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6626b6a64b5b41b599463af5f985674d', 'request_id': 'req-2a20f59f-589b-40ac-a06f-b79b263877a4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.157815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98a76d-02f8-46b3-8653-8044f36585e8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:12.176649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6626b6a64b5b41b599463af5f985674d', 'request_id': 'req-2a20f59f-589b-40ac-a06f-b79b263877a4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.203003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] The token cache is being invalidate because project 6626b6a64b5b41b599463af5f985674d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:12.203003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.204439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2a20f59f-589b-40ac-a06f-b79b263877a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.207311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 970/1947] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:11 2022] DELETE /identity/v3/projects/6626b6a64b5b41b599463af5f985674d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:12.212522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9128-9641-4f17-b691-711cd4c66459 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.212522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9128-9641-4f17-b691-711cd4c66459 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.212750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9128-9641-4f17-b691-711cd4c66459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.242576 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1a5e9128-9641-4f17-b691-711cd4c66459 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:12.243934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1a5e9128-9641-4f17-b691-711cd4c66459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:12.249336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:12.285890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:12.287224 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.287521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.287805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] PATH_INFO: `/v3/users/9be8334176b742e7a8eec30d92641b12` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.289226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be8334176b742e7a8eec30d92641b12)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:12.292437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:12.315782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 971/1948] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:12.325009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1cec2-e17b-46ed-ab59-6c275dad57df None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.325291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1cec2-e17b-46ed-ab59-6c275dad57df None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.325588 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1cec2-e17b-46ed-ab59-6c275dad57df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.354758 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0ac1cec2-e17b-46ed-ab59-6c275dad57df None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:12.357755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0ac1cec2-e17b-46ed-ab59-6c275dad57df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:12.373611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 972/1949] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:12.373611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1cec2-e17b-46ed-ab59-6c275dad57df None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:12.375066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0ac1cec2-e17b-46ed-ab59-6c275dad57df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:12.384282 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be8334176b742e7a8eec30d92641b12'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.390223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1cec2-e17b-46ed-ab59-6c275dad57df None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:12.400470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be8334176b742e7a8eec30d92641b12'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.401546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:12.402415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.402748 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.403028 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] PATH_INFO: `/v3/projects/eb318bb531954b89aea620dcdcf6290d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.404251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb318bb531954b89aea620dcdcf6290d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:12.406217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:12.412606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be8334176b742e7a8eec30d92641b12'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.413319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be8334176b742e7a8eec30d92641b12'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.422766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be8334176b742e7a8eec30d92641b12'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.431189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 978/1950] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:12 2022] DELETE /identity/v3/users/9be8334176b742e7a8eec30d92641b12 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:12.432139 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:12.433621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:12.459462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb318bb531954b89aea620dcdcf6290d', 'request_id': 'req-29cd8431-e43b-4193-8449-35600c7255ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.468535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb318bb531954b89aea620dcdcf6290d', 'request_id': 'req-29cd8431-e43b-4193-8449-35600c7255ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.475930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb318bb531954b89aea620dcdcf6290d', 'request_id': 'req-29cd8431-e43b-4193-8449-35600c7255ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.492144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] The token cache is being invalidate because project eb318bb531954b89aea620dcdcf6290d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:12.492440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.493258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-29cd8431-e43b-4193-8449-35600c7255ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:12.495257 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 973/1951] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:12 2022] DELETE /identity/v3/projects/eb318bb531954b89aea620dcdcf6290d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:12.496847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa14117-7743-435e-96f7-c3a02e01af06 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.497217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa14117-7743-435e-96f7-c3a02e01af06 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.497654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa14117-7743-435e-96f7-c3a02e01af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.506734 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c292f-e210-4031-9ea2-e494a2f6905a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:12.522174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1fa14117-7743-435e-96f7-c3a02e01af06 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:12.523590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1fa14117-7743-435e-96f7-c3a02e01af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:12.530495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:12.577573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798971f7-3617-428b-8797-c29af607a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:12.578246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798971f7-3617-428b-8797-c29af607a3fc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.578531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798971f7-3617-428b-8797-c29af607a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.578807 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798971f7-3617-428b-8797-c29af607a3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.579878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798971f7-3617-428b-8797-c29af607a3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:12.581456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798971f7-3617-428b-8797-c29af607a3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:12.582785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798971f7-3617-428b-8797-c29af607a3fc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:12.598349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 979/1952] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:12.599674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea7bc-5c63-4dd6-bebc-1419e8fc3745 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.599967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea7bc-5c63-4dd6-bebc-1419e8fc3745 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.600277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea7bc-5c63-4dd6-bebc-1419e8fc3745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.610804 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 974/1953] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:12.613024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa14117-7743-435e-96f7-c3a02e01af06 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:12.614537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1fa14117-7743-435e-96f7-c3a02e01af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:12.621292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-01bea7bc-5c63-4dd6-bebc-1419e8fc3745 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:12.622819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-01bea7bc-5c63-4dd6-bebc-1419e8fc3745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:12.635511 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa14117-7743-435e-96f7-c3a02e01af06 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:12.641241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2069e0-3e23-4a64-ba7c-f5f6d8349b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:12.641967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2069e0-3e23-4a64-ba7c-f5f6d8349b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.642254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2069e0-3e23-4a64-ba7c-f5f6d8349b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.643288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2069e0-3e23-4a64-ba7c-f5f6d8349b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.644004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2069e0-3e23-4a64-ba7c-f5f6d8349b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:12.646204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2069e0-3e23-4a64-ba7c-f5f6d8349b51 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:12.665124 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 980/1954] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:12.665124 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bea7bc-5c63-4dd6-bebc-1419e8fc3745 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:12.667675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-01bea7bc-5c63-4dd6-bebc-1419e8fc3745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:12.673172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:12.701384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 975/1955] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:12 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:12.702921 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4365d-a81b-421a-8194-50f50cc1b43f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.703232 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4365d-a81b-421a-8194-50f50cc1b43f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.703513 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4365d-a81b-421a-8194-50f50cc1b43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.742658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bea7bc-5c63-4dd6-bebc-1419e8fc3745 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:12.750487 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-56f4365d-a81b-421a-8194-50f50cc1b43f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:12.752627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-56f4365d-a81b-421a-8194-50f50cc1b43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:12.803744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c52ae-34be-4090-a29c-3807bcbeb5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:12.804508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c52ae-34be-4090-a29c-3807bcbeb5ee service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.804847 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c52ae-34be-4090-a29c-3807bcbeb5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.805159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c52ae-34be-4090-a29c-3807bcbeb5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.879217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 976/1956] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:12.880189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4365d-a81b-421a-8194-50f50cc1b43f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:12.891176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4365d-a81b-421a-8194-50f50cc1b43f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:12.898500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657ca4d-5477-4602-babd-7654d43b76a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:12.899794 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ca4d-5477-4602-babd-7654d43b76a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.900323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ca4d-5477-4602-babd-7654d43b76a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.900872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ca4d-5477-4602-babd-7654d43b76a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.901961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657ca4d-5477-4602-babd-7654d43b76a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:12.905288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657ca4d-5477-4602-babd-7654d43b76a6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:12.912626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c52ae-34be-4090-a29c-3807bcbeb5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:12.914196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c52ae-34be-4090-a29c-3807bcbeb5ee service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:12.926251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 981/1957] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:12.927006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c52ae-34be-4090-a29c-3807bcbeb5ee service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:12.931715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 977/1958] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:12 2022] POST /identity/v3/users => generated 287 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:12.937157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657ca4d-5477-4602-babd-7654d43b76a6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:12.941826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c52ae-34be-4090-a29c-3807bcbeb5ee service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:12.947374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9626dda-0568-439a-ae64-0f165f9f49d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:12.948104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9626dda-0568-439a-ae64-0f165f9f49d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.948420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9626dda-0568-439a-ae64-0f165f9f49d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.948731 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9626dda-0568-439a-ae64-0f165f9f49d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.949539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9626dda-0568-439a-ae64-0f165f9f49d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:12.949878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9626dda-0568-439a-ae64-0f165f9f49d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:12.951292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657ca4d-5477-4602-babd-7654d43b76a6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:12.951561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9626dda-0568-439a-ae64-0f165f9f49d5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:12.958475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a5319-ba40-4d2f-a94f-f1c20eb19dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:12.960773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5319-ba40-4d2f-a94f-f1c20eb19dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.961219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5319-ba40-4d2f-a94f-f1c20eb19dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.961600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a5319-ba40-4d2f-a94f-f1c20eb19dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.962894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a5319-ba40-4d2f-a94f-f1c20eb19dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:12.965226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a5319-ba40-4d2f-a94f-f1c20eb19dfa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:12.966684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 982/1959] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:12.971153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9626dda-0568-439a-ae64-0f165f9f49d5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:12.982938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 978/1960] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:12.984121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a5319-ba40-4d2f-a94f-f1c20eb19dfa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:12.986891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9626dda-0568-439a-ae64-0f165f9f49d5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:12.993297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c3e39-7d1e-4d2a-95bb-6ab4ec4abace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:12.994226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3e39-7d1e-4d2a-95bb-6ab4ec4abace admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:12.994589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3e39-7d1e-4d2a-95bb-6ab4ec4abace admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:12.994952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3e39-7d1e-4d2a-95bb-6ab4ec4abace admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:12.995766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c3e39-7d1e-4d2a-95bb-6ab4ec4abace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:12.996296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a5319-ba40-4d2f-a94f-f1c20eb19dfa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:12.998035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c3e39-7d1e-4d2a-95bb-6ab4ec4abace admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.003683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee852ec-bdb8-48ee-af6d-4b061fa52b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.004405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee852ec-bdb8-48ee-af6d-4b061fa52b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.004693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee852ec-bdb8-48ee-af6d-4b061fa52b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.005031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee852ec-bdb8-48ee-af6d-4b061fa52b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.005973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee852ec-bdb8-48ee-af6d-4b061fa52b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.007946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee852ec-bdb8-48ee-af6d-4b061fa52b4d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.025393 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 979/1961] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:13.026542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee852ec-bdb8-48ee-af6d-4b061fa52b4d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.033244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 983/1962] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:12 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:13.037131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c3e39-7d1e-4d2a-95bb-6ab4ec4abace admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.037938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee852ec-bdb8-48ee-af6d-4b061fa52b4d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.076161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:13.094793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:13.108407 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20150f85-7b69-4a5b-9edb-1e99df7b58bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.109367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20150f85-7b69-4a5b-9edb-1e99df7b58bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.109951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20150f85-7b69-4a5b-9edb-1e99df7b58bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.109951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20150f85-7b69-4a5b-9edb-1e99df7b58bd admin admin] PATH_INFO: `/v3/projects/1f665ae92e6746ad9ae29abff05d2356/users/56e2081846054cc0aec81616726fe309/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.110906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c3e39-7d1e-4d2a-95bb-6ab4ec4abace admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.117232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb52f9-5c06-4df8-bfe4-e3713f0e8d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.118483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb52f9-5c06-4df8-bfe4-e3713f0e8d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.119088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb52f9-5c06-4df8-bfe4-e3713f0e8d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.119197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb52f9-5c06-4df8-bfe4-e3713f0e8d08 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.119839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb52f9-5c06-4df8-bfe4-e3713f0e8d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.122157 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb52f9-5c06-4df8-bfe4-e3713f0e8d08 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.127466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20150f85-7b69-4a5b-9edb-1e99df7b58bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f665ae92e6746ad9ae29abff05d2356, user_id=56e2081846054cc0aec81616726fe309, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.130343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20150f85-7b69-4a5b-9edb-1e99df7b58bd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.147150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 980/1963] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:13 2022] PUT /identity/v3/projects/1f665ae92e6746ad9ae29abff05d2356/users/56e2081846054cc0aec81616726fe309/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:13.158451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 984/1964] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:13 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:13.158660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20150f85-7b69-4a5b-9edb-1e99df7b58bd admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.159041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21901c3-2156-43e5-beab-38e9d9378b94 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.159607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21901c3-2156-43e5-beab-38e9d9378b94 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.159932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21901c3-2156-43e5-beab-38e9d9378b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.191164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d21901c3-2156-43e5-beab-38e9d9378b94 None None] MFA Rules not processed for user `56e2081846054cc0aec81616726fe309`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:13.192528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d21901c3-2156-43e5-beab-38e9d9378b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:13.235266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20150f85-7b69-4a5b-9edb-1e99df7b58bd admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.241152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f89d69-6208-4992-a369-2d2b3af1a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.241831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89d69-6208-4992-a369-2d2b3af1a2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.242121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89d69-6208-4992-a369-2d2b3af1a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.242406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89d69-6208-4992-a369-2d2b3af1a2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.243138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f89d69-6208-4992-a369-2d2b3af1a2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.244857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f89d69-6208-4992-a369-2d2b3af1a2a5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.259943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 981/1965] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:13.260817 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f89d69-6208-4992-a369-2d2b3af1a2a5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.273106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f89d69-6208-4992-a369-2d2b3af1a2a5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.278582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b950e-6f11-4a54-b782-e7cec80296fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.278840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b950e-6f11-4a54-b782-e7cec80296fc admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.279330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b950e-6f11-4a54-b782-e7cec80296fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.279449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b950e-6f11-4a54-b782-e7cec80296fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.280122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b950e-6f11-4a54-b782-e7cec80296fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.282005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b950e-6f11-4a54-b782-e7cec80296fc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.292799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 985/1966] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:13.303605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 982/1967] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:13.304364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21901c3-2156-43e5-beab-38e9d9378b94 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.310582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b950e-6f11-4a54-b782-e7cec80296fc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.314983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-aa3b950e-6f11-4a54-b782-e7cec80296fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:13.319757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21901c3-2156-43e5-beab-38e9d9378b94 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.331021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e35ed7-f138-4c33-93de-2c413bca2562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.332273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e35ed7-f138-4c33-93de-2c413bca2562 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.333177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e35ed7-f138-4c33-93de-2c413bca2562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.334054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e35ed7-f138-4c33-93de-2c413bca2562 admin admin] PATH_INFO: `/v3/projects/3cefaf6a10b241dcb93e0ae0466d1ad2/users/71ec11346460432fa384a900cb272151/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.355448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e35ed7-f138-4c33-93de-2c413bca2562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cefaf6a10b241dcb93e0ae0466d1ad2, user_id=71ec11346460432fa384a900cb272151, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.358320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e35ed7-f138-4c33-93de-2c413bca2562 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.374955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 986/1968] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:13 2022] PUT /identity/v3/projects/3cefaf6a10b241dcb93e0ae0466d1ad2/users/71ec11346460432fa384a900cb272151/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:13.386114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73b05-97c9-4b22-9274-c319c3489dcf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.386405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73b05-97c9-4b22-9274-c319c3489dcf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.386686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73b05-97c9-4b22-9274-c319c3489dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.390079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b950e-6f11-4a54-b782-e7cec80296fc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.422746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3ec73b05-97c9-4b22-9274-c319c3489dcf None None] MFA Rules not processed for user `71ec11346460432fa384a900cb272151`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:13.425228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ec73b05-97c9-4b22-9274-c319c3489dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:13.451178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4590a9b-2d31-405d-b645-db3031eb40d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.451178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4590a9b-2d31-405d-b645-db3031eb40d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.452061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4590a9b-2d31-405d-b645-db3031eb40d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.452061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4590a9b-2d31-405d-b645-db3031eb40d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.496779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:13.523768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 987/1969] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 22 12:24:13.524605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec73b05-97c9-4b22-9274-c319c3489dcf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.526177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ec73b05-97c9-4b22-9274-c319c3489dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:13.529342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4590a9b-2d31-405d-b645-db3031eb40d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.530879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4590a9b-2d31-405d-b645-db3031eb40d5 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.551566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 983/1970] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:13.551566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4590a9b-2d31-405d-b645-db3031eb40d5 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.551855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:13.633556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec73b05-97c9-4b22-9274-c319c3489dcf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.638554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4590a9b-2d31-405d-b645-db3031eb40d5 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.639896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.640878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.642076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.642355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] PATH_INFO: `/v3/projects/60f78592473842d1adad5a5c39f5a4fd` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.643778 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f78592473842d1adad5a5c39f5a4fd)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.644167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b742b72-a02a-4e08-b080-4f1f55b283ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.644903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742b72-a02a-4e08-b080-4f1f55b283ef admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.645334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742b72-a02a-4e08-b080-4f1f55b283ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.645623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742b72-a02a-4e08-b080-4f1f55b283ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.646119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.646331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b742b72-a02a-4e08-b080-4f1f55b283ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.648351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b742b72-a02a-4e08-b080-4f1f55b283ef admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.683857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 984/1971] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:13 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:13.683857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b742b72-a02a-4e08-b080-4f1f55b283ef admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.698096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f78592473842d1adad5a5c39f5a4fd', 'request_id': 'req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:13.704414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f78592473842d1adad5a5c39f5a4fd', 'request_id': 'req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:13.710453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f78592473842d1adad5a5c39f5a4fd', 'request_id': 'req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:13.724419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] The token cache is being invalidate because project 60f78592473842d1adad5a5c39f5a4fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:13.724945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:13.726439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:13.728743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 988/1972] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:13 2022] DELETE /identity/v3/projects/60f78592473842d1adad5a5c39f5a4fd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:13.729881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.731613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:13.755162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b742b72-a02a-4e08-b080-4f1f55b283ef admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.805107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806c7d7-3c78-43c8-8dcb-4ac8640b2209 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.810220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16848622-b7b5-4c00-a91d-a42522730ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.811159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16848622-b7b5-4c00-a91d-a42522730ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.811732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16848622-b7b5-4c00-a91d-a42522730ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.812058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16848622-b7b5-4c00-a91d-a42522730ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.812772 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16848622-b7b5-4c00-a91d-a42522730ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.815374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16848622-b7b5-4c00-a91d-a42522730ce2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.842085 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.842527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 989/1973] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:13 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:13.842624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.842624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.842624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] PATH_INFO: `/v3/users/56e2081846054cc0aec81616726fe309` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.842881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457318-b589-48cf-a662-25fe0b9e82df None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.842881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457318-b589-48cf-a662-25fe0b9e82df None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.842881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457318-b589-48cf-a662-25fe0b9e82df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.844091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e2081846054cc0aec81616726fe309)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.846792 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.849777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:13.863535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4d457318-b589-48cf-a662-25fe0b9e82df None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:13.864999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4d457318-b589-48cf-a662-25fe0b9e82df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:13.876085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 990/1974] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:13.876085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457318-b589-48cf-a662-25fe0b9e82df None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.884909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457318-b589-48cf-a662-25fe0b9e82df None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.890302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe68ad-cdfd-4b12-b968-f4c023687dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.891236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe68ad-cdfd-4b12-b968-f4c023687dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.891533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe68ad-cdfd-4b12-b968-f4c023687dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.891817 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe68ad-cdfd-4b12-b968-f4c023687dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.892616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe68ad-cdfd-4b12-b968-f4c023687dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.894355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe68ad-cdfd-4b12-b968-f4c023687dbc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:13.909051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 991/1975] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:13.909051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0bd0d-7f46-4be7-8aff-b3ade82f0afb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.909051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0bd0d-7f46-4be7-8aff-b3ade82f0afb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.909051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0bd0d-7f46-4be7-8aff-b3ade82f0afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.918958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e2081846054cc0aec81616726fe309'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:13.929999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-14a0bd0d-7f46-4be7-8aff-b3ade82f0afb None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:13.931236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-14a0bd0d-7f46-4be7-8aff-b3ade82f0afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:13.933002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e2081846054cc0aec81616726fe309'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:13.940183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 992/1976] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:13.941156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0bd0d-7f46-4be7-8aff-b3ade82f0afb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.945264 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e2081846054cc0aec81616726fe309'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:13.946071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e2081846054cc0aec81616726fe309'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:13.951867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0bd0d-7f46-4be7-8aff-b3ade82f0afb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:13.957803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062effda-f2ac-4915-99dc-8a3000e78245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:13.958704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062effda-f2ac-4915-99dc-8a3000e78245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:13.958993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062effda-f2ac-4915-99dc-8a3000e78245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:13.959274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062effda-f2ac-4915-99dc-8a3000e78245 admin admin] PATH_INFO: `/v3/projects/8dcc6ab6846b4cf5a2835636751d6999/users/0df7ff0774b54668afcb88ad877125a9/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:13.960345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e2081846054cc0aec81616726fe309'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:13.973148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 985/1977] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:13 2022] DELETE /identity/v3/users/56e2081846054cc0aec81616726fe309 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:13.973148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:13.973920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:13.975490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:13.981555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062effda-f2ac-4915-99dc-8a3000e78245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcc6ab6846b4cf5a2835636751d6999, user_id=0df7ff0774b54668afcb88ad877125a9, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:13.985572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062effda-f2ac-4915-99dc-8a3000e78245 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:14.004689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 993/1978] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:13 2022] PUT /identity/v3/projects/8dcc6ab6846b4cf5a2835636751d6999/users/0df7ff0774b54668afcb88ad877125a9/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:14.006505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13376d-076d-4c7d-92d8-df62c5a622f2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.006860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13376d-076d-4c7d-92d8-df62c5a622f2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.007382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13376d-076d-4c7d-92d8-df62c5a622f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.037005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7d13376d-076d-4c7d-92d8-df62c5a622f2 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:14.038557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7d13376d-076d-4c7d-92d8-df62c5a622f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:14.066824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2dc6a-2a0e-4718-9aa4-7e31d71b0823 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:14.113102 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 994/1979] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:14.116305 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13376d-076d-4c7d-92d8-df62c5a622f2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:14.117770 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7d13376d-076d-4c7d-92d8-df62c5a622f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:14.134222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13376d-076d-4c7d-92d8-df62c5a622f2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:14.135440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa0306-ec8f-433a-8978-769d1814c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:14.136145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa0306-ec8f-433a-8978-769d1814c5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.136462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa0306-ec8f-433a-8978-769d1814c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.136770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa0306-ec8f-433a-8978-769d1814c5d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.137602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa0306-ec8f-433a-8978-769d1814c5d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:14.137973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa0306-ec8f-433a-8978-769d1814c5d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:14.139640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa0306-ec8f-433a-8978-769d1814c5d9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:14.140530 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c327fb-56a7-4060-99b3-c9c15d864d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:14.141771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c327fb-56a7-4060-99b3-c9c15d864d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.142244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c327fb-56a7-4060-99b3-c9c15d864d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.143272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c327fb-56a7-4060-99b3-c9c15d864d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.144169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c327fb-56a7-4060-99b3-c9c15d864d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:14.146062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c327fb-56a7-4060-99b3-c9c15d864d3f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:14.154127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 986/1980] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:14.154959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa0306-ec8f-433a-8978-769d1814c5d9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:14.157008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-12aa0306-ec8f-433a-8978-769d1814c5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:14.190058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:14.192627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 995/1981] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:14.193700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c327fb-56a7-4060-99b3-c9c15d864d3f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:14.229883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c327fb-56a7-4060-99b3-c9c15d864d3f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:14.243467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa0306-ec8f-433a-8978-769d1814c5d9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:14.244651 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae741a-907e-4d51-b48e-abee5184d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:14.245342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae741a-907e-4d51-b48e-abee5184d7cf admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.245635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae741a-907e-4d51-b48e-abee5184d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.245924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae741a-907e-4d51-b48e-abee5184d7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.246632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae741a-907e-4d51-b48e-abee5184d7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:14.248784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4fbdc-a9f9-4f54-be1e-80c6cf486905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:14.248968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae741a-907e-4d51-b48e-abee5184d7cf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:14.249758 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4fbdc-a9f9-4f54-be1e-80c6cf486905 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.250167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4fbdc-a9f9-4f54-be1e-80c6cf486905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.250601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4fbdc-a9f9-4f54-be1e-80c6cf486905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.263668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4fbdc-a9f9-4f54-be1e-80c6cf486905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:14.266183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4fbdc-a9f9-4f54-be1e-80c6cf486905 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:14.282520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 987/1982] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:14.284310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4fbdc-a9f9-4f54-be1e-80c6cf486905 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:14.294880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4fbdc-a9f9-4f54-be1e-80c6cf486905 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:14.298861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 996/1983] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:14 2022] POST /identity/v3/projects => generated 359 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:14.301041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6c6f2-beeb-4425-a61e-55eb22550eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:14.302644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6c6f2-beeb-4425-a61e-55eb22550eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.302766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae741a-907e-4d51-b48e-abee5184d7cf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:14.302973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6c6f2-beeb-4425-a61e-55eb22550eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.303284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6c6f2-beeb-4425-a61e-55eb22550eb4 admin admin] PATH_INFO: `/v3/projects/8dcc6ab6846b4cf5a2835636751d6999/users/0df7ff0774b54668afcb88ad877125a9/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.316106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6c6f2-beeb-4425-a61e-55eb22550eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcc6ab6846b4cf5a2835636751d6999, user_id=0df7ff0774b54668afcb88ad877125a9, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:14.318993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6c6f2-beeb-4425-a61e-55eb22550eb4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:14.356060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 988/1984] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:14 2022] PUT /identity/v3/projects/8dcc6ab6846b4cf5a2835636751d6999/users/0df7ff0774b54668afcb88ad877125a9/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:14.362132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98039fb1-afec-402b-91a3-f622bc9ed7f7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.362472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98039fb1-afec-402b-91a3-f622bc9ed7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.362727 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98039fb1-afec-402b-91a3-f622bc9ed7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.411313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae741a-907e-4d51-b48e-abee5184d7cf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:14.433125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-98039fb1-afec-402b-91a3-f622bc9ed7f7 None None] MFA Rules not processed for user `0df7ff0774b54668afcb88ad877125a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:14.435286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-98039fb1-afec-402b-91a3-f622bc9ed7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:14.507469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abdbd2-8b62-4cd9-955b-b4702dd515e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:14.508585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abdbd2-8b62-4cd9-955b-b4702dd515e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.508922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abdbd2-8b62-4cd9-955b-b4702dd515e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.509278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abdbd2-8b62-4cd9-955b-b4702dd515e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.510268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abdbd2-8b62-4cd9-955b-b4702dd515e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:14.513104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abdbd2-8b62-4cd9-955b-b4702dd515e3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:14.526722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:14.546334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 997/1985] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:14 2022] POST /identity/v3/users => generated 280 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:14.552112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abdbd2-8b62-4cd9-955b-b4702dd515e3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:14.576185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 989/1986] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:14.579041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abdbd2-8b62-4cd9-955b-b4702dd515e3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:14.584793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211696d1-ce7b-4bed-a217-28b522af22f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:14.585714 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211696d1-ce7b-4bed-a217-28b522af22f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.586072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211696d1-ce7b-4bed-a217-28b522af22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.586424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211696d1-ce7b-4bed-a217-28b522af22f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.587261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211696d1-ce7b-4bed-a217-28b522af22f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:14.589209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211696d1-ce7b-4bed-a217-28b522af22f8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:14.603069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98039fb1-afec-402b-91a3-f622bc9ed7f7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:14.603640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 998/1987] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:14.607251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211696d1-ce7b-4bed-a217-28b522af22f8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:14.607981 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-98039fb1-afec-402b-91a3-f622bc9ed7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:14.619820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211696d1-ce7b-4bed-a217-28b522af22f8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:14.627334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c013e-5819-485f-9f4a-5e20196f4bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:14.628360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c013e-5819-485f-9f4a-5e20196f4bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.628725 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c013e-5819-485f-9f4a-5e20196f4bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.629134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c013e-5819-485f-9f4a-5e20196f4bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.630604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c013e-5819-485f-9f4a-5e20196f4bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:14.632603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c013e-5819-485f-9f4a-5e20196f4bcc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:14.647633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 999/1988] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:14.652478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c013e-5819-485f-9f4a-5e20196f4bcc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:14.670867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c013e-5819-485f-9f4a-5e20196f4bcc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:14.685155 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01474b-273f-4835-b71b-f33247dcbd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:14.686326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01474b-273f-4835-b71b-f33247dcbd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.686719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01474b-273f-4835-b71b-f33247dcbd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.687675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01474b-273f-4835-b71b-f33247dcbd2c admin admin] PATH_INFO: `/v3/projects/7b9bf5ff5935418e80bd0463837c01a6/users/3952e18e5afb41e2916ad1c7a0f7f6df/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.692056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98039fb1-afec-402b-91a3-f622bc9ed7f7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:14.695898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b09fe7-882b-479f-9444-a4cc93feb96f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:14.696658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09fe7-882b-479f-9444-a4cc93feb96f service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.697033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09fe7-882b-479f-9444-a4cc93feb96f service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.697380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09fe7-882b-479f-9444-a4cc93feb96f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.705521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01474b-273f-4835-b71b-f33247dcbd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9bf5ff5935418e80bd0463837c01a6, user_id=3952e18e5afb41e2916ad1c7a0f7f6df, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:14.708502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b09fe7-882b-479f-9444-a4cc93feb96f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:14.709241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01474b-273f-4835-b71b-f33247dcbd2c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:14.710122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b09fe7-882b-479f-9444-a4cc93feb96f service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:14.723272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 990/1989] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:14.726642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1000/1990] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:14 2022] PUT /identity/v3/projects/7b9bf5ff5935418e80bd0463837c01a6/users/3952e18e5afb41e2916ad1c7a0f7f6df/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:14.738481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0314e7-78f7-473a-9280-5e2a2f9f0f7c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:14.738481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0314e7-78f7-473a-9280-5e2a2f9f0f7c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:14.738481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0314e7-78f7-473a-9280-5e2a2f9f0f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:14.779607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cb0314e7-78f7-473a-9280-5e2a2f9f0f7c None None] MFA Rules not processed for user `3952e18e5afb41e2916ad1c7a0f7f6df`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:14.780961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cb0314e7-78f7-473a-9280-5e2a2f9f0f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:14.839383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:14.910573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 991/1991] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:14 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:15.008146 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01474b-273f-4835-b71b-f33247dcbd2c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:15.087135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01474b-273f-4835-b71b-f33247dcbd2c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:15.090957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788cdd5-6c2b-4335-8106-68734233ebad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:15.091712 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788cdd5-6c2b-4335-8106-68734233ebad service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:15.092134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788cdd5-6c2b-4335-8106-68734233ebad service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:15.092492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788cdd5-6c2b-4335-8106-68734233ebad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:15.102519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788cdd5-6c2b-4335-8106-68734233ebad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:15.104460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788cdd5-6c2b-4335-8106-68734233ebad service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:15.114924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1001/1992] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:15.129880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0314e7-78f7-473a-9280-5e2a2f9f0f7c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:15.203544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0314e7-78f7-473a-9280-5e2a2f9f0f7c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:15.209621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:15.210801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:15.211089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:15.211388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] PATH_INFO: `/v3/users/3952e18e5afb41e2916ad1c7a0f7f6df` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:15.212810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3952e18e5afb41e2916ad1c7a0f7f6df)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:15.215534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:15.292908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3952e18e5afb41e2916ad1c7a0f7f6df'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.315771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3952e18e5afb41e2916ad1c7a0f7f6df'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.330685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3952e18e5afb41e2916ad1c7a0f7f6df'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.332568 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3952e18e5afb41e2916ad1c7a0f7f6df'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.343382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3952e18e5afb41e2916ad1c7a0f7f6df'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.362475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 992/1993] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:15 2022] DELETE /identity/v3/users/3952e18e5afb41e2916ad1c7a0f7f6df => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:15.369005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3256-53d5-46a4-a4d3-6c64e89228de None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:15.369378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3256-53d5-46a4-a4d3-6c64e89228de None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:15.369747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3256-53d5-46a4-a4d3-6c64e89228de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:15.392269 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-65ce3256-53d5-46a4-a4d3-6c64e89228de None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:15.393819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-65ce3256-53d5-46a4-a4d3-6c64e89228de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:15.476231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1002/1994] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:15.480341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:15.481812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:15.489699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce3256-53d5-46a4-a4d3-6c64e89228de None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:15.492221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-65ce3256-53d5-46a4-a4d3-6c64e89228de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:15.502300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb2a5c-f56c-414f-a7d6-eb62da11f79f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:15.513834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8eb1e3-1c85-45a4-9081-662a4f88914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:15.514984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eb1e3-1c85-45a4-9081-662a4f88914c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:15.515340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eb1e3-1c85-45a4-9081-662a4f88914c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:15.515690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eb1e3-1c85-45a4-9081-662a4f88914c admin admin] PATH_INFO: `/v3/users/f6f512c88a6b4a39b4159715dd78fac5` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:15.517973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8eb1e3-1c85-45a4-9081-662a4f88914c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f512c88a6b4a39b4159715dd78fac5)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:15.520961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8eb1e3-1c85-45a4-9081-662a4f88914c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:15.597198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:15.603241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0b8eb1e3-1c85-45a4-9081-662a4f88914c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f512c88a6b4a39b4159715dd78fac5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.604573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce3256-53d5-46a4-a4d3-6c64e89228de None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:15.612209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7cd16-c2e9-4241-bfe6-9a79db6951be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:15.613283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7cd16-c2e9-4241-bfe6-9a79db6951be service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:15.613621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7cd16-c2e9-4241-bfe6-9a79db6951be service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:15.613902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7cd16-c2e9-4241-bfe6-9a79db6951be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:15.623388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:15.624936 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0b8eb1e3-1c85-45a4-9081-662a4f88914c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f512c88a6b4a39b4159715dd78fac5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.628694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7cd16-c2e9-4241-bfe6-9a79db6951be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:15.631189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7cd16-c2e9-4241-bfe6-9a79db6951be service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:15.635138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0b8eb1e3-1c85-45a4-9081-662a4f88914c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f512c88a6b4a39b4159715dd78fac5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.636417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0b8eb1e3-1c85-45a4-9081-662a4f88914c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f512c88a6b4a39b4159715dd78fac5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.646264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1003/1995] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:15.647141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7cd16-c2e9-4241-bfe6-9a79db6951be service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:15.648839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0b8eb1e3-1c85-45a4-9081-662a4f88914c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f512c88a6b4a39b4159715dd78fac5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.649054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c8f7cd16-c2e9-4241-bfe6-9a79db6951be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:15.659938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 993/1996] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:15 2022] DELETE /identity/v3/users/f6f512c88a6b4a39b4159715dd78fac5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:15.663597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7cd16-c2e9-4241-bfe6-9a79db6951be service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:15.665007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e5bb-9618-4c6e-9844-2159050dcdd9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:15.665551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e5bb-9618-4c6e-9844-2159050dcdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:15.666253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e5bb-9618-4c6e-9844-2159050dcdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:15.719258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d8a6e5bb-9618-4c6e-9844-2159050dcdd9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:15.722457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d8a6e5bb-9618-4c6e-9844-2159050dcdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:15.790184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:15.791420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:15.791865 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:15.792744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] PATH_INFO: `/v3/projects/1f665ae92e6746ad9ae29abff05d2356` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:15.794434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f665ae92e6746ad9ae29abff05d2356)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:15.797461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:15.833884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 994/1997] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:15.833884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6e5bb-9618-4c6e-9844-2159050dcdd9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:15.835945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d8a6e5bb-9618-4c6e-9844-2159050dcdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:15.853774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6e5bb-9618-4c6e-9844-2159050dcdd9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:15.874132 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f665ae92e6746ad9ae29abff05d2356', 'request_id': 'req-cbb3b733-9cff-4ff0-ba80-947412bed53b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.881792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f665ae92e6746ad9ae29abff05d2356', 'request_id': 'req-cbb3b733-9cff-4ff0-ba80-947412bed53b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.888483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f665ae92e6746ad9ae29abff05d2356', 'request_id': 'req-cbb3b733-9cff-4ff0-ba80-947412bed53b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.904826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] The token cache is being invalidate because project 1f665ae92e6746ad9ae29abff05d2356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:15.905120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.906199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:15.911786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1004/1998] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:15 2022] DELETE /identity/v3/projects/1f665ae92e6746ad9ae29abff05d2356 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:15.912886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:15.914477 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:15.972403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5563af-0cf8-4b9a-a90f-2f8ed5275950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:15.976146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5563af-0cf8-4b9a-a90f-2f8ed5275950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:15.977655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5563af-0cf8-4b9a-a90f-2f8ed5275950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:15.977655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5563af-0cf8-4b9a-a90f-2f8ed5275950 admin admin] PATH_INFO: `/v3/users/71ec11346460432fa384a900cb272151` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:15.989864 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5563af-0cf8-4b9a-a90f-2f8ed5275950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ec11346460432fa384a900cb272151)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:15.994652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5563af-0cf8-4b9a-a90f-2f8ed5275950 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:16.006954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3b733-9cff-4ff0-ba80-947412bed53b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:16.013480 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da7bf7-3b7b-40cb-bc4a-dea6fe0dcae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:16.016489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da7bf7-3b7b-40cb-bc4a-dea6fe0dcae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.017012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da7bf7-3b7b-40cb-bc4a-dea6fe0dcae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.018001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da7bf7-3b7b-40cb-bc4a-dea6fe0dcae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.020170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-60da7bf7-3b7b-40cb-bc4a-dea6fe0dcae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:16.042761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da7bf7-3b7b-40cb-bc4a-dea6fe0dcae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:16.044522 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da7bf7-3b7b-40cb-bc4a-dea6fe0dcae3 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:16.055801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1005/1999] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:16.065820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9bb7e-7656-4d10-a3dd-63a1e689dd07 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.066120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9bb7e-7656-4d10-a3dd-63a1e689dd07 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.066418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9bb7e-7656-4d10-a3dd-63a1e689dd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.095113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a5563af-0cf8-4b9a-a90f-2f8ed5275950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ec11346460432fa384a900cb272151'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.114385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-39d9bb7e-7656-4d10-a3dd-63a1e689dd07 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:16.118237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-39d9bb7e-7656-4d10-a3dd-63a1e689dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:16.124564 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:16.129839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a5563af-0cf8-4b9a-a90f-2f8ed5275950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ec11346460432fa384a900cb272151'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.135597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1006/2000] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:16.136308 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9bb7e-7656-4d10-a3dd-63a1e689dd07 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:16.143264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-39d9bb7e-7656-4d10-a3dd-63a1e689dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:16.146851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a5563af-0cf8-4b9a-a90f-2f8ed5275950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ec11346460432fa384a900cb272151'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.147575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a5563af-0cf8-4b9a-a90f-2f8ed5275950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ec11346460432fa384a900cb272151'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.157242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a5563af-0cf8-4b9a-a90f-2f8ed5275950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ec11346460432fa384a900cb272151'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.167182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9bb7e-7656-4d10-a3dd-63a1e689dd07 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:16.175630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 995/2001] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:15 2022] DELETE /identity/v3/users/71ec11346460432fa384a900cb272151 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:16.175630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5ee30-0fed-40f1-aabb-1952635d58e7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.175630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5ee30-0fed-40f1-aabb-1952635d58e7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.175929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5ee30-0fed-40f1-aabb-1952635d58e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.178351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:16.180011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.181735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.182072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] PATH_INFO: `/v3/projects/7b9bf5ff5935418e80bd0463837c01a6` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.183474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9bf5ff5935418e80bd0463837c01a6)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:16.186229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:16.198409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c3a5ee30-0fed-40f1-aabb-1952635d58e7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:16.199979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c3a5ee30-0fed-40f1-aabb-1952635d58e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:16.205597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:16.249916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9bf5ff5935418e80bd0463837c01a6', 'request_id': 'req-3611ba2f-44d1-404a-87aa-b8b1a7679803'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.257209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9bf5ff5935418e80bd0463837c01a6', 'request_id': 'req-3611ba2f-44d1-404a-87aa-b8b1a7679803'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.263745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9bf5ff5935418e80bd0463837c01a6', 'request_id': 'req-3611ba2f-44d1-404a-87aa-b8b1a7679803'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.281239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] The token cache is being invalidate because project 7b9bf5ff5935418e80bd0463837c01a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:16.281624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.282646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.283917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 996/2002] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:16.285379 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1007/2003] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:16 2022] DELETE /identity/v3/projects/7b9bf5ff5935418e80bd0463837c01a6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:16.285541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d71f2d-3916-4a44-910c-979314e12434 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.285896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d71f2d-3916-4a44-910c-979314e12434 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.286274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d71f2d-3916-4a44-910c-979314e12434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.288530 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:16.292188 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:16.312333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d1d71f2d-3916-4a44-910c-979314e12434 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:16.313975 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d1d71f2d-3916-4a44-910c-979314e12434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:16.401128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 997/2004] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:16.401128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6d14c-2ea0-4c04-a08f-898548ec83ce None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.401128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6d14c-2ea0-4c04-a08f-898548ec83ce None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.401128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6d14c-2ea0-4c04-a08f-898548ec83ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.417708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-15c6d14c-2ea0-4c04-a08f-898548ec83ce None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:16.418994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-15c6d14c-2ea0-4c04-a08f-898548ec83ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:16.422711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611ba2f-44d1-404a-87aa-b8b1a7679803 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:16.429477 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c0b30-8eb6-4435-aa70-fd56f583af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:16.430261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0b30-8eb6-4435-aa70-fd56f583af4e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.430620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0b30-8eb6-4435-aa70-fd56f583af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.431081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 998/2005] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:16.431200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c0b30-8eb6-4435-aa70-fd56f583af4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.432461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c0b30-8eb6-4435-aa70-fd56f583af4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:16.432867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c0b30-8eb6-4435-aa70-fd56f583af4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:16.434636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c0b30-8eb6-4435-aa70-fd56f583af4e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:16.439864 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d592f6-925c-44eb-a50e-f7e0ed5c69ac None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.440200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d592f6-925c-44eb-a50e-f7e0ed5c69ac None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.440491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d592f6-925c-44eb-a50e-f7e0ed5c69ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.452090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1008/2006] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:16.453553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c0b30-8eb6-4435-aa70-fd56f583af4e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:16.456822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7f7c0b30-8eb6-4435-aa70-fd56f583af4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:16.460790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-56d592f6-925c-44eb-a50e-f7e0ed5c69ac None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:16.462267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-56d592f6-925c-44eb-a50e-f7e0ed5c69ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:16.476364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 999/2007] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:16.477338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d592f6-925c-44eb-a50e-f7e0ed5c69ac None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:16.489688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d592f6-925c-44eb-a50e-f7e0ed5c69ac None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:16.496760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b754dc4-8143-4d51-ac18-f74c3b59cb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:16.498135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b754dc4-8143-4d51-ac18-f74c3b59cb9a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.498428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b754dc4-8143-4d51-ac18-f74c3b59cb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.499265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b754dc4-8143-4d51-ac18-f74c3b59cb9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.500111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b754dc4-8143-4d51-ac18-f74c3b59cb9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:16.503249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b754dc4-8143-4d51-ac18-f74c3b59cb9a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:16.525976 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c0b30-8eb6-4435-aa70-fd56f583af4e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:16.531027 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286984b-d5ba-472c-8733-4ab35e4b5918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:16.532435 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286984b-d5ba-472c-8733-4ab35e4b5918 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.532687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286984b-d5ba-472c-8733-4ab35e4b5918 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.533112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286984b-d5ba-472c-8733-4ab35e4b5918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.546335 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1000/2008] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:16 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:16.548494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b754dc4-8143-4d51-ac18-f74c3b59cb9a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:16.551497 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286984b-d5ba-472c-8733-4ab35e4b5918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:16.553538 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286984b-d5ba-472c-8733-4ab35e4b5918 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:16.568808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1009/2009] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:16.570504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286984b-d5ba-472c-8733-4ab35e4b5918 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:16.586916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286984b-d5ba-472c-8733-4ab35e4b5918 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:16.623339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:16.639800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b754dc4-8143-4d51-ac18-f74c3b59cb9a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:16.651509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a896b-24cc-46b2-a284-61f9e167d264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:16.652240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a896b-24cc-46b2-a284-61f9e167d264 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.652535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a896b-24cc-46b2-a284-61f9e167d264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.652821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a896b-24cc-46b2-a284-61f9e167d264 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.653910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a896b-24cc-46b2-a284-61f9e167d264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:16.654228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a896b-24cc-46b2-a284-61f9e167d264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:16.657130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:16.657759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a896b-24cc-46b2-a284-61f9e167d264 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:16.700638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97597085-fbf7-43ea-9814-07db2ef446b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:16.701828 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97597085-fbf7-43ea-9814-07db2ef446b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.706039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97597085-fbf7-43ea-9814-07db2ef446b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.706192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1001/2010] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:16.706304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97597085-fbf7-43ea-9814-07db2ef446b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.706402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a896b-24cc-46b2-a284-61f9e167d264 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:16.706489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97597085-fbf7-43ea-9814-07db2ef446b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:16.706581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ff3a896b-24cc-46b2-a284-61f9e167d264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:16.706700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97597085-fbf7-43ea-9814-07db2ef446b8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:16.733406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a896b-24cc-46b2-a284-61f9e167d264 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:16.738392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1010/2011] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:16 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:16.738392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97597085-fbf7-43ea-9814-07db2ef446b8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:16.746911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:16.751389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.751531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97597085-fbf7-43ea-9814-07db2ef446b8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:16.751730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.753856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] PATH_INFO: `/v3/projects/5a68866c7d2d41e98fb602341321d483` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.756392 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a68866c7d2d41e98fb602341321d483)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:16.756810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c92c7-3f7e-44e4-a8d6-eb5ecf07f6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:16.757773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c92c7-3f7e-44e4-a8d6-eb5ecf07f6fb admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.757990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c92c7-3f7e-44e4-a8d6-eb5ecf07f6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.758284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c92c7-3f7e-44e4-a8d6-eb5ecf07f6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.758976 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c92c7-3f7e-44e4-a8d6-eb5ecf07f6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:16.761037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c92c7-3f7e-44e4-a8d6-eb5ecf07f6fb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:16.767444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:16.824239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1011/2012] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:16 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:16.824239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c92c7-3f7e-44e4-a8d6-eb5ecf07f6fb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:16.838383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a68866c7d2d41e98fb602341321d483', 'request_id': 'req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.848206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a68866c7d2d41e98fb602341321d483', 'request_id': 'req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.855771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a68866c7d2d41e98fb602341321d483', 'request_id': 'req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.882126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] The token cache is being invalidate because project 5a68866c7d2d41e98fb602341321d483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:16.882720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.883783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:16.885897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1002/2013] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:16 2022] DELETE /identity/v3/projects/5a68866c7d2d41e98fb602341321d483 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:16.886644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:16.895324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:16.940587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c92c7-3f7e-44e4-a8d6-eb5ecf07f6fb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:16.952776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c238-3ee3-42c0-9529-8121f919cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:16.953483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c238-3ee3-42c0-9529-8121f919cf8d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:16.953789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c238-3ee3-42c0-9529-8121f919cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:16.954061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c238-3ee3-42c0-9529-8121f919cf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:16.956305 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016c238-3ee3-42c0-9529-8121f919cf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:16.958255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016c238-3ee3-42c0-9529-8121f919cf8d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:16.984619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1012/2014] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:16.988522 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c238-3ee3-42c0-9529-8121f919cf8d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:16.993002 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c016c238-3ee3-42c0-9529-8121f919cf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:17.028329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd2e46-c4f5-4776-ae29-e2831fcd66fe admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:17.029226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c238-3ee3-42c0-9529-8121f919cf8d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:17.037248 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb6ef7-864a-48b9-af7b-1df9bafa092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:17.037939 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb6ef7-864a-48b9-af7b-1df9bafa092a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:17.038229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb6ef7-864a-48b9-af7b-1df9bafa092a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:17.038502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb6ef7-864a-48b9-af7b-1df9bafa092a admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:17.039213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb6ef7-864a-48b9-af7b-1df9bafa092a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:17.041208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb6ef7-864a-48b9-af7b-1df9bafa092a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:17.049628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:17.050460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:17.050747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:17.051029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] PATH_INFO: `/v3/users/4da3833d9e6e42ce93e68d48b8ce1bc7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:17.053346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da3833d9e6e42ce93e68d48b8ce1bc7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:17.055922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:17.082723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1003/2015] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:16 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:17.083851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb6ef7-864a-48b9-af7b-1df9bafa092a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:17.087300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e0eb6ef7-864a-48b9-af7b-1df9bafa092a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:17.103183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb6ef7-864a-48b9-af7b-1df9bafa092a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:17.109181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bc0eb-35c7-406e-a569-19295350ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:17.110014 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bc0eb-35c7-406e-a569-19295350ba2f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:17.110310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bc0eb-35c7-406e-a569-19295350ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:17.110596 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bc0eb-35c7-406e-a569-19295350ba2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:17.116444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bc0eb-35c7-406e-a569-19295350ba2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:17.119527 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bc0eb-35c7-406e-a569-19295350ba2f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:17.123365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da3833d9e6e42ce93e68d48b8ce1bc7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.135050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1004/2016] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:17.136269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bc0eb-35c7-406e-a569-19295350ba2f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:17.138441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ab1bc0eb-35c7-406e-a569-19295350ba2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:17.141726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da3833d9e6e42ce93e68d48b8ce1bc7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.152161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da3833d9e6e42ce93e68d48b8ce1bc7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.152943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da3833d9e6e42ce93e68d48b8ce1bc7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.155486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bc0eb-35c7-406e-a569-19295350ba2f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:17.161104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:17.162309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:17.162709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da3833d9e6e42ce93e68d48b8ce1bc7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.163022 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:17.163639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] PATH_INFO: `/v3/projects/3cefaf6a10b241dcb93e0ae0466d1ad2` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:17.166199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cefaf6a10b241dcb93e0ae0466d1ad2)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:17.168813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:17.172096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1013/2017] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:16 2022] DELETE /identity/v3/users/4da3833d9e6e42ce93e68d48b8ce1bc7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:17.173198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:17.186528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:17.228588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:17.240208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:17.260470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cefaf6a10b241dcb93e0ae0466d1ad2', 'request_id': 'req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.281597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cefaf6a10b241dcb93e0ae0466d1ad2', 'request_id': 'req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.298353 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cefaf6a10b241dcb93e0ae0466d1ad2', 'request_id': 'req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.318091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] The token cache is being invalidate because project 3cefaf6a10b241dcb93e0ae0466d1ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:17.318685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.319363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.325833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1005/2018] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:17 2022] DELETE /identity/v3/projects/3cefaf6a10b241dcb93e0ae0466d1ad2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:17.325833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:17.326104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba946ed-e587-43d7-b2bd-c8b9dfe78699 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:17.328047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:17.444287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16189f-934c-4087-9078-82c7e9e75647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:17.445595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16189f-934c-4087-9078-82c7e9e75647 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:17.446103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16189f-934c-4087-9078-82c7e9e75647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:17.446720 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16189f-934c-4087-9078-82c7e9e75647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:17.448049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16189f-934c-4087-9078-82c7e9e75647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:17.450189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16189f-934c-4087-9078-82c7e9e75647 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:17.455669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b9123-a51d-4004-8c9d-bf3a2805ec94 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:17.464507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1014/2019] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:17.465666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16189f-934c-4087-9078-82c7e9e75647 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:17.469173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1b16189f-934c-4087-9078-82c7e9e75647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:17.469468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9be84-0b0f-4b4a-8066-52443b1f1b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:17.470948 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9be84-0b0f-4b4a-8066-52443b1f1b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:17.471235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9be84-0b0f-4b4a-8066-52443b1f1b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:17.471657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9be84-0b0f-4b4a-8066-52443b1f1b56 admin admin] PATH_INFO: `/v3/projects/33437b9853ac4280967deddfac95e51c/users/c43de58b61f748d3bacccc0d78498ab9/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:17.486890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16189f-934c-4087-9078-82c7e9e75647 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:17.495872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba417280-319c-4796-8ee5-1efbfe2cfa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:17.497068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417280-319c-4796-8ee5-1efbfe2cfa39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:17.497572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417280-319c-4796-8ee5-1efbfe2cfa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:17.498303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417280-319c-4796-8ee5-1efbfe2cfa39 admin admin] PATH_INFO: `/v3/users/0df7ff0774b54668afcb88ad877125a9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:17.500319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417280-319c-4796-8ee5-1efbfe2cfa39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df7ff0774b54668afcb88ad877125a9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:17.504381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417280-319c-4796-8ee5-1efbfe2cfa39 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:17.506252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9be84-0b0f-4b4a-8066-52443b1f1b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33437b9853ac4280967deddfac95e51c, user_id=c43de58b61f748d3bacccc0d78498ab9, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:17.509571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9be84-0b0f-4b4a-8066-52443b1f1b56 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:17.535779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1006/2020] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:17 2022] PUT /identity/v3/projects/33437b9853ac4280967deddfac95e51c/users/c43de58b61f748d3bacccc0d78498ab9/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:17.539009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9be84-0b0f-4b4a-8066-52443b1f1b56 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:17.542575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1da9be84-0b0f-4b4a-8066-52443b1f1b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:17.598460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ba417280-319c-4796-8ee5-1efbfe2cfa39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df7ff0774b54668afcb88ad877125a9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.615010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ba417280-319c-4796-8ee5-1efbfe2cfa39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df7ff0774b54668afcb88ad877125a9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.629991 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ba417280-319c-4796-8ee5-1efbfe2cfa39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df7ff0774b54668afcb88ad877125a9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.633215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ba417280-319c-4796-8ee5-1efbfe2cfa39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df7ff0774b54668afcb88ad877125a9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.647434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ba417280-319c-4796-8ee5-1efbfe2cfa39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df7ff0774b54668afcb88ad877125a9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.658685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1015/2021] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:17 2022] DELETE /identity/v3/users/0df7ff0774b54668afcb88ad877125a9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:17.660419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4072d-415c-421a-847c-7efbbcecdd88 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:17.660888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4072d-415c-421a-847c-7efbbcecdd88 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:17.661355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4072d-415c-421a-847c-7efbbcecdd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:17.674827 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9be84-0b0f-4b4a-8066-52443b1f1b56 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:17.731479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ddb4072d-415c-421a-847c-7efbbcecdd88 None None] MFA Rules not processed for user `c43de58b61f748d3bacccc0d78498ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:17.733160 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ddb4072d-415c-421a-847c-7efbbcecdd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:17.749607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:17.774278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc86d7b-7f2f-4634-9586-2767dd17486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:17.774896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86d7b-7f2f-4634-9586-2767dd17486b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:17.775185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86d7b-7f2f-4634-9586-2767dd17486b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:17.775468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86d7b-7f2f-4634-9586-2767dd17486b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:17.776278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc86d7b-7f2f-4634-9586-2767dd17486b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:17.778047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc86d7b-7f2f-4634-9586-2767dd17486b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:17.780636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:17.800984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1007/2022] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:17.801906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc86d7b-7f2f-4634-9586-2767dd17486b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:17.806305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8bc86d7b-7f2f-4634-9586-2767dd17486b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:17.823008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc86d7b-7f2f-4634-9586-2767dd17486b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:17.856868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:17.857797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:17.858087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:17.858399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] PATH_INFO: `/v3/projects/67be37d4f5914952b3450885c1901883` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:17.859723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67be37d4f5914952b3450885c1901883)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:17.861909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:17.870187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1016/2023] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:17.871493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4072d-415c-421a-847c-7efbbcecdd88 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:17.874184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ddb4072d-415c-421a-847c-7efbbcecdd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:17.927899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4072d-415c-421a-847c-7efbbcecdd88 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:17.932191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98977602-2464-4155-8af7-571bc6cf648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:17.933741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977602-2464-4155-8af7-571bc6cf648a admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:17.934032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977602-2464-4155-8af7-571bc6cf648a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:17.934359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977602-2464-4155-8af7-571bc6cf648a admin admin] PATH_INFO: `/v3/projects/7c31c09dc65e417288a36b2146a926cb/users/bd7324f7539840b08c17d39d297eb99e/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:17.954342 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98977602-2464-4155-8af7-571bc6cf648a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c31c09dc65e417288a36b2146a926cb, user_id=bd7324f7539840b08c17d39d297eb99e, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:17.958272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98977602-2464-4155-8af7-571bc6cf648a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:17.967019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67be37d4f5914952b3450885c1901883', 'request_id': 'req-b4c4df03-8994-44a4-9683-79307673e816'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.977350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1017/2024] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:17 2022] PUT /identity/v3/projects/7c31c09dc65e417288a36b2146a926cb/users/bd7324f7539840b08c17d39d297eb99e/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:17.978257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98977602-2464-4155-8af7-571bc6cf648a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:17.985592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67be37d4f5914952b3450885c1901883', 'request_id': 'req-b4c4df03-8994-44a4-9683-79307673e816'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:17.990703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-98977602-2464-4155-8af7-571bc6cf648a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:17.995698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67be37d4f5914952b3450885c1901883', 'request_id': 'req-b4c4df03-8994-44a4-9683-79307673e816'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.014389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] The token cache is being invalidate because project 67be37d4f5914952b3450885c1901883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:18.014801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.015609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b4c4df03-8994-44a4-9683-79307673e816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.021215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1008/2025] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:17 2022] DELETE /identity/v3/projects/67be37d4f5914952b3450885c1901883 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:18.021215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a062a5-871b-4f52-8ce8-50de373a4e95 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:18.021215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a062a5-871b-4f52-8ce8-50de373a4e95 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:18.021215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a062a5-871b-4f52-8ce8-50de373a4e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:18.041142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-64a062a5-871b-4f52-8ce8-50de373a4e95 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:18.042876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-64a062a5-871b-4f52-8ce8-50de373a4e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:18.077171 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98977602-2464-4155-8af7-571bc6cf648a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:18.083748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545265c3-744b-40b4-b472-188bc43440de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd82125a47ce044b389684b97c7097ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:18.083748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545265c3-744b-40b4-b472-188bc43440de service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:18.084839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545265c3-744b-40b4-b472-188bc43440de service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:18.085221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545265c3-744b-40b4-b472-188bc43440de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:18.087764 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-545265c3-744b-40b4-b472-188bc43440de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:18.151161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1009/2026] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:18.152371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a062a5-871b-4f52-8ce8-50de373a4e95 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:18.161138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-64a062a5-871b-4f52-8ce8-50de373a4e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:18.175709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a062a5-871b-4f52-8ce8-50de373a4e95 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:18.180740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205ff20-1500-478e-9120-1020d325a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:18.182111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205ff20-1500-478e-9120-1020d325a57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:18.182111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205ff20-1500-478e-9120-1020d325a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:18.182111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205ff20-1500-478e-9120-1020d325a57f admin admin] PATH_INFO: `/v3/users/35640133f1e54286b0cea9b6fb3cda3e` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:18.183310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205ff20-1500-478e-9120-1020d325a57f admin admin] RBAC: Authorizing `identity:delete_user(user_id=35640133f1e54286b0cea9b6fb3cda3e)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:18.184043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545265c3-744b-40b4-b472-188bc43440de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:18.185844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545265c3-744b-40b4-b472-188bc43440de service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:18.186309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205ff20-1500-478e-9120-1020d325a57f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:18.200765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1018/2027] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:18.202506 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545265c3-744b-40b4-b472-188bc43440de service glance] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:18.204562 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-545265c3-744b-40b4-b472-188bc43440de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:18.230666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545265c3-744b-40b4-b472-188bc43440de service glance] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:18.242301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:18.243304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:18.243657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:18.243941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] PATH_INFO: `/v3/projects/8dcc6ab6846b4cf5a2835636751d6999` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:18.245337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dcc6ab6846b4cf5a2835636751d6999)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:18.247456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:18.307228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1205ff20-1500-478e-9120-1020d325a57f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35640133f1e54286b0cea9b6fb3cda3e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.337694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:18.341007 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dcc6ab6846b4cf5a2835636751d6999', 'request_id': 'req-2749a809-24f0-4be1-9019-5f166c3eba53'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.346733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1205ff20-1500-478e-9120-1020d325a57f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35640133f1e54286b0cea9b6fb3cda3e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.351416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:18.351947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dcc6ab6846b4cf5a2835636751d6999', 'request_id': 'req-2749a809-24f0-4be1-9019-5f166c3eba53'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.360553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1205ff20-1500-478e-9120-1020d325a57f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35640133f1e54286b0cea9b6fb3cda3e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.363273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1205ff20-1500-478e-9120-1020d325a57f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35640133f1e54286b0cea9b6fb3cda3e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.369878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dcc6ab6846b4cf5a2835636751d6999', 'request_id': 'req-2749a809-24f0-4be1-9019-5f166c3eba53'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.382628 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1205ff20-1500-478e-9120-1020d325a57f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35640133f1e54286b0cea9b6fb3cda3e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.385978 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] The token cache is being invalidate because project 8dcc6ab6846b4cf5a2835636751d6999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:18.386440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.387141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:18.388871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1019/2028] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:18 2022] DELETE /identity/v3/projects/8dcc6ab6846b4cf5a2835636751d6999 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:18.393876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:18.395517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:18.412480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1010/2029] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:18 2022] DELETE /identity/v3/users/35640133f1e54286b0cea9b6fb3cda3e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:18.414625 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57af936-a554-4bfe-83ac-bd5d290306c4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:18.414920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57af936-a554-4bfe-83ac-bd5d290306c4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:18.425322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57af936-a554-4bfe-83ac-bd5d290306c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:18.485491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f57af936-a554-4bfe-83ac-bd5d290306c4 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:18.493275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749a809-24f0-4be1-9019-5f166c3eba53 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:18.494328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f57af936-a554-4bfe-83ac-bd5d290306c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:18.592511 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a9fa-9b8b-4eae-b67a-54e2c7840099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:18.593286 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a9fa-9b8b-4eae-b67a-54e2c7840099 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:18.593445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a9fa-9b8b-4eae-b67a-54e2c7840099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:18.593730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47a9fa-9b8b-4eae-b67a-54e2c7840099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:18.598265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ec47a9fa-9b8b-4eae-b67a-54e2c7840099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:18.641422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1011/2030] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:18.649785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755f716-085f-4f6f-a85b-5996a080a39c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:18.650081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755f716-085f-4f6f-a85b-5996a080a39c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:18.650388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755f716-085f-4f6f-a85b-5996a080a39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:18.671584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1755f716-085f-4f6f-a85b-5996a080a39c None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:18.673044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1755f716-085f-4f6f-a85b-5996a080a39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:18.682541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1012/2031] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:18.690113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755f716-085f-4f6f-a85b-5996a080a39c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:18.701632 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755f716-085f-4f6f-a85b-5996a080a39c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:18.708173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47a9fa-9b8b-4eae-b67a-54e2c7840099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:18.708555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8286da-f1d8-45dc-ba72-212f23d6a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:18.709403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8286da-f1d8-45dc-ba72-212f23d6a966 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:18.709757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47a9fa-9b8b-4eae-b67a-54e2c7840099 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:18.709875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8286da-f1d8-45dc-ba72-212f23d6a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:18.710365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8286da-f1d8-45dc-ba72-212f23d6a966 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:18.711444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8286da-f1d8-45dc-ba72-212f23d6a966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:18.711876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8286da-f1d8-45dc-ba72-212f23d6a966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:18.713897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8286da-f1d8-45dc-ba72-212f23d6a966 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:18.728109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1020/2032] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:18.734518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1013/2033] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:18.739971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a9fa-9b8b-4eae-b67a-54e2c7840099 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:18.753743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47a9fa-9b8b-4eae-b67a-54e2c7840099 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:18.760991 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c975a33-92dd-42bb-985f-4af5987fef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:18.762571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975a33-92dd-42bb-985f-4af5987fef0e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:18.762857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975a33-92dd-42bb-985f-4af5987fef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:18.763151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975a33-92dd-42bb-985f-4af5987fef0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:18.764056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c975a33-92dd-42bb-985f-4af5987fef0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:18.767924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c975a33-92dd-42bb-985f-4af5987fef0e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:18.825996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1021/2034] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:18 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:18.827238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8286da-f1d8-45dc-ba72-212f23d6a966 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:18.839110 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8286da-f1d8-45dc-ba72-212f23d6a966 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:18.903730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c975a33-92dd-42bb-985f-4af5987fef0e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:18.905688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4c975a33-92dd-42bb-985f-4af5987fef0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:18.948911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:18.968770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1991f-4447-4c26-b19e-827f40a78f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:18.971113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1991f-4447-4c26-b19e-827f40a78f6b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:18.971642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1991f-4447-4c26-b19e-827f40a78f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:18.972064 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1991f-4447-4c26-b19e-827f40a78f6b admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:18.972899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1991f-4447-4c26-b19e-827f40a78f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:18.975639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1991f-4447-4c26-b19e-827f40a78f6b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.005999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1014/2035] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:18 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:19.010004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1991f-4447-4c26-b19e-827f40a78f6b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:19.024061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1991f-4447-4c26-b19e-827f40a78f6b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:19.030234 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ec988-19e3-4b60-b175-a5bbf237e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:19.031160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ec988-19e3-4b60-b175-a5bbf237e969 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.031592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ec988-19e3-4b60-b175-a5bbf237e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.032183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ec988-19e3-4b60-b175-a5bbf237e969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.034071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ec988-19e3-4b60-b175-a5bbf237e969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:19.035475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c975a33-92dd-42bb-985f-4af5987fef0e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:19.036092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ec988-19e3-4b60-b175-a5bbf237e969 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.041663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:19.043031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.043407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.043965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] PATH_INFO: `/v3/projects/afc6fbe214134737895852acc71073a9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.046841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc6fbe214134737895852acc71073a9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:19.050381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.052207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1015/2036] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:19.056185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ec988-19e3-4b60-b175-a5bbf237e969 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:19.069978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ec988-19e3-4b60-b175-a5bbf237e969 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:19.077857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd5817-f38b-4abc-b424-5c02fd523bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:19.079154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5817-f38b-4abc-b424-5c02fd523bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.079858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5817-f38b-4abc-b424-5c02fd523bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.080389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5817-f38b-4abc-b424-5c02fd523bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.082214 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd5817-f38b-4abc-b424-5c02fd523bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:19.084488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd5817-f38b-4abc-b424-5c02fd523bcf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.113524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1016/2037] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:19.116798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd5817-f38b-4abc-b424-5c02fd523bcf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:19.129095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd5817-f38b-4abc-b424-5c02fd523bcf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:19.146030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc6fbe214134737895852acc71073a9', 'request_id': 'req-c0afeba8-3e21-4137-909a-ce42eb9be5a4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:19.156359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc6fbe214134737895852acc71073a9', 'request_id': 'req-c0afeba8-3e21-4137-909a-ce42eb9be5a4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:19.163489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:19.167890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc6fbe214134737895852acc71073a9', 'request_id': 'req-c0afeba8-3e21-4137-909a-ce42eb9be5a4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:19.186135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] The token cache is being invalidate because project afc6fbe214134737895852acc71073a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:19.186575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:19.187084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0afeba8-3e21-4137-909a-ce42eb9be5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:19.188884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1022/2038] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:18 2022] DELETE /identity/v3/projects/afc6fbe214134737895852acc71073a9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:19.193782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9866a8-9b6e-4ffc-a932-f0f0d818f00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:19.194322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ee13-b62f-4cc6-830a-d875072e2e83 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.194619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ee13-b62f-4cc6-830a-d875072e2e83 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.195108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ee13-b62f-4cc6-830a-d875072e2e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.195236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9866a8-9b6e-4ffc-a932-f0f0d818f00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.195566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9866a8-9b6e-4ffc-a932-f0f0d818f00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.196443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9866a8-9b6e-4ffc-a932-f0f0d818f00d admin admin] PATH_INFO: `/v3/projects/9693d1597a6a40319aa7756b8ff18361/users/49b2889226254237bffb75b5b6610cf7/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.213241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9866a8-9b6e-4ffc-a932-f0f0d818f00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9693d1597a6a40319aa7756b8ff18361, user_id=49b2889226254237bffb75b5b6610cf7, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:19.216879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cf46ee13-b62f-4cc6-830a-d875072e2e83 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:19.217116 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9866a8-9b6e-4ffc-a932-f0f0d818f00d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.219069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cf46ee13-b62f-4cc6-830a-d875072e2e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:19.236733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1023/2039] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:19.239763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1017/2040] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:19 2022] PUT /identity/v3/projects/9693d1597a6a40319aa7756b8ff18361/users/49b2889226254237bffb75b5b6610cf7/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:19.239883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ec5eb-5fea-4515-8b66-9748400c8704 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.240161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ec5eb-5fea-4515-8b66-9748400c8704 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.240407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ec5eb-5fea-4515-8b66-9748400c8704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.245451 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7e849-dc35-4f2b-a60b-554c13246a66 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.245672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7e849-dc35-4f2b-a60b-554c13246a66 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.246236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7e849-dc35-4f2b-a60b-554c13246a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.264194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bce7e849-dc35-4f2b-a60b-554c13246a66 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:19.264422 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-666ec5eb-5fea-4515-8b66-9748400c8704 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:19.265472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bce7e849-dc35-4f2b-a60b-554c13246a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:19.265688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-666ec5eb-5fea-4515-8b66-9748400c8704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:19.349267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1018/2041] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:19.349817 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1024/2042] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:19.353173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7e849-dc35-4f2b-a60b-554c13246a66 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:19.356344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ec5eb-5fea-4515-8b66-9748400c8704 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:19.357891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-666ec5eb-5fea-4515-8b66-9748400c8704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:19.371297 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7e849-dc35-4f2b-a60b-554c13246a66 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:19.377155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cacd4d-2c1f-433b-9813-f980a5485b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:19.377831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cacd4d-2c1f-433b-9813-f980a5485b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.378112 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cacd4d-2c1f-433b-9813-f980a5485b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.378417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cacd4d-2c1f-433b-9813-f980a5485b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.379221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cacd4d-2c1f-433b-9813-f980a5485b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:19.379699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cacd4d-2c1f-433b-9813-f980a5485b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:19.381565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cacd4d-2c1f-433b-9813-f980a5485b9c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.398856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1019/2043] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:19.404348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cacd4d-2c1f-433b-9813-f980a5485b9c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:19.419222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cacd4d-2c1f-433b-9813-f980a5485b9c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:19.420407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:19.427312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb415d-5c1c-4e57-a28d-05c09a7dfccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:19.427932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb415d-5c1c-4e57-a28d-05c09a7dfccf admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.428255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb415d-5c1c-4e57-a28d-05c09a7dfccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.428593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb415d-5c1c-4e57-a28d-05c09a7dfccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.429249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb415d-5c1c-4e57-a28d-05c09a7dfccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:19.431202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb415d-5c1c-4e57-a28d-05c09a7dfccf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.439556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ec5eb-5fea-4515-8b66-9748400c8704 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:19.443966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bf35d-8d33-4dc0-906a-b065142cfc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:19.445264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf35d-8d33-4dc0-906a-b065142cfc3e service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.445264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf35d-8d33-4dc0-906a-b065142cfc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.445264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf35d-8d33-4dc0-906a-b065142cfc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.457523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bf35d-8d33-4dc0-906a-b065142cfc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:19.459106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bf35d-8d33-4dc0-906a-b065142cfc3e service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.468064 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1020/2044] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:19 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:19.472682 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb415d-5c1c-4e57-a28d-05c09a7dfccf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:19.474061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1025/2045] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:19.560549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb415d-5c1c-4e57-a28d-05c09a7dfccf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:19.566325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c48e2-7b8c-4400-9658-770aaa1a0592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:19.567017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c48e2-7b8c-4400-9658-770aaa1a0592 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.567440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c48e2-7b8c-4400-9658-770aaa1a0592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.567801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c48e2-7b8c-4400-9658-770aaa1a0592 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.568546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c48e2-7b8c-4400-9658-770aaa1a0592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:19.570492 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c48e2-7b8c-4400-9658-770aaa1a0592 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.595664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1021/2046] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:19 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:19.600985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bf35d-8d33-4dc0-906a-b065142cfc3e service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:19.611839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bf35d-8d33-4dc0-906a-b065142cfc3e service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:19.616725 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ad090-44ce-4c1a-84b8-e11e98241b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:19.617389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ad090-44ce-4c1a-84b8-e11e98241b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.617673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ad090-44ce-4c1a-84b8-e11e98241b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.617950 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ad090-44ce-4c1a-84b8-e11e98241b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.618685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ad090-44ce-4c1a-84b8-e11e98241b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:19.620328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ad090-44ce-4c1a-84b8-e11e98241b06 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.638265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1026/2047] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:19.639322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c48e2-7b8c-4400-9658-770aaa1a0592 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:19.671501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c48e2-7b8c-4400-9658-770aaa1a0592 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:19.678469 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b4d4c-56a7-441a-b371-e3b81067d889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:19.679397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b4d4c-56a7-441a-b371-e3b81067d889 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.679686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b4d4c-56a7-441a-b371-e3b81067d889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.679964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b4d4c-56a7-441a-b371-e3b81067d889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.680739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b4d4c-56a7-441a-b371-e3b81067d889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:19.682544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b4d4c-56a7-441a-b371-e3b81067d889 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.695537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1022/2048] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:19.700047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ad090-44ce-4c1a-84b8-e11e98241b06 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:19.715092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ad090-44ce-4c1a-84b8-e11e98241b06 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:19.722099 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e0710-9922-4119-b104-c51a26496447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:19.723908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e0710-9922-4119-b104-c51a26496447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.724300 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e0710-9922-4119-b104-c51a26496447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.724607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e0710-9922-4119-b104-c51a26496447 admin admin] PATH_INFO: `/v3/projects/278c77e407934c28a8dbbebcfb370c95/users/c74ddc2f464047c69a0bbf4d6812dc2d/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.754849 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e0710-9922-4119-b104-c51a26496447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278c77e407934c28a8dbbebcfb370c95, user_id=c74ddc2f464047c69a0bbf4d6812dc2d, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:19.758847 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e0710-9922-4119-b104-c51a26496447 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:19.784731 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1027/2049] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:19 2022] PUT /identity/v3/projects/278c77e407934c28a8dbbebcfb370c95/users/c74ddc2f464047c69a0bbf4d6812dc2d/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:19.797888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a067260-6b18-4453-9203-af51bf1ea308 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.799862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a067260-6b18-4453-9203-af51bf1ea308 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.799976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a067260-6b18-4453-9203-af51bf1ea308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.820230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:19.822041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544810e-d980-4d4a-a042-24c5ea9ee73d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:19.822331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544810e-d980-4d4a-a042-24c5ea9ee73d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:19.828013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544810e-d980-4d4a-a042-24c5ea9ee73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:19.860503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7a067260-6b18-4453-9203-af51bf1ea308 None None] MFA Rules not processed for user `c74ddc2f464047c69a0bbf4d6812dc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:19.862442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7a067260-6b18-4453-9203-af51bf1ea308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:19.906627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a544810e-d980-4d4a-a042-24c5ea9ee73d None None] MFA Rules not processed for user `bd7324f7539840b08c17d39d297eb99e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:19.916300 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a544810e-d980-4d4a-a042-24c5ea9ee73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:19.996192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1023/2050] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:19.999480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a067260-6b18-4453-9203-af51bf1ea308 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.041867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1028/2051] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:20.059089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544810e-d980-4d4a-a042-24c5ea9ee73d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.060587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a544810e-d980-4d4a-a042-24c5ea9ee73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:20.082421 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a067260-6b18-4453-9203-af51bf1ea308 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.087690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af137fe-d1fe-4c86-8cde-6e9d568ea834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.088677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af137fe-d1fe-4c86-8cde-6e9d568ea834 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.088968 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af137fe-d1fe-4c86-8cde-6e9d568ea834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.089281 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af137fe-d1fe-4c86-8cde-6e9d568ea834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.090112 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af137fe-d1fe-4c86-8cde-6e9d568ea834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.092107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af137fe-d1fe-4c86-8cde-6e9d568ea834 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.124111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1024/2052] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:19 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:20.128747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af137fe-d1fe-4c86-8cde-6e9d568ea834 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.189792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544810e-d980-4d4a-a042-24c5ea9ee73d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.218938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af137fe-d1fe-4c86-8cde-6e9d568ea834 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.234934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8f3e4-4fa3-4c2f-a758-31fc2ead6c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.235626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8f3e4-4fa3-4c2f-a758-31fc2ead6c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.236482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8f3e4-4fa3-4c2f-a758-31fc2ead6c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.236871 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8f3e4-4fa3-4c2f-a758-31fc2ead6c6d admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.237705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8f3e4-4fa3-4c2f-a758-31fc2ead6c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.239694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8f3e4-4fa3-4c2f-a758-31fc2ead6c6d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.260773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f8e30-99ff-4bd6-8159-e2a5b327b24d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.261940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8e30-99ff-4bd6-8159-e2a5b327b24d service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.263217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8e30-99ff-4bd6-8159-e2a5b327b24d service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.263217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8e30-99ff-4bd6-8159-e2a5b327b24d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.274569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:20.276869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1025/2053] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:20 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:20.281652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8f3e4-4fa3-4c2f-a758-31fc2ead6c6d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.296087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8f3e4-4fa3-4c2f-a758-31fc2ead6c6d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.317769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613b185-69ef-45de-afc5-6fe0deba864e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.318749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b185-69ef-45de-afc5-6fe0deba864e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.319196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b185-69ef-45de-afc5-6fe0deba864e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.320444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b185-69ef-45de-afc5-6fe0deba864e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.321783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613b185-69ef-45de-afc5-6fe0deba864e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.323892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613b185-69ef-45de-afc5-6fe0deba864e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.348492 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:20.358469 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1026/2054] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:20.361838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1061-6059-4398-ab54-682914308253 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.362527 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1061-6059-4398-ab54-682914308253 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.363595 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1061-6059-4398-ab54-682914308253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.383228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f8e30-99ff-4bd6-8159-e2a5b327b24d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.385037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f8e30-99ff-4bd6-8159-e2a5b327b24d service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.398315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1029/2055] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:20.400530 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f8e30-99ff-4bd6-8159-e2a5b327b24d service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.417511 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e6ad1061-6059-4398-ab54-682914308253 None None] MFA Rules not processed for user `49b2889226254237bffb75b5b6610cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:20.418449 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f8e30-99ff-4bd6-8159-e2a5b327b24d service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.419079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e6ad1061-6059-4398-ab54-682914308253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:20.424084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08037a-d5fb-4dc9-8637-9bf73727e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.424996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08037a-d5fb-4dc9-8637-9bf73727e7cc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.425628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08037a-d5fb-4dc9-8637-9bf73727e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.426190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08037a-d5fb-4dc9-8637-9bf73727e7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.426960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08037a-d5fb-4dc9-8637-9bf73727e7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.428760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08037a-d5fb-4dc9-8637-9bf73727e7cc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.444804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1030/2056] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:20.445673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08037a-d5fb-4dc9-8637-9bf73727e7cc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.462561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08037a-d5fb-4dc9-8637-9bf73727e7cc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.474004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632315e-edcd-4d2b-91f2-2629a1b6c683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.475737 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632315e-edcd-4d2b-91f2-2629a1b6c683 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.476263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632315e-edcd-4d2b-91f2-2629a1b6c683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.477070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632315e-edcd-4d2b-91f2-2629a1b6c683 admin admin] PATH_INFO: `/v3/projects/13ed48d21ecc4d88a168c873aec0ca8f/users/4c101519f18047da841fa538bad2c24c/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.504806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632315e-edcd-4d2b-91f2-2629a1b6c683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ed48d21ecc4d88a168c873aec0ca8f, user_id=4c101519f18047da841fa538bad2c24c, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.507713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632315e-edcd-4d2b-91f2-2629a1b6c683 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.517935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1027/2057] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:20.522126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1061-6059-4398-ab54-682914308253 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.523805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e6ad1061-6059-4398-ab54-682914308253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:20.531523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1031/2058] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:20 2022] PUT /identity/v3/projects/13ed48d21ecc4d88a168c873aec0ca8f/users/4c101519f18047da841fa538bad2c24c/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:20.542391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1061-6059-4398-ab54-682914308253 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.547800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff762a7-f675-43ef-8798-b4bd85cef68e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.548125 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff762a7-f675-43ef-8798-b4bd85cef68e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.548475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff762a7-f675-43ef-8798-b4bd85cef68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.601883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fff762a7-f675-43ef-8798-b4bd85cef68e None None] MFA Rules not processed for user `4c101519f18047da841fa538bad2c24c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:20.604339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fff762a7-f675-43ef-8798-b4bd85cef68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:20.632156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b085a-bc35-44da-a141-99964cdde190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.633181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b085a-bc35-44da-a141-99964cdde190 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.633519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b085a-bc35-44da-a141-99964cdde190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.633855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b085a-bc35-44da-a141-99964cdde190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.634772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b085a-bc35-44da-a141-99964cdde190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.637175 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b085a-bc35-44da-a141-99964cdde190 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.668559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1028/2059] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:20 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:20.672911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b085a-bc35-44da-a141-99964cdde190 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.692439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1032/2060] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:20.697492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff762a7-f675-43ef-8798-b4bd85cef68e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.709904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff762a7-f675-43ef-8798-b4bd85cef68e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.774747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b085a-bc35-44da-a141-99964cdde190 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.787763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81167b0-1fed-470c-86d1-ab6d432bf75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.787763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81167b0-1fed-470c-86d1-ab6d432bf75b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.787763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81167b0-1fed-470c-86d1-ab6d432bf75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.787763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81167b0-1fed-470c-86d1-ab6d432bf75b admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.788153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81167b0-1fed-470c-86d1-ab6d432bf75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.788426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81167b0-1fed-470c-86d1-ab6d432bf75b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.793650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce696576-bb9e-4bd5-9483-4b6184cd6c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.794321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce696576-bb9e-4bd5-9483-4b6184cd6c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.794611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce696576-bb9e-4bd5-9483-4b6184cd6c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.795446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce696576-bb9e-4bd5-9483-4b6184cd6c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.796211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce696576-bb9e-4bd5-9483-4b6184cd6c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.798168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce696576-bb9e-4bd5-9483-4b6184cd6c68 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.806569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:20.807243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:20.818467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1029/2061] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:20 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:20.822148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81167b0-1fed-470c-86d1-ab6d432bf75b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.835147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81167b0-1fed-470c-86d1-ab6d432bf75b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.836475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1033/2062] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:20 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:20.840431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce696576-bb9e-4bd5-9483-4b6184cd6c68 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.898989 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7fbee-74fc-4e19-97a7-b1b590e8a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.899678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7fbee-74fc-4e19-97a7-b1b590e8a089 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.899963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7fbee-74fc-4e19-97a7-b1b590e8a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.900272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7fbee-74fc-4e19-97a7-b1b590e8a089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.900996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7fbee-74fc-4e19-97a7-b1b590e8a089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.902592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7fbee-74fc-4e19-97a7-b1b590e8a089 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.910135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce696576-bb9e-4bd5-9483-4b6184cd6c68 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.915844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1030/2063] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:20.915992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ff245-a023-4d7c-8063-0ae82731cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.915992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff245-a023-4d7c-8063-0ae82731cca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.916230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff245-a023-4d7c-8063-0ae82731cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.916454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff245-a023-4d7c-8063-0ae82731cca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.917061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7fbee-74fc-4e19-97a7-b1b590e8a089 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.917188 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ff245-a023-4d7c-8063-0ae82731cca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.919063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ff245-a023-4d7c-8063-0ae82731cca9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.928476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7fbee-74fc-4e19-97a7-b1b590e8a089 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.933595 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c402e-400a-4fdf-92a2-2ea5692c92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.934488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c402e-400a-4fdf-92a2-2ea5692c92aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.934773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c402e-400a-4fdf-92a2-2ea5692c92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.935057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c402e-400a-4fdf-92a2-2ea5692c92aa admin admin] PATH_INFO: `/v3/projects/a07c6cb77cbf4e028736d2275beaf852/users/8e3f0b504d914460ae4b7d7ed87d0027/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.939066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1034/2064] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:20 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:20.942708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ff245-a023-4d7c-8063-0ae82731cca9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.950713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c402e-400a-4fdf-92a2-2ea5692c92aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07c6cb77cbf4e028736d2275beaf852, user_id=8e3f0b504d914460ae4b7d7ed87d0027, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.952318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ff245-a023-4d7c-8063-0ae82731cca9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:20.953449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c402e-400a-4fdf-92a2-2ea5692c92aa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.958136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6c886-bb70-43cb-8500-f90f4304b58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:20.958887 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6c886-bb70-43cb-8500-f90f4304b58e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:20.959217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6c886-bb70-43cb-8500-f90f4304b58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:20.959557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6c886-bb70-43cb-8500-f90f4304b58e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:20.961858 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6c886-bb70-43cb-8500-f90f4304b58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:20.963548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6c886-bb70-43cb-8500-f90f4304b58e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:20.967107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1031/2065] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:20 2022] PUT /identity/v3/projects/a07c6cb77cbf4e028736d2275beaf852/users/8e3f0b504d914460ae4b7d7ed87d0027/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:20.971493 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c402e-400a-4fdf-92a2-2ea5692c92aa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.974904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1035/2066] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:20.978841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6c886-bb70-43cb-8500-f90f4304b58e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:20.989550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6c886-bb70-43cb-8500-f90f4304b58e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:21.033588 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c402e-400a-4fdf-92a2-2ea5692c92aa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:21.038322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c47e4-56f2-43f2-9fed-18d26d77f6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:21.038988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c47e4-56f2-43f2-9fed-18d26d77f6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:21.039273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c47e4-56f2-43f2-9fed-18d26d77f6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:21.039551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c47e4-56f2-43f2-9fed-18d26d77f6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:21.040313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c47e4-56f2-43f2-9fed-18d26d77f6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:21.041920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c47e4-56f2-43f2-9fed-18d26d77f6c0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:21.047131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a2ddc-6a39-4107-915c-be9c06f0645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:21.048043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a2ddc-6a39-4107-915c-be9c06f0645b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:21.048378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a2ddc-6a39-4107-915c-be9c06f0645b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:21.048653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a2ddc-6a39-4107-915c-be9c06f0645b admin admin] PATH_INFO: `/v3/projects/e40037a547a949d1a4296e3103b3d9b7/users/851c56d3e7134251bf260a5d2efc0e80/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:21.055730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1032/2067] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:21.056401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c47e4-56f2-43f2-9fed-18d26d77f6c0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:21.066875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c47e4-56f2-43f2-9fed-18d26d77f6c0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:21.071839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480a506-692e-47b0-b302-c44852712b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:21.071972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a2ddc-6a39-4107-915c-be9c06f0645b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40037a547a949d1a4296e3103b3d9b7, user_id=851c56d3e7134251bf260a5d2efc0e80, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:21.072897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480a506-692e-47b0-b302-c44852712b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:21.073178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480a506-692e-47b0-b302-c44852712b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:21.073456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480a506-692e-47b0-b302-c44852712b95 admin admin] PATH_INFO: `/v3/projects/a07c6cb77cbf4e028736d2275beaf852/users/8e3f0b504d914460ae4b7d7ed87d0027/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:21.075347 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a2ddc-6a39-4107-915c-be9c06f0645b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:21.075610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480a506-692e-47b0-b302-c44852712b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07c6cb77cbf4e028736d2275beaf852, user_id=8e3f0b504d914460ae4b7d7ed87d0027, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:21.078647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480a506-692e-47b0-b302-c44852712b95 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:21.094200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1033/2068] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:21 2022] PUT /identity/v3/projects/a07c6cb77cbf4e028736d2275beaf852/users/8e3f0b504d914460ae4b7d7ed87d0027/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:21.094357 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1036/2069] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:20 2022] PUT /identity/v3/projects/e40037a547a949d1a4296e3103b3d9b7/users/851c56d3e7134251bf260a5d2efc0e80/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:21.097276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480a506-692e-47b0-b302-c44852712b95 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:21.155839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:21.162074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480a506-692e-47b0-b302-c44852712b95 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:21.227846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd0891-e8a9-4f29-a69e-b86de041aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:21.228642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0891-e8a9-4f29-a69e-b86de041aacd admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:21.228997 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0891-e8a9-4f29-a69e-b86de041aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:21.229346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0891-e8a9-4f29-a69e-b86de041aacd admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:21.230312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd0891-e8a9-4f29-a69e-b86de041aacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:21.232183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd0891-e8a9-4f29-a69e-b86de041aacd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:21.247743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1034/2070] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:21.249215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a2ddc-6a39-4107-915c-be9c06f0645b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:21.261093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a2ddc-6a39-4107-915c-be9c06f0645b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:21.266312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61a6fc-73d6-4634-9687-4b8c123035d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:21.267628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61a6fc-73d6-4634-9687-4b8c123035d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:21.267911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61a6fc-73d6-4634-9687-4b8c123035d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:21.268216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61a6fc-73d6-4634-9687-4b8c123035d3 admin admin] PATH_INFO: `/v3/projects/e40037a547a949d1a4296e3103b3d9b7/users/851c56d3e7134251bf260a5d2efc0e80/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:21.270509 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61a6fc-73d6-4634-9687-4b8c123035d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40037a547a949d1a4296e3103b3d9b7, user_id=851c56d3e7134251bf260a5d2efc0e80, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:21.273208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61a6fc-73d6-4634-9687-4b8c123035d3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:21.284608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1037/2071] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:21 2022] PUT /identity/v3/projects/e40037a547a949d1a4296e3103b3d9b7/users/851c56d3e7134251bf260a5d2efc0e80/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:21.297800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230712e3-cdb4-459b-8d93-c32cdf498aa6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:21.298089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230712e3-cdb4-459b-8d93-c32cdf498aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:21.298465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230712e3-cdb4-459b-8d93-c32cdf498aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:21.325633 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-230712e3-cdb4-459b-8d93-c32cdf498aa6 None None] MFA Rules not processed for user `851c56d3e7134251bf260a5d2efc0e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:21.326888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-230712e3-cdb4-459b-8d93-c32cdf498aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:21.408497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1035/2072] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:21.421292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61a6fc-73d6-4634-9687-4b8c123035d3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:21.475292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:21.492563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61a6fc-73d6-4634-9687-4b8c123035d3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:21.496558 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aa04d-0622-496f-a98a-f4e17ef0a097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:21.497215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aa04d-0622-496f-a98a-f4e17ef0a097 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:21.497686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aa04d-0622-496f-a98a-f4e17ef0a097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:21.497978 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aa04d-0622-496f-a98a-f4e17ef0a097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:21.562429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aa04d-0622-496f-a98a-f4e17ef0a097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:21.563773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aa04d-0622-496f-a98a-f4e17ef0a097 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:21.574283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1038/2073] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:21.878402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9bf27-c913-4e32-9e89-12fc48491e5f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:21.879015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9bf27-c913-4e32-9e89-12fc48491e5f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:21.879500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9bf27-c913-4e32-9e89-12fc48491e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:21.902184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b4e9-d9c6-4ac8-81f8-613725d3527e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:21.902504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b4e9-d9c6-4ac8-81f8-613725d3527e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:21.902812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b4e9-d9c6-4ac8-81f8-613725d3527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:21.929871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9974b4e9-d9c6-4ac8-81f8-613725d3527e None None] MFA Rules not processed for user `bd7324f7539840b08c17d39d297eb99e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:21.930030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-97b9bf27-c913-4e32-9e89-12fc48491e5f None None] MFA Rules not processed for user `8e3f0b504d914460ae4b7d7ed87d0027`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:21.931114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9974b4e9-d9c6-4ac8-81f8-613725d3527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:21.931366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-97b9bf27-c913-4e32-9e89-12fc48491e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:22.030143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1039/2074] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:22.044452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1036/2075] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:22.056338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974b4e9-d9c6-4ac8-81f8-613725d3527e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:22.057924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9974b4e9-d9c6-4ac8-81f8-613725d3527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:22.071302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974b4e9-d9c6-4ac8-81f8-613725d3527e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:22.074918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249a848-4144-4309-a3bf-13a52a36fd5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:22.075573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249a848-4144-4309-a3bf-13a52a36fd5f service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:22.075860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249a848-4144-4309-a3bf-13a52a36fd5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:22.076172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249a848-4144-4309-a3bf-13a52a36fd5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:22.142800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249a848-4144-4309-a3bf-13a52a36fd5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:22.144274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249a848-4144-4309-a3bf-13a52a36fd5f service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:22.153258 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1040/2076] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:23.162096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9bf27-c913-4e32-9e89-12fc48491e5f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:23.171559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9bf27-c913-4e32-9e89-12fc48491e5f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:23.175585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b354d9-aef8-4727-8e6f-083d0b98b6e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:23.176280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b354d9-aef8-4727-8e6f-083d0b98b6e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:23.176571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b354d9-aef8-4727-8e6f-083d0b98b6e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:23.176853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b354d9-aef8-4727-8e6f-083d0b98b6e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:23.182667 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:23.234835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b354d9-aef8-4727-8e6f-083d0b98b6e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:23.236803 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b354d9-aef8-4727-8e6f-083d0b98b6e2 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:23.245574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1037/2077] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:23.542586 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249a848-4144-4309-a3bf-13a52a36fd5f service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:23.550970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249a848-4144-4309-a3bf-13a52a36fd5f service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:23.554629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e854f22-7d8a-4be6-8c0e-641d0c40a1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:23.555266 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e854f22-7d8a-4be6-8c0e-641d0c40a1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:23.555540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e854f22-7d8a-4be6-8c0e-641d0c40a1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:23.555822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e854f22-7d8a-4be6-8c0e-641d0c40a1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:23.565645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e854f22-7d8a-4be6-8c0e-641d0c40a1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:23.567080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e854f22-7d8a-4be6-8c0e-641d0c40a1c5 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:23.577037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1041/2078] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:23.849241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b354d9-aef8-4727-8e6f-083d0b98b6e2 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:23.858939 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b354d9-aef8-4727-8e6f-083d0b98b6e2 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:23.863313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d71e9-63ac-4f9b-85b6-c8b1d8040a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:23.863878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d71e9-63ac-4f9b-85b6-c8b1d8040a72 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:23.864335 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d71e9-63ac-4f9b-85b6-c8b1d8040a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:23.864639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d71e9-63ac-4f9b-85b6-c8b1d8040a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:23.875870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d71e9-63ac-4f9b-85b6-c8b1d8040a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:23.877456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d71e9-63ac-4f9b-85b6-c8b1d8040a72 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:23.902206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1038/2079] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:27.843170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e854f22-7d8a-4be6-8c0e-641d0c40a1c5 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:27.874732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:27.927487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e854f22-7d8a-4be6-8c0e-641d0c40a1c5 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:27.934448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:27.934883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:27.935216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:27.935504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] PATH_INFO: `/v3/users/c74ddc2f464047c69a0bbf4d6812dc2d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:27.937251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74ddc2f464047c69a0bbf4d6812dc2d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:27.939459 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:28.009546 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74ddc2f464047c69a0bbf4d6812dc2d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:28.024752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74ddc2f464047c69a0bbf4d6812dc2d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:28.034553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74ddc2f464047c69a0bbf4d6812dc2d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:28.035225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74ddc2f464047c69a0bbf4d6812dc2d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:28.043783 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74ddc2f464047c69a0bbf4d6812dc2d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:28.050882 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1042/2080] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:27 2022] DELETE /identity/v3/users/c74ddc2f464047c69a0bbf4d6812dc2d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:28.055122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fefd98-d856-455d-9ab9-2d36a718f0d3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:28.055626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fefd98-d856-455d-9ab9-2d36a718f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:28.055719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fefd98-d856-455d-9ab9-2d36a718f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:28.074624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-43fefd98-d856-455d-9ab9-2d36a718f0d3 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:28.075952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-43fefd98-d856-455d-9ab9-2d36a718f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:28.152551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1039/2081] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:28.174895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:28.177150 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:28.275891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dd849-0f42-4655-9bb7-4246bf9ccec8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:28.296845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40edf1-93d5-470e-93fe-0dc2fd50e649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:28.297736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40edf1-93d5-470e-93fe-0dc2fd50e649 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:28.298156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40edf1-93d5-470e-93fe-0dc2fd50e649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:28.298626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40edf1-93d5-470e-93fe-0dc2fd50e649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:28.309131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40edf1-93d5-470e-93fe-0dc2fd50e649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:28.310676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40edf1-93d5-470e-93fe-0dc2fd50e649 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:28.320848 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1043/2082] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:28.687255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fefd98-d856-455d-9ab9-2d36a718f0d3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:28.689517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-43fefd98-d856-455d-9ab9-2d36a718f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:28.728122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fefd98-d856-455d-9ab9-2d36a718f0d3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:28.745824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:28.747006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:28.747487 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:28.748010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] PATH_INFO: `/v3/projects/278c77e407934c28a8dbbebcfb370c95` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:28.750547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278c77e407934c28a8dbbebcfb370c95)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:28.753078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:28.902327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278c77e407934c28a8dbbebcfb370c95', 'request_id': 'req-43b130e9-392a-4359-9e78-e213913d4e24'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:28.912362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278c77e407934c28a8dbbebcfb370c95', 'request_id': 'req-43b130e9-392a-4359-9e78-e213913d4e24'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:28.918837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278c77e407934c28a8dbbebcfb370c95', 'request_id': 'req-43b130e9-392a-4359-9e78-e213913d4e24'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:28.939139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] The token cache is being invalidate because project 278c77e407934c28a8dbbebcfb370c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:28.939429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:28.940191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:28.942388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1040/2083] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:28 2022] DELETE /identity/v3/projects/278c77e407934c28a8dbbebcfb370c95 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:28.946136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40edf1-93d5-470e-93fe-0dc2fd50e649 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:28.958206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40edf1-93d5-470e-93fe-0dc2fd50e649 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:29.007211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:29.025942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:29.027196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:29.028913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:29.029389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] PATH_INFO: `/v3/users/4c101519f18047da841fa538bad2c24c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:29.030712 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c101519f18047da841fa538bad2c24c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:29.033299 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:29.090229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c101519f18047da841fa538bad2c24c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.131831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c101519f18047da841fa538bad2c24c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.147138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c101519f18047da841fa538bad2c24c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.148006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c101519f18047da841fa538bad2c24c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.159182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c101519f18047da841fa538bad2c24c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.168211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1044/2084] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:28 2022] DELETE /identity/v3/users/4c101519f18047da841fa538bad2c24c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:29.498207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:29.500434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:29.516390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b130e9-392a-4359-9e78-e213913d4e24 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:29.533825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:29.589384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:29.590258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:29.590565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:29.590811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] PATH_INFO: `/v3/projects/13ed48d21ecc4d88a168c873aec0ca8f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:29.592104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ed48d21ecc4d88a168c873aec0ca8f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:29.594021 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:29.644981 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ed48d21ecc4d88a168c873aec0ca8f', 'request_id': 'req-3d48386f-c371-44e2-8334-11efaa957f7d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.651466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ed48d21ecc4d88a168c873aec0ca8f', 'request_id': 'req-3d48386f-c371-44e2-8334-11efaa957f7d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.657423 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ed48d21ecc4d88a168c873aec0ca8f', 'request_id': 'req-3d48386f-c371-44e2-8334-11efaa957f7d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.669680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] The token cache is being invalidate because project 13ed48d21ecc4d88a168c873aec0ca8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:29.669991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.670684 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.672361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1041/2085] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:29 2022] DELETE /identity/v3/projects/13ed48d21ecc4d88a168c873aec0ca8f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:29.676967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:29.678364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:29.691878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeade8-3db2-4dd5-a8fe-51e3ab292685 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:29.766957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efa099-a561-4b3c-b3ed-6aae0115261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:29.767895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efa099-a561-4b3c-b3ed-6aae0115261b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:29.768213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efa099-a561-4b3c-b3ed-6aae0115261b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:29.768495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efa099-a561-4b3c-b3ed-6aae0115261b admin admin] PATH_INFO: `/v3/users/851c56d3e7134251bf260a5d2efc0e80` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:29.769692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efa099-a561-4b3c-b3ed-6aae0115261b admin admin] RBAC: Authorizing `identity:delete_user(user_id=851c56d3e7134251bf260a5d2efc0e80)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:29.771630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efa099-a561-4b3c-b3ed-6aae0115261b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:29.835869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71efa099-a561-4b3c-b3ed-6aae0115261b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851c56d3e7134251bf260a5d2efc0e80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.854645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71efa099-a561-4b3c-b3ed-6aae0115261b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851c56d3e7134251bf260a5d2efc0e80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.856611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:29.865230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71efa099-a561-4b3c-b3ed-6aae0115261b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851c56d3e7134251bf260a5d2efc0e80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.866376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71efa099-a561-4b3c-b3ed-6aae0115261b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851c56d3e7134251bf260a5d2efc0e80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.883619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71efa099-a561-4b3c-b3ed-6aae0115261b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851c56d3e7134251bf260a5d2efc0e80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:29.895284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1045/2086] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:29 2022] DELETE /identity/v3/users/851c56d3e7134251bf260a5d2efc0e80 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:30.339888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:30.341427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:30.360303 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48386f-c371-44e2-8334-11efaa957f7d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:30.441471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:30.442479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:30.442835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:30.443181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] PATH_INFO: `/v3/projects/e40037a547a949d1a4296e3103b3d9b7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:30.445401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40037a547a949d1a4296e3103b3d9b7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:30.447579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:30.515327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40037a547a949d1a4296e3103b3d9b7', 'request_id': 'req-a98c500f-564a-4fbe-9669-d1962ca5b7a2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:30.517406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:30.524790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40037a547a949d1a4296e3103b3d9b7', 'request_id': 'req-a98c500f-564a-4fbe-9669-d1962ca5b7a2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:30.533153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40037a547a949d1a4296e3103b3d9b7', 'request_id': 'req-a98c500f-564a-4fbe-9669-d1962ca5b7a2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:30.547204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] The token cache is being invalidate because project e40037a547a949d1a4296e3103b3d9b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:30.547492 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:30.548238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a98c500f-564a-4fbe-9669-d1962ca5b7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:30.550173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1042/2087] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:30 2022] DELETE /identity/v3/projects/e40037a547a949d1a4296e3103b3d9b7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:30.555369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4403e3d-084b-4177-9dc6-56b8f9a9babd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:30.555945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4403e3d-084b-4177-9dc6-56b8f9a9babd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:30.555945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4403e3d-084b-4177-9dc6-56b8f9a9babd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:30.577843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b4403e3d-084b-4177-9dc6-56b8f9a9babd None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:30.579713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b4403e3d-084b-4177-9dc6-56b8f9a9babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:30.649939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1046/2088] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:30.658420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335b47-77e0-40e8-bf03-3fc65a65590d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:30.658734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335b47-77e0-40e8-bf03-3fc65a65590d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:30.659060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335b47-77e0-40e8-bf03-3fc65a65590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:30.681118 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bc335b47-77e0-40e8-bf03-3fc65a65590d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:30.682325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bc335b47-77e0-40e8-bf03-3fc65a65590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:30.691185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1043/2089] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:30.695572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4403e3d-084b-4177-9dc6-56b8f9a9babd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:30.705418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4403e3d-084b-4177-9dc6-56b8f9a9babd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:30.710362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf60ec-17ec-457f-90d5-b813829da84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:30.711128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf60ec-17ec-457f-90d5-b813829da84f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:30.711415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf60ec-17ec-457f-90d5-b813829da84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:30.711691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf60ec-17ec-457f-90d5-b813829da84f admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:30.712452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf60ec-17ec-457f-90d5-b813829da84f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:30.712758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf60ec-17ec-457f-90d5-b813829da84f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:30.714347 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf60ec-17ec-457f-90d5-b813829da84f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:30.729137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1047/2090] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:30.730703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc335b47-77e0-40e8-bf03-3fc65a65590d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:30.740868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc335b47-77e0-40e8-bf03-3fc65a65590d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:30.746491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919bdf7-babb-4ba7-8cdb-1ab3b6d01945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:30.747135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919bdf7-babb-4ba7-8cdb-1ab3b6d01945 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:30.747444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919bdf7-babb-4ba7-8cdb-1ab3b6d01945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:30.747714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919bdf7-babb-4ba7-8cdb-1ab3b6d01945 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:30.748767 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919bdf7-babb-4ba7-8cdb-1ab3b6d01945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:30.750656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919bdf7-babb-4ba7-8cdb-1ab3b6d01945 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:30.777579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1044/2091] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:30 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:30.781416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf60ec-17ec-457f-90d5-b813829da84f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:30.796741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf60ec-17ec-457f-90d5-b813829da84f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:30.868922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33c00e-7315-48b1-a85f-585823b91555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:30.869601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33c00e-7315-48b1-a85f-585823b91555 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:30.869889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33c00e-7315-48b1-a85f-585823b91555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:30.870398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33c00e-7315-48b1-a85f-585823b91555 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:30.871111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33c00e-7315-48b1-a85f-585823b91555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:30.873076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33c00e-7315-48b1-a85f-585823b91555 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:30.895614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1048/2092] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:30 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:30.900334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919bdf7-babb-4ba7-8cdb-1ab3b6d01945 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:30.914798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919bdf7-babb-4ba7-8cdb-1ab3b6d01945 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:30.920898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c21dda-2f73-400c-9806-16160a23d2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:30.921605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c21dda-2f73-400c-9806-16160a23d2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:30.921893 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c21dda-2f73-400c-9806-16160a23d2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:30.922174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c21dda-2f73-400c-9806-16160a23d2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:30.923089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c21dda-2f73-400c-9806-16160a23d2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:30.924653 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c21dda-2f73-400c-9806-16160a23d2a3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:30.935979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1045/2093] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:30.940577 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33c00e-7315-48b1-a85f-585823b91555 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:30.951111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33c00e-7315-48b1-a85f-585823b91555 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:30.955893 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42eb35-cb78-4ebc-ad9a-8e7e37028ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:30.956552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42eb35-cb78-4ebc-ad9a-8e7e37028ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:30.956835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42eb35-cb78-4ebc-ad9a-8e7e37028ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:30.957113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42eb35-cb78-4ebc-ad9a-8e7e37028ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:30.957845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42eb35-cb78-4ebc-ad9a-8e7e37028ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:30.959579 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42eb35-cb78-4ebc-ad9a-8e7e37028ef0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:30.970663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1049/2094] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:30.974834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c21dda-2f73-400c-9806-16160a23d2a3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:30.985145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c21dda-2f73-400c-9806-16160a23d2a3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:30.990383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d3116-09c8-4275-a775-f44e89d23fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:30.991254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d3116-09c8-4275-a775-f44e89d23fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:30.991533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d3116-09c8-4275-a775-f44e89d23fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:30.991813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d3116-09c8-4275-a775-f44e89d23fe8 admin admin] PATH_INFO: `/v3/projects/72897590cf744b51a753a273e18e58b1/users/90f0f8e04a9e412b93411903705dd45f/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:31.006122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d3116-09c8-4275-a775-f44e89d23fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72897590cf744b51a753a273e18e58b1, user_id=90f0f8e04a9e412b93411903705dd45f, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:31.008830 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d3116-09c8-4275-a775-f44e89d23fe8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:31.021445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1046/2095] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:30 2022] PUT /identity/v3/projects/72897590cf744b51a753a273e18e58b1/users/90f0f8e04a9e412b93411903705dd45f/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:31.026526 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2725cce-18a2-4bc6-ac82-11f08a1fbcde None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:31.026760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2725cce-18a2-4bc6-ac82-11f08a1fbcde None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:31.027039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2725cce-18a2-4bc6-ac82-11f08a1fbcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:31.045271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c2725cce-18a2-4bc6-ac82-11f08a1fbcde None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:31.046489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c2725cce-18a2-4bc6-ac82-11f08a1fbcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:31.090652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:31.107828 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1050/2096] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:31.117971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d3116-09c8-4275-a775-f44e89d23fe8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:31.119691 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-315d3116-09c8-4275-a775-f44e89d23fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:31.176321 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d3116-09c8-4275-a775-f44e89d23fe8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:31.180156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc7acf-7e4c-47d5-b0d9-658a8e45f999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:31.180797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7acf-7e4c-47d5-b0d9-658a8e45f999 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:31.181083 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7acf-7e4c-47d5-b0d9-658a8e45f999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:31.181364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7acf-7e4c-47d5-b0d9-658a8e45f999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:31.190492 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc7acf-7e4c-47d5-b0d9-658a8e45f999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:31.191925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc7acf-7e4c-47d5-b0d9-658a8e45f999 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:31.201543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1047/2097] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:32.143035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e5c19-6246-4ba1-9af5-771c27290439 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:32.143548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e5c19-6246-4ba1-9af5-771c27290439 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:32.143726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e5c19-6246-4ba1-9af5-771c27290439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:32.171769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-872e5c19-6246-4ba1-9af5-771c27290439 None None] MFA Rules not processed for user `90f0f8e04a9e412b93411903705dd45f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:32.173280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-872e5c19-6246-4ba1-9af5-771c27290439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:32.255122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1051/2098] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:32.263868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc7acf-7e4c-47d5-b0d9-658a8e45f999 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:32.269043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-09cc7acf-7e4c-47d5-b0d9-658a8e45f999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:32.356661 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc7acf-7e4c-47d5-b0d9-658a8e45f999 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:32.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5073a0-ae72-4117-8b7d-8b6803b7a1cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:32.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5073a0-ae72-4117-8b7d-8b6803b7a1cc service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:32.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5073a0-ae72-4117-8b7d-8b6803b7a1cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:32.364337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5073a0-ae72-4117-8b7d-8b6803b7a1cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:32.376402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5073a0-ae72-4117-8b7d-8b6803b7a1cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:32.378065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5073a0-ae72-4117-8b7d-8b6803b7a1cc service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:32.390458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1048/2099] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:33.868298 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab70af-1403-43d2-b6b9-62b2de3b86ff None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:33.868862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab70af-1403-43d2-b6b9-62b2de3b86ff None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:33.868862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab70af-1403-43d2-b6b9-62b2de3b86ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:33.889236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2bab70af-1403-43d2-b6b9-62b2de3b86ff None None] MFA Rules not processed for user `90f0f8e04a9e412b93411903705dd45f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:33.890762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2bab70af-1403-43d2-b6b9-62b2de3b86ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:33.899296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1052/2100] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:36.087748 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553ce0d-d782-4c01-95c5-896ca2910882 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:36.087748 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553ce0d-d782-4c01-95c5-896ca2910882 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:36.088472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553ce0d-d782-4c01-95c5-896ca2910882 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:36.089928 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1049/2101] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:24:36.101280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437b530-809f-4bb4-a071-a0bfc85a0d1c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:36.102226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437b530-809f-4bb4-a071-a0bfc85a0d1c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:36.102226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437b530-809f-4bb4-a071-a0bfc85a0d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:36.124451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8437b530-809f-4bb4-a071-a0bfc85a0d1c None None] MFA Rules not processed for user `c89ae81d49214b75a747a6cfa3ddf0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:36.126031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8437b530-809f-4bb4-a071-a0bfc85a0d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:36.206626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553ce0d-d782-4c01-95c5-896ca2910882 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:36.208516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5553ce0d-d782-4c01-95c5-896ca2910882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:36.211154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1053/2102] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:36.221659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437b530-809f-4bb4-a071-a0bfc85a0d1c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:36.223101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8437b530-809f-4bb4-a071-a0bfc85a0d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:36.237154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437b530-809f-4bb4-a071-a0bfc85a0d1c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:36.245613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553ce0d-d782-4c01-95c5-896ca2910882 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:36.249776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3337ef-8c45-4992-a5ad-f64bce98733a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:36.250445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3337ef-8c45-4992-a5ad-f64bce98733a service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:36.251596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3337ef-8c45-4992-a5ad-f64bce98733a service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:36.252396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3337ef-8c45-4992-a5ad-f64bce98733a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:36.252660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c76270-ceca-4305-9c8f-3d7ec6b92288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:36.253913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c76270-ceca-4305-9c8f-3d7ec6b92288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:36.254293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c76270-ceca-4305-9c8f-3d7ec6b92288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:36.254667 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c76270-ceca-4305-9c8f-3d7ec6b92288 admin admin] PATH_INFO: `/v3/users/45beec4d30384eb49bba3ba9a5f2c7ca` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:36.256712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c76270-ceca-4305-9c8f-3d7ec6b92288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45beec4d30384eb49bba3ba9a5f2c7ca)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:36.262594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c76270-ceca-4305-9c8f-3d7ec6b92288 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:36.263462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3337ef-8c45-4992-a5ad-f64bce98733a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:36.265350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3337ef-8c45-4992-a5ad-f64bce98733a service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:36.278805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1054/2103] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:36.297023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:36.354360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d8c76270-ceca-4305-9c8f-3d7ec6b92288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45beec4d30384eb49bba3ba9a5f2c7ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:36.367254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d8c76270-ceca-4305-9c8f-3d7ec6b92288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45beec4d30384eb49bba3ba9a5f2c7ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:36.378444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d8c76270-ceca-4305-9c8f-3d7ec6b92288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45beec4d30384eb49bba3ba9a5f2c7ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:36.378444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d8c76270-ceca-4305-9c8f-3d7ec6b92288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45beec4d30384eb49bba3ba9a5f2c7ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:36.396671 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d8c76270-ceca-4305-9c8f-3d7ec6b92288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45beec4d30384eb49bba3ba9a5f2c7ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:36.404737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1050/2104] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:36 2022] DELETE /identity/v3/users/45beec4d30384eb49bba3ba9a5f2c7ca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:36.609079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3337ef-8c45-4992-a5ad-f64bce98733a service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:36.624122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3337ef-8c45-4992-a5ad-f64bce98733a service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:36.690077 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:36.697704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:36.698611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:36.698899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:36.699213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] PATH_INFO: `/v3/projects/5998eeb14d9842fa8b330a9cb9cd5f03` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:36.700441 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5998eeb14d9842fa8b330a9cb9cd5f03)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:36.702372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:36.754803 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5998eeb14d9842fa8b330a9cb9cd5f03', 'request_id': 'req-575b58b5-17c9-4a76-b7bd-53db0f59e196'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:36.761285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5998eeb14d9842fa8b330a9cb9cd5f03', 'request_id': 'req-575b58b5-17c9-4a76-b7bd-53db0f59e196'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:36.768204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5998eeb14d9842fa8b330a9cb9cd5f03', 'request_id': 'req-575b58b5-17c9-4a76-b7bd-53db0f59e196'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:36.781362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] The token cache is being invalidate because project 5998eeb14d9842fa8b330a9cb9cd5f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:36.781649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:36.782820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-575b58b5-17c9-4a76-b7bd-53db0f59e196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:36.784458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1055/2105] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:36 2022] DELETE /identity/v3/projects/5998eeb14d9842fa8b330a9cb9cd5f03 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:36.790504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7092-f986-46c9-a89f-ba8cd4fbd317 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:36.790789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7092-f986-46c9-a89f-ba8cd4fbd317 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:36.791251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7092-f986-46c9-a89f-ba8cd4fbd317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:36.813009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6c1e7092-f986-46c9-a89f-ba8cd4fbd317 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:36.814884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6c1e7092-f986-46c9-a89f-ba8cd4fbd317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:36.901349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1051/2106] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:36.910252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c27342-6fff-46fd-a548-452881384acd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:36.910635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c27342-6fff-46fd-a548-452881384acd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:36.910925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c27342-6fff-46fd-a548-452881384acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:36.945747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-44c27342-6fff-46fd-a548-452881384acd None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:36.946974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-44c27342-6fff-46fd-a548-452881384acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:36.956920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1056/2107] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:36.961896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e7092-f986-46c9-a89f-ba8cd4fbd317 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:36.975627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e7092-f986-46c9-a89f-ba8cd4fbd317 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:36.981715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f0840-c4f0-47b4-bd88-43e7fe706db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:36.982824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f0840-c4f0-47b4-bd88-43e7fe706db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:36.983202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f0840-c4f0-47b4-bd88-43e7fe706db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:36.983498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f0840-c4f0-47b4-bd88-43e7fe706db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:36.984315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f0840-c4f0-47b4-bd88-43e7fe706db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:36.984637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f0840-c4f0-47b4-bd88-43e7fe706db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:36.988403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f0840-c4f0-47b4-bd88-43e7fe706db0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:37.009389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1052/2108] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:37.013490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c27342-6fff-46fd-a548-452881384acd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:37.028352 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c27342-6fff-46fd-a548-452881384acd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:37.044114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6340-6ad7-45f9-aff2-60d2c29e8564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:37.044852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6340-6ad7-45f9-aff2-60d2c29e8564 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:37.045335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6340-6ad7-45f9-aff2-60d2c29e8564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:37.045841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6340-6ad7-45f9-aff2-60d2c29e8564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:37.046573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f6340-6ad7-45f9-aff2-60d2c29e8564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:37.049588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f6340-6ad7-45f9-aff2-60d2c29e8564 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:37.080149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1057/2109] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:37 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:37.083324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f0840-c4f0-47b4-bd88-43e7fe706db0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:37.094014 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f0840-c4f0-47b4-bd88-43e7fe706db0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:37.206362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529ea1a-5160-44a7-ac5e-2dee7d9997dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:37.207829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529ea1a-5160-44a7-ac5e-2dee7d9997dc admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:37.207829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529ea1a-5160-44a7-ac5e-2dee7d9997dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:37.208363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529ea1a-5160-44a7-ac5e-2dee7d9997dc admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:37.209223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529ea1a-5160-44a7-ac5e-2dee7d9997dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:37.212122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529ea1a-5160-44a7-ac5e-2dee7d9997dc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:37.247802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1053/2110] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:37 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:37.248409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6340-6ad7-45f9-aff2-60d2c29e8564 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:37.276672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6340-6ad7-45f9-aff2-60d2c29e8564 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:37.308933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533e7e0-a938-4c74-bfe3-2c2d5c35bb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:37.309652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533e7e0-a938-4c74-bfe3-2c2d5c35bb85 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:37.309960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533e7e0-a938-4c74-bfe3-2c2d5c35bb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:37.310253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533e7e0-a938-4c74-bfe3-2c2d5c35bb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:37.311088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533e7e0-a938-4c74-bfe3-2c2d5c35bb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:37.316998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533e7e0-a938-4c74-bfe3-2c2d5c35bb85 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:37.332058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1058/2111] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:37.334835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529ea1a-5160-44a7-ac5e-2dee7d9997dc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:37.351439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529ea1a-5160-44a7-ac5e-2dee7d9997dc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:37.357042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc5b9-6457-4388-ac8c-de490ce9ccf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:37.358107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc5b9-6457-4388-ac8c-de490ce9ccf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:37.358405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc5b9-6457-4388-ac8c-de490ce9ccf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:37.358685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc5b9-6457-4388-ac8c-de490ce9ccf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:37.361549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bc5b9-6457-4388-ac8c-de490ce9ccf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:37.363180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bc5b9-6457-4388-ac8c-de490ce9ccf4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:37.366312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:37.401984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533e7e0-a938-4c74-bfe3-2c2d5c35bb85 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:37.408679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1054/2112] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:37.416500 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533e7e0-a938-4c74-bfe3-2c2d5c35bb85 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:37.425475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1ebad-d7e7-4093-a419-61a3bbe47020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:37.432644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1ebad-d7e7-4093-a419-61a3bbe47020 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:37.433274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1ebad-d7e7-4093-a419-61a3bbe47020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:37.433797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1ebad-d7e7-4093-a419-61a3bbe47020 admin admin] PATH_INFO: `/v3/projects/8b8575ea2d08421ba4afa3f12a6b8fa7/users/62efd4fd615c4e63ab83335af45bc7ab/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:37.455831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1ebad-d7e7-4093-a419-61a3bbe47020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8575ea2d08421ba4afa3f12a6b8fa7, user_id=62efd4fd615c4e63ab83335af45bc7ab, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:37.461029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1ebad-d7e7-4093-a419-61a3bbe47020 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:37.496516 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1059/2113] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:37 2022] PUT /identity/v3/projects/8b8575ea2d08421ba4afa3f12a6b8fa7/users/62efd4fd615c4e63ab83335af45bc7ab/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:37.498833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2367fa-c48e-48f4-9f4b-ba05ec8fe228 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:37.499134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2367fa-c48e-48f4-9f4b-ba05ec8fe228 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:37.499425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2367fa-c48e-48f4-9f4b-ba05ec8fe228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:37.550423 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ff2367fa-c48e-48f4-9f4b-ba05ec8fe228 None None] MFA Rules not processed for user `62efd4fd615c4e63ab83335af45bc7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:37.552327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ff2367fa-c48e-48f4-9f4b-ba05ec8fe228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:37.664069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1055/2114] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:37.674594 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1ebad-d7e7-4093-a419-61a3bbe47020 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:37.676758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-94a1ebad-d7e7-4093-a419-61a3bbe47020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:37.806499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1ebad-d7e7-4093-a419-61a3bbe47020 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:37.813061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418aef98-a749-42f0-96d2-22df67731408 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:37.814385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418aef98-a749-42f0-96d2-22df67731408 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:37.814773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418aef98-a749-42f0-96d2-22df67731408 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:37.815157 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418aef98-a749-42f0-96d2-22df67731408 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:37.824304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418aef98-a749-42f0-96d2-22df67731408 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:37.826198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418aef98-a749-42f0-96d2-22df67731408 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:37.838104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1060/2115] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:37.929947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2367fa-c48e-48f4-9f4b-ba05ec8fe228 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:37.931673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ff2367fa-c48e-48f4-9f4b-ba05ec8fe228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:38.016803 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2367fa-c48e-48f4-9f4b-ba05ec8fe228 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:38.022698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f2089-ef94-405b-9318-37334a202304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:38.023588 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f2089-ef94-405b-9318-37334a202304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:38.024045 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f2089-ef94-405b-9318-37334a202304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:38.024413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f2089-ef94-405b-9318-37334a202304 admin admin] PATH_INFO: `/v3/users/49b2889226254237bffb75b5b6610cf7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:38.025869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f2089-ef94-405b-9318-37334a202304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b2889226254237bffb75b5b6610cf7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:38.028786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f2089-ef94-405b-9318-37334a202304 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:38.088474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418aef98-a749-42f0-96d2-22df67731408 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:38.090554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a81f2089-ef94-405b-9318-37334a202304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b2889226254237bffb75b5b6610cf7'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.102575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418aef98-a749-42f0-96d2-22df67731408 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:38.105244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a81f2089-ef94-405b-9318-37334a202304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b2889226254237bffb75b5b6610cf7'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.111384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:38.114530 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:38.115394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:38.116798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a81f2089-ef94-405b-9318-37334a202304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b2889226254237bffb75b5b6610cf7'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.116945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] PATH_INFO: `/v3/users/62efd4fd615c4e63ab83335af45bc7ab` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:38.117561 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a81f2089-ef94-405b-9318-37334a202304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b2889226254237bffb75b5b6610cf7'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.121971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62efd4fd615c4e63ab83335af45bc7ab)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:38.124360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:38.126556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:38.143768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a81f2089-ef94-405b-9318-37334a202304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b2889226254237bffb75b5b6610cf7'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.158139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1056/2116] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:37 2022] DELETE /identity/v3/users/49b2889226254237bffb75b5b6610cf7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:38.212151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62efd4fd615c4e63ab83335af45bc7ab'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.229035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62efd4fd615c4e63ab83335af45bc7ab'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.240527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62efd4fd615c4e63ab83335af45bc7ab'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.241960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62efd4fd615c4e63ab83335af45bc7ab'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.261035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62efd4fd615c4e63ab83335af45bc7ab'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.268548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1061/2117] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:38 2022] DELETE /identity/v3/users/62efd4fd615c4e63ab83335af45bc7ab => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:38.273128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200de2-d341-4967-9322-1759f2bd943d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:38.273668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200de2-d341-4967-9322-1759f2bd943d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:38.274131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7200de2-d341-4967-9322-1759f2bd943d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:38.290185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:38.299048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a7200de2-d341-4967-9322-1759f2bd943d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:38.301833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a7200de2-d341-4967-9322-1759f2bd943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:38.417173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1057/2118] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:38.425707 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:38.427347 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:38.443083 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728582d9-ff0e-4c44-a023-a3950eb45721 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:38.448791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:38.449674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:38.449969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:38.450255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] PATH_INFO: `/v3/projects/9693d1597a6a40319aa7756b8ff18361` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:38.451583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9693d1597a6a40319aa7756b8ff18361)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:38.453496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:38.459754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7200de2-d341-4967-9322-1759f2bd943d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:38.461018 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a7200de2-d341-4967-9322-1759f2bd943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:38.535045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9693d1597a6a40319aa7756b8ff18361', 'request_id': 'req-a330626e-6ab1-4f47-af46-a1322fac5e96'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.542634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7200de2-d341-4967-9322-1759f2bd943d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:38.543942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9693d1597a6a40319aa7756b8ff18361', 'request_id': 'req-a330626e-6ab1-4f47-af46-a1322fac5e96'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.554937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9693d1597a6a40319aa7756b8ff18361', 'request_id': 'req-a330626e-6ab1-4f47-af46-a1322fac5e96'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.578423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] The token cache is being invalidate because project 9693d1597a6a40319aa7756b8ff18361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:38.578731 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.579505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.583235 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1062/2119] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:38 2022] DELETE /identity/v3/projects/9693d1597a6a40319aa7756b8ff18361 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:38.591014 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:38.593534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:38.615277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea65abd-0dab-4077-8f80-56cd651dcb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:38.616402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea65abd-0dab-4077-8f80-56cd651dcb0c service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:38.616808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea65abd-0dab-4077-8f80-56cd651dcb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:38.617187 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea65abd-0dab-4077-8f80-56cd651dcb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:38.620456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5ea65abd-0dab-4077-8f80-56cd651dcb0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:38.667919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330626e-6ab1-4f47-af46-a1322fac5e96 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:38.674685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:38.675724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:38.676147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:38.676560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] PATH_INFO: `/v3/users/8e3f0b504d914460ae4b7d7ed87d0027` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:38.677879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3f0b504d914460ae4b7d7ed87d0027)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:38.680170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:38.683114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:38.696988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea65abd-0dab-4077-8f80-56cd651dcb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:38.698239 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea65abd-0dab-4077-8f80-56cd651dcb0c service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:38.709620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1058/2120] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:38.747180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3f0b504d914460ae4b7d7ed87d0027'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.760899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3f0b504d914460ae4b7d7ed87d0027'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.776870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3f0b504d914460ae4b7d7ed87d0027'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.777608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3f0b504d914460ae4b7d7ed87d0027'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.789275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3f0b504d914460ae4b7d7ed87d0027'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:38.804165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1063/2121] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:38 2022] DELETE /identity/v3/users/8e3f0b504d914460ae4b7d7ed87d0027 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:39.179777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea65abd-0dab-4077-8f80-56cd651dcb0c service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.181755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5ea65abd-0dab-4077-8f80-56cd651dcb0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:39.197443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea65abd-0dab-4077-8f80-56cd651dcb0c service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:39.208779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:39.282483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:39.283647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.284197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.284524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] PATH_INFO: `/v3/projects/8b8575ea2d08421ba4afa3f12a6b8fa7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.286000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8575ea2d08421ba4afa3f12a6b8fa7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:39.288483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:39.296883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.298495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:39.322290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa066537-6c54-4eb3-bfa1-cb240e60646d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:39.343156 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:39.346214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.348461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.350031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] PATH_INFO: `/v3/projects/a07c6cb77cbf4e028736d2275beaf852` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.353300 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07c6cb77cbf4e028736d2275beaf852)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:39.357528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:39.385640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8575ea2d08421ba4afa3f12a6b8fa7', 'request_id': 'req-83627dea-3770-42da-b7ea-428c86650221'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:39.395416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8575ea2d08421ba4afa3f12a6b8fa7', 'request_id': 'req-83627dea-3770-42da-b7ea-428c86650221'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:39.402732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8575ea2d08421ba4afa3f12a6b8fa7', 'request_id': 'req-83627dea-3770-42da-b7ea-428c86650221'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:39.425653 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] The token cache is being invalidate because project 8b8575ea2d08421ba4afa3f12a6b8fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:39.425961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:39.426700 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83627dea-3770-42da-b7ea-428c86650221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:39.432873 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1059/2122] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:39 2022] DELETE /identity/v3/projects/8b8575ea2d08421ba4afa3f12a6b8fa7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:39.434400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ced52-c4a9-42bb-ba6e-3072aa681404 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.434702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ced52-c4a9-42bb-ba6e-3072aa681404 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.434990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ced52-c4a9-42bb-ba6e-3072aa681404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.435504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07c6cb77cbf4e028736d2275beaf852', 'request_id': 'req-4426ae30-0fcf-402d-a081-d4ed9ed3e337'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:39.445172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07c6cb77cbf4e028736d2275beaf852', 'request_id': 'req-4426ae30-0fcf-402d-a081-d4ed9ed3e337'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:39.455222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07c6cb77cbf4e028736d2275beaf852', 'request_id': 'req-4426ae30-0fcf-402d-a081-d4ed9ed3e337'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:39.466536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b56ced52-c4a9-42bb-ba6e-3072aa681404 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:39.468348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b56ced52-c4a9-42bb-ba6e-3072aa681404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:39.482514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] The token cache is being invalidate because project a07c6cb77cbf4e028736d2275beaf852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:39.483038 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:39.484061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4426ae30-0fcf-402d-a081-d4ed9ed3e337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:39.487040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1064/2123] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:39 2022] DELETE /identity/v3/projects/a07c6cb77cbf4e028736d2275beaf852 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:39.491755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b0df-d745-4da7-aad0-8ef155e88cf6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.492485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b0df-d745-4da7-aad0-8ef155e88cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.496770 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b0df-d745-4da7-aad0-8ef155e88cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.520899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3ee7b0df-d745-4da7-aad0-8ef155e88cf6 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:39.522141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ee7b0df-d745-4da7-aad0-8ef155e88cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:39.548479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1060/2124] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:39.557402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f0d41-2b5b-4b18-b85f-5383d54d05de None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.557835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f0d41-2b5b-4b18-b85f-5383d54d05de None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.558546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f0d41-2b5b-4b18-b85f-5383d54d05de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.579406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3b8f0d41-2b5b-4b18-b85f-5383d54d05de None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:39.580687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3b8f0d41-2b5b-4b18-b85f-5383d54d05de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:39.595041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1061/2125] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:39.595967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1065/2126] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:39.596113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f0d41-2b5b-4b18-b85f-5383d54d05de None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.605673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceb7e1-3949-41b0-9f0f-4f6a0705ccec None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.606179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceb7e1-3949-41b0-9f0f-4f6a0705ccec None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.606464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceb7e1-3949-41b0-9f0f-4f6a0705ccec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.608269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f0d41-2b5b-4b18-b85f-5383d54d05de None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:39.613127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766368d-20c2-43b9-84f0-7d17be80ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:39.613783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766368d-20c2-43b9-84f0-7d17be80ed33 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.614069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766368d-20c2-43b9-84f0-7d17be80ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.614350 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766368d-20c2-43b9-84f0-7d17be80ed33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.614570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:39.615367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766368d-20c2-43b9-84f0-7d17be80ed33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:39.615367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766368d-20c2-43b9-84f0-7d17be80ed33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:39.617040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766368d-20c2-43b9-84f0-7d17be80ed33 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:39.627723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-89ceb7e1-3949-41b0-9f0f-4f6a0705ccec None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:39.630449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1062/2127] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:24:39.634489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766368d-20c2-43b9-84f0-7d17be80ed33 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.635140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-89ceb7e1-3949-41b0-9f0f-4f6a0705ccec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:39.648168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1066/2128] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:39.651681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ceb7e1-3949-41b0-9f0f-4f6a0705ccec None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.654772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766368d-20c2-43b9-84f0-7d17be80ed33 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:39.660918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4de7f-e5da-4f6f-a906-1d7867421898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:39.661368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ceb7e1-3949-41b0-9f0f-4f6a0705ccec None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:39.661578 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4de7f-e5da-4f6f-a906-1d7867421898 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.661858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4de7f-e5da-4f6f-a906-1d7867421898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.662183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4de7f-e5da-4f6f-a906-1d7867421898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.663570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4de7f-e5da-4f6f-a906-1d7867421898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:39.665528 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4de7f-e5da-4f6f-a906-1d7867421898 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:39.666621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeebbf-20f2-49a0-9e29-1c64c20f5f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:39.667389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeebbf-20f2-49a0-9e29-1c64c20f5f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.667767 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeebbf-20f2-49a0-9e29-1c64c20f5f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.668200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeebbf-20f2-49a0-9e29-1c64c20f5f17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.669090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaeebbf-20f2-49a0-9e29-1c64c20f5f17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:39.669505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaeebbf-20f2-49a0-9e29-1c64c20f5f17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:39.671214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaeebbf-20f2-49a0-9e29-1c64c20f5f17 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:39.690902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1067/2129] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:39.692253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeebbf-20f2-49a0-9e29-1c64c20f5f17 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.701593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1063/2130] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:39 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:39.703285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeebbf-20f2-49a0-9e29-1c64c20f5f17 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:39.706005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4de7f-e5da-4f6f-a906-1d7867421898 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.711054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:39.775839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b54baa-721e-44d2-85ac-a77bf7bc2373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:39.776569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b54baa-721e-44d2-85ac-a77bf7bc2373 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.776936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b54baa-721e-44d2-85ac-a77bf7bc2373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.777288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b54baa-721e-44d2-85ac-a77bf7bc2373 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.778068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b54baa-721e-44d2-85ac-a77bf7bc2373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:39.780128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b54baa-721e-44d2-85ac-a77bf7bc2373 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:39.790620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4de7f-e5da-4f6f-a906-1d7867421898 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:39.795679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c990bde-f998-452a-a333-d4b4e802bd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:39.796568 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c990bde-f998-452a-a333-d4b4e802bd60 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.796688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c990bde-f998-452a-a333-d4b4e802bd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.796967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c990bde-f998-452a-a333-d4b4e802bd60 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.797837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c990bde-f998-452a-a333-d4b4e802bd60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:39.799770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c990bde-f998-452a-a333-d4b4e802bd60 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:39.815079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1068/2131] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:39 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:39.816383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b54baa-721e-44d2-85ac-a77bf7bc2373 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.851397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1064/2132] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:39 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:39.852498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c990bde-f998-452a-a333-d4b4e802bd60 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.863417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c990bde-f998-452a-a333-d4b4e802bd60 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:39.900984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b54baa-721e-44d2-85ac-a77bf7bc2373 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:39.917302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0006-636a-4a56-83be-0b6d593f757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:39.918009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0006-636a-4a56-83be-0b6d593f757f admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.918296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0006-636a-4a56-83be-0b6d593f757f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.918585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0006-636a-4a56-83be-0b6d593f757f admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.919304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a0006-636a-4a56-83be-0b6d593f757f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:39.921310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a0006-636a-4a56-83be-0b6d593f757f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:39.931115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5be6d9-6c76-438d-b5d0-11f06d14d2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:39.932461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5be6d9-6c76-438d-b5d0-11f06d14d2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.932920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5be6d9-6c76-438d-b5d0-11f06d14d2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.933565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5be6d9-6c76-438d-b5d0-11f06d14d2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.934432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5be6d9-6c76-438d-b5d0-11f06d14d2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:39.936144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5be6d9-6c76-438d-b5d0-11f06d14d2a1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:39.944426 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1069/2133] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:39 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:39.948378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0006-636a-4a56-83be-0b6d593f757f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.953049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1065/2134] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:39.954882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5be6d9-6c76-438d-b5d0-11f06d14d2a1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.959691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0006-636a-4a56-83be-0b6d593f757f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:39.965262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5be6d9-6c76-438d-b5d0-11f06d14d2a1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:39.966127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f2b0b-5bc2-449b-bad2-dc2f05807dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:39.966799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f2b0b-5bc2-449b-bad2-dc2f05807dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.967088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f2b0b-5bc2-449b-bad2-dc2f05807dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.967412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f2b0b-5bc2-449b-bad2-dc2f05807dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.968340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f2b0b-5bc2-449b-bad2-dc2f05807dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:39.970485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f2b0b-5bc2-449b-bad2-dc2f05807dbb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:39.971101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f9d5f-9470-410e-8027-66ac23a6c8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:39.971961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f9d5f-9470-410e-8027-66ac23a6c8ae admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:39.972524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f9d5f-9470-410e-8027-66ac23a6c8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:39.972883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f9d5f-9470-410e-8027-66ac23a6c8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:39.973746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f9d5f-9470-410e-8027-66ac23a6c8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:39.975571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f9d5f-9470-410e-8027-66ac23a6c8ae admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:39.983039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1070/2135] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:39.988868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1066/2136] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:39.989042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f2b0b-5bc2-449b-bad2-dc2f05807dbb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:39.996769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f9d5f-9470-410e-8027-66ac23a6c8ae admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:40.002681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f2b0b-5bc2-449b-bad2-dc2f05807dbb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:40.008499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91344b7-5529-4c0a-8368-a1c62aa200e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:40.009172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f9d5f-9470-410e-8027-66ac23a6c8ae admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:40.009284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91344b7-5529-4c0a-8368-a1c62aa200e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.009501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91344b7-5529-4c0a-8368-a1c62aa200e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.009783 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91344b7-5529-4c0a-8368-a1c62aa200e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.010521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91344b7-5529-4c0a-8368-a1c62aa200e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:40.012199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91344b7-5529-4c0a-8368-a1c62aa200e0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:40.029489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0dd5d-9b2f-4b62-8a8b-f0536a4b1348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:40.030424 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0dd5d-9b2f-4b62-8a8b-f0536a4b1348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.030715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0dd5d-9b2f-4b62-8a8b-f0536a4b1348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.031087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0dd5d-9b2f-4b62-8a8b-f0536a4b1348 admin admin] PATH_INFO: `/v3/projects/d012c62a613e48a1be61f7f67c4846bb/users/07499f73f7a94ed599f34afbb5e9477d/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.034600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1071/2137] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:40.039224 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91344b7-5529-4c0a-8368-a1c62aa200e0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:40.049461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0dd5d-9b2f-4b62-8a8b-f0536a4b1348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d012c62a613e48a1be61f7f67c4846bb, user_id=07499f73f7a94ed599f34afbb5e9477d, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:40.053486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0dd5d-9b2f-4b62-8a8b-f0536a4b1348 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:40.055628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91344b7-5529-4c0a-8368-a1c62aa200e0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:40.061478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7b7e3-1226-4258-a968-1cd8e02fc8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:40.062372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7b7e3-1226-4258-a968-1cd8e02fc8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.062704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7b7e3-1226-4258-a968-1cd8e02fc8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.062949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7b7e3-1226-4258-a968-1cd8e02fc8fa admin admin] PATH_INFO: `/v3/projects/dbdd6e3916264da1b8ddf74eb76ab9e3/users/541b60af772c4cefb8a885da4b35948b/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.070288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1067/2138] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:39 2022] PUT /identity/v3/projects/d012c62a613e48a1be61f7f67c4846bb/users/07499f73f7a94ed599f34afbb5e9477d/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:40.080442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7627ea-57c5-45fa-9694-11e1f597919d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.080675 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7627ea-57c5-45fa-9694-11e1f597919d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.080960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7627ea-57c5-45fa-9694-11e1f597919d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.082726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7b7e3-1226-4258-a968-1cd8e02fc8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbdd6e3916264da1b8ddf74eb76ab9e3, user_id=541b60af772c4cefb8a885da4b35948b, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:40.086465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7b7e3-1226-4258-a968-1cd8e02fc8fa admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:40.114287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4e7627ea-57c5-45fa-9694-11e1f597919d None None] MFA Rules not processed for user `07499f73f7a94ed599f34afbb5e9477d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:40.115547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4e7627ea-57c5-45fa-9694-11e1f597919d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:40.117138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1072/2139] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:40 2022] PUT /identity/v3/projects/dbdd6e3916264da1b8ddf74eb76ab9e3/users/541b60af772c4cefb8a885da4b35948b/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:40.128364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66dc5-f2d1-4643-8819-3f805331fe26 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.129182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66dc5-f2d1-4643-8819-3f805331fe26 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.130396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d66dc5-f2d1-4643-8819-3f805331fe26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.159322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:40.162334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:40.162689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b1d66dc5-f2d1-4643-8819-3f805331fe26 None None] MFA Rules not processed for user `541b60af772c4cefb8a885da4b35948b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:40.165740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b1d66dc5-f2d1-4643-8819-3f805331fe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:40.188902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1068/2140] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:40.193229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7627ea-57c5-45fa-9694-11e1f597919d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:40.235225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1073/2141] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:40.250644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d66dc5-f2d1-4643-8819-3f805331fe26 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:40.252151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b1d66dc5-f2d1-4643-8819-3f805331fe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:40.271554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7627ea-57c5-45fa-9694-11e1f597919d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:40.276554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814b73e-a67f-43c8-9f08-b2a78f92a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:40.277262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814b73e-a67f-43c8-9f08-b2a78f92a8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.277490 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814b73e-a67f-43c8-9f08-b2a78f92a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.277765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814b73e-a67f-43c8-9f08-b2a78f92a8a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.278460 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814b73e-a67f-43c8-9f08-b2a78f92a8a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:40.280390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814b73e-a67f-43c8-9f08-b2a78f92a8a2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:40.307434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1069/2142] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:40 2022] POST /identity/v3/projects => generated 361 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:40.311396 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814b73e-a67f-43c8-9f08-b2a78f92a8a2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:40.323116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d66dc5-f2d1-4643-8819-3f805331fe26 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:40.375546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814b73e-a67f-43c8-9f08-b2a78f92a8a2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:40.378648 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b843801-848e-4ab8-bb2d-91c29d06e7a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:40.379307 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843801-848e-4ab8-bb2d-91c29d06e7a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.379626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843801-848e-4ab8-bb2d-91c29d06e7a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.379907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843801-848e-4ab8-bb2d-91c29d06e7a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.380228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb72e-6871-4dc0-8415-f7f40f2b4a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:40.380888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb72e-6871-4dc0-8415-f7f40f2b4a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.381170 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb72e-6871-4dc0-8415-f7f40f2b4a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.381445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb72e-6871-4dc0-8415-f7f40f2b4a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.382129 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb72e-6871-4dc0-8415-f7f40f2b4a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:40.384065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb72e-6871-4dc0-8415-f7f40f2b4a7e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:40.407721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1070/2143] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:40 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:40.412078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb72e-6871-4dc0-8415-f7f40f2b4a7e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:40.423207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb72e-6871-4dc0-8415-f7f40f2b4a7e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:40.428164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c45991-51f8-4c00-8ff1-1e5f57bfc7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:40.428842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45991-51f8-4c00-8ff1-1e5f57bfc7ae admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.429132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45991-51f8-4c00-8ff1-1e5f57bfc7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.429412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45991-51f8-4c00-8ff1-1e5f57bfc7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.430152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c45991-51f8-4c00-8ff1-1e5f57bfc7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:40.431776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c45991-51f8-4c00-8ff1-1e5f57bfc7ae admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:40.445015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1071/2144] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:40.446151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c45991-51f8-4c00-8ff1-1e5f57bfc7ae admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:40.446290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b843801-848e-4ab8-bb2d-91c29d06e7a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:40.447610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b843801-848e-4ab8-bb2d-91c29d06e7a5 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:40.456215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c45991-51f8-4c00-8ff1-1e5f57bfc7ae admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:40.457599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1074/2145] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:40.460795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d27b9e-2745-4235-ba90-2f0d4c642d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:40.461658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27b9e-2745-4235-ba90-2f0d4c642d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.461943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27b9e-2745-4235-ba90-2f0d4c642d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.462236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27b9e-2745-4235-ba90-2f0d4c642d1e admin admin] PATH_INFO: `/v3/projects/ecb191344e4d40cb838595eddf914bb9/users/b8d7657b78a74fc6bc5349a742d062ef/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.479472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d27b9e-2745-4235-ba90-2f0d4c642d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb191344e4d40cb838595eddf914bb9, user_id=b8d7657b78a74fc6bc5349a742d062ef, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:40.482233 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d27b9e-2745-4235-ba90-2f0d4c642d1e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:40.496507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1072/2146] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:40 2022] PUT /identity/v3/projects/ecb191344e4d40cb838595eddf914bb9/users/b8d7657b78a74fc6bc5349a742d062ef/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:40.500528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b843801-848e-4ab8-bb2d-91c29d06e7a5 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:40.511488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b843801-848e-4ab8-bb2d-91c29d06e7a5 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:40.521482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:40.590953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817fb1b-5a57-4061-9327-ae50672dbdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:40.591674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817fb1b-5a57-4061-9327-ae50672dbdfc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.591964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817fb1b-5a57-4061-9327-ae50672dbdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.592290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817fb1b-5a57-4061-9327-ae50672dbdfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.593017 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817fb1b-5a57-4061-9327-ae50672dbdfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:40.594699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817fb1b-5a57-4061-9327-ae50672dbdfc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:40.608069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1075/2147] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:40.610389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d27b9e-2745-4235-ba90-2f0d4c642d1e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:40.624256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d27b9e-2745-4235-ba90-2f0d4c642d1e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:40.629923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5446c17-f262-4922-a5a2-b9038effbf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:40.630865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5446c17-f262-4922-a5a2-b9038effbf7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.631216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5446c17-f262-4922-a5a2-b9038effbf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.631524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5446c17-f262-4922-a5a2-b9038effbf7a admin admin] PATH_INFO: `/v3/projects/ecb191344e4d40cb838595eddf914bb9/users/b8d7657b78a74fc6bc5349a742d062ef/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.636453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5446c17-f262-4922-a5a2-b9038effbf7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb191344e4d40cb838595eddf914bb9, user_id=b8d7657b78a74fc6bc5349a742d062ef, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:40.643589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5446c17-f262-4922-a5a2-b9038effbf7a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:40.658651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1073/2148] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:40 2022] PUT /identity/v3/projects/ecb191344e4d40cb838595eddf914bb9/users/b8d7657b78a74fc6bc5349a742d062ef/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:40.670525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc4aad-175e-446e-9fa3-0c3f4698c351 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.671004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc4aad-175e-446e-9fa3-0c3f4698c351 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.671364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc4aad-175e-446e-9fa3-0c3f4698c351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.708589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-24fc4aad-175e-446e-9fa3-0c3f4698c351 None None] MFA Rules not processed for user `b8d7657b78a74fc6bc5349a742d062ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:40.709907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-24fc4aad-175e-446e-9fa3-0c3f4698c351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:40.796780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1076/2149] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:40.820949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5446c17-f262-4922-a5a2-b9038effbf7a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:40.845839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:40.892678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5446c17-f262-4922-a5a2-b9038effbf7a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:40.896284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51661df-f120-48b7-965e-19fb05148cde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:40.896925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51661df-f120-48b7-965e-19fb05148cde service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:40.897215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51661df-f120-48b7-965e-19fb05148cde service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:40.897491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51661df-f120-48b7-965e-19fb05148cde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:40.906858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51661df-f120-48b7-965e-19fb05148cde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:40.908888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51661df-f120-48b7-965e-19fb05148cde service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:40.918833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1074/2150] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:41.313874 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc4aad-175e-446e-9fa3-0c3f4698c351 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:41.387578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc4aad-175e-446e-9fa3-0c3f4698c351 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:41.392523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:41.393390 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:41.393675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:41.393954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] PATH_INFO: `/v3/users/07499f73f7a94ed599f34afbb5e9477d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:41.395141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07499f73f7a94ed599f34afbb5e9477d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:41.397085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:41.437739 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:41.447268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07499f73f7a94ed599f34afbb5e9477d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:41.460201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07499f73f7a94ed599f34afbb5e9477d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:41.467744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07499f73f7a94ed599f34afbb5e9477d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:41.468430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07499f73f7a94ed599f34afbb5e9477d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:41.476677 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07499f73f7a94ed599f34afbb5e9477d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:41.482904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1077/2151] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:41 2022] DELETE /identity/v3/users/07499f73f7a94ed599f34afbb5e9477d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:41.488133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941d78-7136-49db-9151-f597761f269d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:41.488615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941d78-7136-49db-9151-f597761f269d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:41.488776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941d78-7136-49db-9151-f597761f269d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:41.508209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d3941d78-7136-49db-9151-f597761f269d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:41.509444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d3941d78-7136-49db-9151-f597761f269d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:41.573736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1075/2152] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:41.583998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:41.585537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:41.642142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812db0a-2abe-45e5-b4dd-8bb00ae644b8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:41.647530 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5dde-a5af-4823-9b0a-2c1b8698012c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:41.648319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5dde-a5af-4823-9b0a-2c1b8698012c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:41.648681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5dde-a5af-4823-9b0a-2c1b8698012c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:41.649065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5dde-a5af-4823-9b0a-2c1b8698012c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:41.662322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e5dde-a5af-4823-9b0a-2c1b8698012c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:41.663777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e5dde-a5af-4823-9b0a-2c1b8698012c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:41.674573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1078/2153] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:42.070387 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941d78-7136-49db-9151-f597761f269d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:42.071974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d3941d78-7136-49db-9151-f597761f269d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:42.086148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941d78-7136-49db-9151-f597761f269d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:42.091331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:42.092222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:42.092512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:42.092792 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] PATH_INFO: `/v3/projects/d012c62a613e48a1be61f7f67c4846bb` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:42.094019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d012c62a613e48a1be61f7f67c4846bb)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:42.096566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:42.144800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd012c62a613e48a1be61f7f67c4846bb', 'request_id': 'req-5e781a6a-979c-46f2-a303-f9f7075b7791'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:42.150896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd012c62a613e48a1be61f7f67c4846bb', 'request_id': 'req-5e781a6a-979c-46f2-a303-f9f7075b7791'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:42.156619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd012c62a613e48a1be61f7f67c4846bb', 'request_id': 'req-5e781a6a-979c-46f2-a303-f9f7075b7791'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:42.169517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] The token cache is being invalidate because project d012c62a613e48a1be61f7f67c4846bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:42.169810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:42.170547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:42.172180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1076/2154] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:42 2022] DELETE /identity/v3/projects/d012c62a613e48a1be61f7f67c4846bb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:42.176664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5dde-a5af-4823-9b0a-2c1b8698012c service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:42.186339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5dde-a5af-4823-9b0a-2c1b8698012c service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:42.242165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70c990-06a4-4978-b238-67f77445ff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:42.243027 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70c990-06a4-4978-b238-67f77445ff02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:42.243314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70c990-06a4-4978-b238-67f77445ff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:42.243598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70c990-06a4-4978-b238-67f77445ff02 admin admin] PATH_INFO: `/v3/users/b8d7657b78a74fc6bc5349a742d062ef` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:42.244823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70c990-06a4-4978-b238-67f77445ff02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d7657b78a74fc6bc5349a742d062ef)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:42.246747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70c990-06a4-4978-b238-67f77445ff02 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:42.292798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd70c990-06a4-4978-b238-67f77445ff02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d7657b78a74fc6bc5349a742d062ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:42.301043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:42.306424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd70c990-06a4-4978-b238-67f77445ff02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d7657b78a74fc6bc5349a742d062ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:42.314852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd70c990-06a4-4978-b238-67f77445ff02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d7657b78a74fc6bc5349a742d062ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:42.315502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd70c990-06a4-4978-b238-67f77445ff02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d7657b78a74fc6bc5349a742d062ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:42.324547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd70c990-06a4-4978-b238-67f77445ff02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d7657b78a74fc6bc5349a742d062ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:42.331502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1079/2155] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:42 2022] DELETE /identity/v3/users/b8d7657b78a74fc6bc5349a742d062ef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:42.911480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:42.912950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:42.926986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e781a6a-979c-46f2-a303-f9f7075b7791 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:42.967041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:42.999298 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:43.000350 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.000671 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.000988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] PATH_INFO: `/v3/projects/ecb191344e4d40cb838595eddf914bb9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.002229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb191344e4d40cb838595eddf914bb9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:43.004209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:43.060362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb191344e4d40cb838595eddf914bb9', 'request_id': 'req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:43.067245 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb191344e4d40cb838595eddf914bb9', 'request_id': 'req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:43.073186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb191344e4d40cb838595eddf914bb9', 'request_id': 'req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:43.086759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] The token cache is being invalidate because project ecb191344e4d40cb838595eddf914bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:43.087004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:43.087603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:43.089479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1077/2156] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:42 2022] DELETE /identity/v3/projects/ecb191344e4d40cb838595eddf914bb9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:43.094714 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bdee2-730e-426f-a7ea-c0cbc2cd3eb8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.095195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bdee2-730e-426f-a7ea-c0cbc2cd3eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.095366 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bdee2-730e-426f-a7ea-c0cbc2cd3eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.115988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b27bdee2-730e-426f-a7ea-c0cbc2cd3eb8 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:43.117285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b27bdee2-730e-426f-a7ea-c0cbc2cd3eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:43.140168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:43.141898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:43.183603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1080/2157] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:43.191377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfa10d-86bc-4215-964b-f42cc80f271c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.191794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfa10d-86bc-4215-964b-f42cc80f271c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.192128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfa10d-86bc-4215-964b-f42cc80f271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.209970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5f86c-fb4b-4bd4-bca9-b73b7847d609 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:43.211140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5bbfa10d-86bc-4215-964b-f42cc80f271c None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:43.212443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5bbfa10d-86bc-4215-964b-f42cc80f271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:43.214732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca628e4-552b-40d9-b1ef-fa56c2848bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:43.215537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca628e4-552b-40d9-b1ef-fa56c2848bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.215844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca628e4-552b-40d9-b1ef-fa56c2848bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.216147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca628e4-552b-40d9-b1ef-fa56c2848bf2 admin admin] PATH_INFO: `/v3/users/541b60af772c4cefb8a885da4b35948b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.217385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca628e4-552b-40d9-b1ef-fa56c2848bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=541b60af772c4cefb8a885da4b35948b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:43.219484 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca628e4-552b-40d9-b1ef-fa56c2848bf2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:43.221325 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1081/2158] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:43.225561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfa10d-86bc-4215-964b-f42cc80f271c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:43.235959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfa10d-86bc-4215-964b-f42cc80f271c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:43.241591 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19286d2-0100-47ca-b523-c8c77f3da0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:43.242328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19286d2-0100-47ca-b523-c8c77f3da0fd admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.242619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19286d2-0100-47ca-b523-c8c77f3da0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.242903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19286d2-0100-47ca-b523-c8c77f3da0fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.243643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19286d2-0100-47ca-b523-c8c77f3da0fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:43.243954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19286d2-0100-47ca-b523-c8c77f3da0fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:43.245603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19286d2-0100-47ca-b523-c8c77f3da0fd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:43.258875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1082/2159] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:24:43.263150 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19286d2-0100-47ca-b523-c8c77f3da0fd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:43.273592 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19286d2-0100-47ca-b523-c8c77f3da0fd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:43.275534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2ca628e4-552b-40d9-b1ef-fa56c2848bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '541b60af772c4cefb8a885da4b35948b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:43.278590 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8f527-4ecb-495d-9c97-fee0600e3734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:43.279412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8f527-4ecb-495d-9c97-fee0600e3734 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.279851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8f527-4ecb-495d-9c97-fee0600e3734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.279993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8f527-4ecb-495d-9c97-fee0600e3734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.280794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8f527-4ecb-495d-9c97-fee0600e3734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:43.283296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8f527-4ecb-495d-9c97-fee0600e3734 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:43.289135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2ca628e4-552b-40d9-b1ef-fa56c2848bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '541b60af772c4cefb8a885da4b35948b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:43.291886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:43.298618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2ca628e4-552b-40d9-b1ef-fa56c2848bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '541b60af772c4cefb8a885da4b35948b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:43.299551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2ca628e4-552b-40d9-b1ef-fa56c2848bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '541b60af772c4cefb8a885da4b35948b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:43.309188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2ca628e4-552b-40d9-b1ef-fa56c2848bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '541b60af772c4cefb8a885da4b35948b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:43.309673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1083/2160] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:43 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:43.313738 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8f527-4ecb-495d-9c97-fee0600e3734 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:43.315903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-61b8f527-4ecb-495d-9c97-fee0600e3734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:43.318839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1078/2161] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:43 2022] DELETE /identity/v3/users/541b60af772c4cefb8a885da4b35948b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:43.323204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef974f-e4d9-4820-aad2-ac02d766b24b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.323496 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef974f-e4d9-4820-aad2-ac02d766b24b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.323808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef974f-e4d9-4820-aad2-ac02d766b24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.341047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-10ef974f-e4d9-4820-aad2-ac02d766b24b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:43.342181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-10ef974f-e4d9-4820-aad2-ac02d766b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:43.382285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8f527-4ecb-495d-9c97-fee0600e3734 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:43.404008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1079/2162] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:43.415935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef974f-e4d9-4820-aad2-ac02d766b24b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:43.417578 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-10ef974f-e4d9-4820-aad2-ac02d766b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:43.433376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:43.456474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42332a97-d368-413e-94d9-2d2c96f410d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:43.457163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332a97-d368-413e-94d9-2d2c96f410d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.457451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332a97-d368-413e-94d9-2d2c96f410d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.457733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332a97-d368-413e-94d9-2d2c96f410d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.458431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42332a97-d368-413e-94d9-2d2c96f410d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:43.460452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42332a97-d368-413e-94d9-2d2c96f410d9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:43.488382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1084/2163] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:43 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:43.491953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42332a97-d368-413e-94d9-2d2c96f410d9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:43.501036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef974f-e4d9-4820-aad2-ac02d766b24b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:43.503739 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42332a97-d368-413e-94d9-2d2c96f410d9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:43.505131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c275fa-153f-46a5-a0c9-4d3f5d113a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:43.505960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c275fa-153f-46a5-a0c9-4d3f5d113a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.506372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c275fa-153f-46a5-a0c9-4d3f5d113a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.506699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c275fa-153f-46a5-a0c9-4d3f5d113a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.509207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadc289-0c28-4a0f-9285-3f380aad8979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:43.509989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc289-0c28-4a0f-9285-3f380aad8979 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.510424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc289-0c28-4a0f-9285-3f380aad8979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.510805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc289-0c28-4a0f-9285-3f380aad8979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.511620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadc289-0c28-4a0f-9285-3f380aad8979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:43.513510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadc289-0c28-4a0f-9285-3f380aad8979 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:43.517966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c275fa-153f-46a5-a0c9-4d3f5d113a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:43.519799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c275fa-153f-46a5-a0c9-4d3f5d113a86 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:43.529337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1085/2164] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:43.530535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadc289-0c28-4a0f-9285-3f380aad8979 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:43.537275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1080/2165] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:43.542335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadc289-0c28-4a0f-9285-3f380aad8979 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:43.549836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e890711-1353-4995-af5b-8e9fbe210a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:43.550574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e890711-1353-4995-af5b-8e9fbe210a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.550864 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e890711-1353-4995-af5b-8e9fbe210a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.551171 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e890711-1353-4995-af5b-8e9fbe210a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.551916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e890711-1353-4995-af5b-8e9fbe210a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:43.553583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e890711-1353-4995-af5b-8e9fbe210a7e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:43.568776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1086/2166] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:43.572946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c275fa-153f-46a5-a0c9-4d3f5d113a86 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:43.587239 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c275fa-153f-46a5-a0c9-4d3f5d113a86 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:43.595904 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d99520-9978-4e72-af17-7a7e928e3bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:43.596761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99520-9978-4e72-af17-7a7e928e3bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.597046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99520-9978-4e72-af17-7a7e928e3bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.597324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99520-9978-4e72-af17-7a7e928e3bd9 admin admin] PATH_INFO: `/v3/projects/445d4c798d6540dfb51cd54e702bf4a9/users/fd041e076f5046a9aa9e5e69fe8911f8/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.616885 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d99520-9978-4e72-af17-7a7e928e3bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445d4c798d6540dfb51cd54e702bf4a9, user_id=fd041e076f5046a9aa9e5e69fe8911f8, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:43.619699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d99520-9978-4e72-af17-7a7e928e3bd9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:43.641908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1081/2167] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:43 2022] PUT /identity/v3/projects/445d4c798d6540dfb51cd54e702bf4a9/users/fd041e076f5046a9aa9e5e69fe8911f8/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:43.653236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65812-14cd-467e-812c-b578912aa108 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.653937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65812-14cd-467e-812c-b578912aa108 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.654318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65812-14cd-467e-812c-b578912aa108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.692492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-83d65812-14cd-467e-812c-b578912aa108 None None] MFA Rules not processed for user `fd041e076f5046a9aa9e5e69fe8911f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:43.693885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-83d65812-14cd-467e-812c-b578912aa108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:43.798919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1087/2168] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:43.803656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d99520-9978-4e72-af17-7a7e928e3bd9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:43.911464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d99520-9978-4e72-af17-7a7e928e3bd9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:43.916702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da3774-3014-4e72-8afd-fddcc90ceb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:43.917534 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da3774-3014-4e72-8afd-fddcc90ceb83 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:43.917877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da3774-3014-4e72-8afd-fddcc90ceb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:43.918182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da3774-3014-4e72-8afd-fddcc90ceb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:43.918900 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da3774-3014-4e72-8afd-fddcc90ceb83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:43.920943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da3774-3014-4e72-8afd-fddcc90ceb83 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:43.933302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65812-14cd-467e-812c-b578912aa108 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:43.933686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:43.934965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-83d65812-14cd-467e-812c-b578912aa108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:43.958680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65812-14cd-467e-812c-b578912aa108 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:43.961639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1082/2169] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:43 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:43.962561 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da3774-3014-4e72-8afd-fddcc90ceb83 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.028826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.029937 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.030402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.030650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] PATH_INFO: `/v3/projects/dbdd6e3916264da1b8ddf74eb76ab9e3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.032066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbdd6e3916264da1b8ddf74eb76ab9e3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.034189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.046194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da3774-3014-4e72-8afd-fddcc90ceb83 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.052547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f7786-287d-4dde-9e06-a19504edcfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.053513 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f7786-287d-4dde-9e06-a19504edcfcc admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.053799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f7786-287d-4dde-9e06-a19504edcfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.054103 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f7786-287d-4dde-9e06-a19504edcfcc admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.054812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f7786-287d-4dde-9e06-a19504edcfcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.060262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f7786-287d-4dde-9e06-a19504edcfcc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.092222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1083/2170] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:43 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:44.096524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f7786-287d-4dde-9e06-a19504edcfcc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.098665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:44.106617 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbdd6e3916264da1b8ddf74eb76ab9e3', 'request_id': 'req-a2a6f6a2-7d92-4978-880e-9fc58e059525'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:44.114451 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f7786-287d-4dde-9e06-a19504edcfcc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.116999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbdd6e3916264da1b8ddf74eb76ab9e3', 'request_id': 'req-a2a6f6a2-7d92-4978-880e-9fc58e059525'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:44.125338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbdd6e3916264da1b8ddf74eb76ab9e3', 'request_id': 'req-a2a6f6a2-7d92-4978-880e-9fc58e059525'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:44.141776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] The token cache is being invalidate because project dbdd6e3916264da1b8ddf74eb76ab9e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:44.142123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:44.143026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a6f6a2-7d92-4978-880e-9fc58e059525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:44.148856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1088/2171] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:43 2022] DELETE /identity/v3/projects/dbdd6e3916264da1b8ddf74eb76ab9e3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:44.151455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22482c-c831-4851-8eb1-3d55cd2490fa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.151975 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22482c-c831-4851-8eb1-3d55cd2490fa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.152370 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22482c-c831-4851-8eb1-3d55cd2490fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.184990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fb22482c-c831-4851-8eb1-3d55cd2490fa None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:44.187261 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fb22482c-c831-4851-8eb1-3d55cd2490fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:44.193909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a245d87-7e81-4841-8b14-caf704665119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.195019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a245d87-7e81-4841-8b14-caf704665119 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.195384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a245d87-7e81-4841-8b14-caf704665119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.196208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a245d87-7e81-4841-8b14-caf704665119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.197057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a245d87-7e81-4841-8b14-caf704665119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.207013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1089/2172] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:44.207314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a245d87-7e81-4841-8b14-caf704665119 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.213347 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1084/2173] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:44.217494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f2ec-0d8a-49f2-ac3f-a649e0bfd4f7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.218166 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a245d87-7e81-4841-8b14-caf704665119 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.218292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f2ec-0d8a-49f2-ac3f-a649e0bfd4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.218483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f2ec-0d8a-49f2-ac3f-a649e0bfd4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.220135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5a245d87-7e81-4841-8b14-caf704665119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:44.239057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a245d87-7e81-4841-8b14-caf704665119 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.239603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-81c2f2ec-0d8a-49f2-ac3f-a649e0bfd4f7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:44.240796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-81c2f2ec-0d8a-49f2-ac3f-a649e0bfd4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:44.246185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb75c8-8e5a-415e-852e-8a29f6789f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.247089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb75c8-8e5a-415e-852e-8a29f6789f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.247378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb75c8-8e5a-415e-852e-8a29f6789f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.247688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb75c8-8e5a-415e-852e-8a29f6789f4d admin admin] PATH_INFO: `/v3/projects/be03a4d36d52483a9de269142bbd156b/users/7d8d28a4a38a4784ae740e818c057c58/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.251282 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1090/2174] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:44.255240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2f2ec-0d8a-49f2-ac3f-a649e0bfd4f7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.264619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2f2ec-0d8a-49f2-ac3f-a649e0bfd4f7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.267436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb75c8-8e5a-415e-852e-8a29f6789f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be03a4d36d52483a9de269142bbd156b, user_id=7d8d28a4a38a4784ae740e818c057c58, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.270157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb75c8-8e5a-415e-852e-8a29f6789f4d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.270273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5d9de-d868-411d-be2a-a416a5acd416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.270993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5d9de-d868-411d-be2a-a416a5acd416 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.271344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5d9de-d868-411d-be2a-a416a5acd416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.271740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5d9de-d868-411d-be2a-a416a5acd416 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.272570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5d9de-d868-411d-be2a-a416a5acd416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:44.273050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5d9de-d868-411d-be2a-a416a5acd416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.274733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5d9de-d868-411d-be2a-a416a5acd416 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.287933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1091/2176] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:24:44.292136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1085/2176] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:44 2022] PUT /identity/v3/projects/be03a4d36d52483a9de269142bbd156b/users/7d8d28a4a38a4784ae740e818c057c58/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:44.292271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5d9de-d868-411d-be2a-a416a5acd416 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.293619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb75c8-8e5a-415e-852e-8a29f6789f4d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.306123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5d9de-d868-411d-be2a-a416a5acd416 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.358870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:44.371500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb75c8-8e5a-415e-852e-8a29f6789f4d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.377419 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12e0fe-7fdd-4b73-9337-df53cd44e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.378080 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12e0fe-7fdd-4b73-9337-df53cd44e619 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.378370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12e0fe-7fdd-4b73-9337-df53cd44e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.378652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12e0fe-7fdd-4b73-9337-df53cd44e619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.379352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12e0fe-7fdd-4b73-9337-df53cd44e619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.379991 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a7087-b9bc-41b8-8b2e-36ac96c0a326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.380864 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7087-b9bc-41b8-8b2e-36ac96c0a326 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.381236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7087-b9bc-41b8-8b2e-36ac96c0a326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.381328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12e0fe-7fdd-4b73-9337-df53cd44e619 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.381625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7087-b9bc-41b8-8b2e-36ac96c0a326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.382432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a7087-b9bc-41b8-8b2e-36ac96c0a326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.384239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a7087-b9bc-41b8-8b2e-36ac96c0a326 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.398493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1092/2177] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:44.399677 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a7087-b9bc-41b8-8b2e-36ac96c0a326 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.414884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1086/2178] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:44 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:44.414884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12e0fe-7fdd-4b73-9337-df53cd44e619 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.415393 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a7087-b9bc-41b8-8b2e-36ac96c0a326 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.481313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48626e4f-d46b-497f-b73d-b2a9369e1da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.481738 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626e4f-d46b-497f-b73d-b2a9369e1da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.482023 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626e4f-d46b-497f-b73d-b2a9369e1da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.482308 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626e4f-d46b-497f-b73d-b2a9369e1da8 admin admin] PATH_INFO: `/v3/projects/be03a4d36d52483a9de269142bbd156b/users/7d8d28a4a38a4784ae740e818c057c58/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.484323 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48626e4f-d46b-497f-b73d-b2a9369e1da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be03a4d36d52483a9de269142bbd156b, user_id=7d8d28a4a38a4784ae740e818c057c58, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.484585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12e0fe-7fdd-4b73-9337-df53cd44e619 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.487206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48626e4f-d46b-497f-b73d-b2a9369e1da8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.489318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef0794-d333-406c-97bf-2cd532947902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.489984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef0794-d333-406c-97bf-2cd532947902 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.490269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef0794-d333-406c-97bf-2cd532947902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.490551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef0794-d333-406c-97bf-2cd532947902 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.491243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef0794-d333-406c-97bf-2cd532947902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.493200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef0794-d333-406c-97bf-2cd532947902 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.498541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1093/2179] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:44 2022] PUT /identity/v3/projects/be03a4d36d52483a9de269142bbd156b/users/7d8d28a4a38a4784ae740e818c057c58/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:44.511988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8446e-d4d5-4e1b-a035-221734d33f49 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.512446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8446e-d4d5-4e1b-a035-221734d33f49 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.512799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8446e-d4d5-4e1b-a035-221734d33f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.514652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1087/2180] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:44 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:44.519223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef0794-d333-406c-97bf-2cd532947902 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.531991 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef0794-d333-406c-97bf-2cd532947902 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.542673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b1f8446e-d4d5-4e1b-a035-221734d33f49 None None] MFA Rules not processed for user `7d8d28a4a38a4784ae740e818c057c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:44.544062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b1f8446e-d4d5-4e1b-a035-221734d33f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:44.567795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:44.602488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2349871-ce97-45f1-af40-1bd7a5f34b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.603279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2349871-ce97-45f1-af40-1bd7a5f34b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.603662 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2349871-ce97-45f1-af40-1bd7a5f34b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.604010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2349871-ce97-45f1-af40-1bd7a5f34b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.604858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2349871-ce97-45f1-af40-1bd7a5f34b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.606604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2349871-ce97-45f1-af40-1bd7a5f34b40 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.619060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1088/2181] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:44.623583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2349871-ce97-45f1-af40-1bd7a5f34b40 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.631376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1094/2182] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:44.634605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2349871-ce97-45f1-af40-1bd7a5f34b40 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.640268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acfdd0-ffb3-4a8e-8d1d-b9595129146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.641372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acfdd0-ffb3-4a8e-8d1d-b9595129146c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.641756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acfdd0-ffb3-4a8e-8d1d-b9595129146c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.642266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acfdd0-ffb3-4a8e-8d1d-b9595129146c admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.643103 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acfdd0-ffb3-4a8e-8d1d-b9595129146c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.643240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8446e-d4d5-4e1b-a035-221734d33f49 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.644897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b1f8446e-d4d5-4e1b-a035-221734d33f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:44.645032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acfdd0-ffb3-4a8e-8d1d-b9595129146c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.656598 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1089/2183] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:44.661003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acfdd0-ffb3-4a8e-8d1d-b9595129146c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.671654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acfdd0-ffb3-4a8e-8d1d-b9595129146c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.679170 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f73c9-8b23-4790-a34c-07b9fa199d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.679446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f73c9-8b23-4790-a34c-07b9fa199d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.679730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f73c9-8b23-4790-a34c-07b9fa199d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.680009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f73c9-8b23-4790-a34c-07b9fa199d42 admin admin] PATH_INFO: `/v3/projects/85dc04b20ddc4d43b2fed3fd057ad351/users/2e95d22987c0471ba3007d00075850c4/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.703414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f73c9-8b23-4790-a34c-07b9fa199d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85dc04b20ddc4d43b2fed3fd057ad351, user_id=2e95d22987c0471ba3007d00075850c4, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.707275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f73c9-8b23-4790-a34c-07b9fa199d42 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.715101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8446e-d4d5-4e1b-a035-221734d33f49 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.719887 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac2db2-e1d7-46d1-8494-480b66e25477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.720691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2db2-e1d7-46d1-8494-480b66e25477 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.720984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2db2-e1d7-46d1-8494-480b66e25477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.721329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2db2-e1d7-46d1-8494-480b66e25477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.730608 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1090/2184] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:44 2022] PUT /identity/v3/projects/85dc04b20ddc4d43b2fed3fd057ad351/users/2e95d22987c0471ba3007d00075850c4/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:44.732405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac2db2-e1d7-46d1-8494-480b66e25477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.733884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac2db2-e1d7-46d1-8494-480b66e25477 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.735755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e6b1-624f-4a59-9f2e-bcff667080c1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.736075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e6b1-624f-4a59-9f2e-bcff667080c1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.736361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9e6b1-624f-4a59-9f2e-bcff667080c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.744348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1095/2185] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:44.755377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5cd9e6b1-624f-4a59-9f2e-bcff667080c1 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:44.756956 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5cd9e6b1-624f-4a59-9f2e-bcff667080c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:44.780650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:44.789054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac2db2-e1d7-46d1-8494-480b66e25477 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.790449 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ddac2db2-e1d7-46d1-8494-480b66e25477 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:44.804414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac2db2-e1d7-46d1-8494-480b66e25477 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.826216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1091/2186] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:44.836114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e6b1-624f-4a59-9f2e-bcff667080c1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.840749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5cd9e6b1-624f-4a59-9f2e-bcff667080c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:44.882508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90356c-b846-4512-9e4d-204231f32201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.883134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90356c-b846-4512-9e4d-204231f32201 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.883451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90356c-b846-4512-9e4d-204231f32201 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.883732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90356c-b846-4512-9e4d-204231f32201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.885834 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7e90356c-b846-4512-9e4d-204231f32201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:44.903992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9e6b1-624f-4a59-9f2e-bcff667080c1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.907961 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2aa8-b23d-49d9-983d-12f97b7cfd5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.908663 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2aa8-b23d-49d9-983d-12f97b7cfd5d service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.908916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2aa8-b23d-49d9-983d-12f97b7cfd5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.910721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2aa8-b23d-49d9-983d-12f97b7cfd5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.920493 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c2aa8-b23d-49d9-983d-12f97b7cfd5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.923112 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c2aa8-b23d-49d9-983d-12f97b7cfd5d service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.935073 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1092/2187] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:44.937418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2aa8-b23d-49d9-983d-12f97b7cfd5d service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:44.939089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4b6c2aa8-b23d-49d9-983d-12f97b7cfd5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:44.956512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2aa8-b23d-49d9-983d-12f97b7cfd5d service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:44.967181 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90356c-b846-4512-9e4d-204231f32201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.969063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90356c-b846-4512-9e4d-204231f32201 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:44.975225 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:44.976439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:44.976729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:44.977002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] PATH_INFO: `/v3/users/c43de58b61f748d3bacccc0d78498ab9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:44.978649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43de58b61f748d3bacccc0d78498ab9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:44.979923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1096/2188] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:44.980745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:45.046103 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43de58b61f748d3bacccc0d78498ab9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:45.063634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43de58b61f748d3bacccc0d78498ab9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:45.073665 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43de58b61f748d3bacccc0d78498ab9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:45.074434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43de58b61f748d3bacccc0d78498ab9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:45.083506 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43de58b61f748d3bacccc0d78498ab9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:45.090305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1093/2189] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:44 2022] DELETE /identity/v3/users/c43de58b61f748d3bacccc0d78498ab9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:45.094762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f4c3-d454-4cde-9003-584b4ff9d98a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:45.095061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f4c3-d454-4cde-9003-584b4ff9d98a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:45.095352 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f4c3-d454-4cde-9003-584b4ff9d98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:45.117116 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-68e3f4c3-d454-4cde-9003-584b4ff9d98a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:45.120119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-68e3f4c3-d454-4cde-9003-584b4ff9d98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:45.134505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:45.203984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1097/2190] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:45.215627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:45.217380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:45.286742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:45.304394 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd39a0-ee11-4b3c-9365-cd76336a909f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:45.310186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94313147-1636-4615-9e0c-0b9d4186ac41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:45.311116 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94313147-1636-4615-9e0c-0b9d4186ac41 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:45.311620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94313147-1636-4615-9e0c-0b9d4186ac41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:45.312057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94313147-1636-4615-9e0c-0b9d4186ac41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:45.330413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94313147-1636-4615-9e0c-0b9d4186ac41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:45.332174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94313147-1636-4615-9e0c-0b9d4186ac41 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:45.354189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1094/2191] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:45.792172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3f4c3-d454-4cde-9003-584b4ff9d98a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:45.793748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-68e3f4c3-d454-4cde-9003-584b4ff9d98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:45.811678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3f4c3-d454-4cde-9003-584b4ff9d98a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:45.815627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:45.816657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:45.816940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:45.817241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] PATH_INFO: `/v3/projects/33437b9853ac4280967deddfac95e51c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:45.818560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33437b9853ac4280967deddfac95e51c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:45.820649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:45.923031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33437b9853ac4280967deddfac95e51c', 'request_id': 'req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:45.931305 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33437b9853ac4280967deddfac95e51c', 'request_id': 'req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:45.940763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33437b9853ac4280967deddfac95e51c', 'request_id': 'req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:45.957045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] The token cache is being invalidate because project 33437b9853ac4280967deddfac95e51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:45.957593 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:45.959332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d8fa514-0e60-4ad1-a070-eb915a4a3c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:45.961251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1098/2192] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:45 2022] DELETE /identity/v3/projects/33437b9853ac4280967deddfac95e51c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:45.966435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001fd69-95d3-4d5a-aef7-9a881686e053 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:45.966947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001fd69-95d3-4d5a-aef7-9a881686e053 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:45.967619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001fd69-95d3-4d5a-aef7-9a881686e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:45.990828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2001fd69-95d3-4d5a-aef7-9a881686e053 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:45.993029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2001fd69-95d3-4d5a-aef7-9a881686e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:46.078105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1095/2193] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:46.080519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd7cc-0edd-49d3-9e52-b1b613996b08 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:46.081185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd7cc-0edd-49d3-9e52-b1b613996b08 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:46.081185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd7cc-0edd-49d3-9e52-b1b613996b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:46.115118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-eabbd7cc-0edd-49d3-9e52-b1b613996b08 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:46.116375 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eabbd7cc-0edd-49d3-9e52-b1b613996b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:46.128649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1099/2194] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:46.130850 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001fd69-95d3-4d5a-aef7-9a881686e053 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:46.148142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001fd69-95d3-4d5a-aef7-9a881686e053 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:46.154968 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cd0ba-3423-4dcd-bcb6-db85cb0beb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:46.155981 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd0ba-3423-4dcd-bcb6-db85cb0beb34 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:46.157181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd0ba-3423-4dcd-bcb6-db85cb0beb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:46.157724 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd0ba-3423-4dcd-bcb6-db85cb0beb34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:46.158746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cd0ba-3423-4dcd-bcb6-db85cb0beb34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:46.159683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cd0ba-3423-4dcd-bcb6-db85cb0beb34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:46.162667 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cd0ba-3423-4dcd-bcb6-db85cb0beb34 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:46.200253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1096/2195] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:46.201742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbd7cc-0edd-49d3-9e52-b1b613996b08 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:46.214420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbd7cc-0edd-49d3-9e52-b1b613996b08 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:46.219368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155f794-9cb9-43df-9c78-6015c1d4a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:46.220057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155f794-9cb9-43df-9c78-6015c1d4a2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:46.220364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155f794-9cb9-43df-9c78-6015c1d4a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:46.220671 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155f794-9cb9-43df-9c78-6015c1d4a2d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:46.221598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155f794-9cb9-43df-9c78-6015c1d4a2d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:46.226134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155f794-9cb9-43df-9c78-6015c1d4a2d5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:46.297127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cd0ba-3423-4dcd-bcb6-db85cb0beb34 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:46.298158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1100/2196] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:46 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:46.316313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cd0ba-3423-4dcd-bcb6-db85cb0beb34 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:46.413279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfca41-183c-4f76-a5f7-ac1e4d7e537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:46.414356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfca41-183c-4f76-a5f7-ac1e4d7e537e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:46.414883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfca41-183c-4f76-a5f7-ac1e4d7e537e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:46.415324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfca41-183c-4f76-a5f7-ac1e4d7e537e admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:46.416220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfca41-183c-4f76-a5f7-ac1e4d7e537e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:46.418277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfca41-183c-4f76-a5f7-ac1e4d7e537e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:46.467527 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1097/2197] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:46 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:46.469108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155f794-9cb9-43df-9c78-6015c1d4a2d5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:46.486663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155f794-9cb9-43df-9c78-6015c1d4a2d5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:46.492395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a97820-2c3d-469e-a8a0-2c30f32123f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:46.493408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a97820-2c3d-469e-a8a0-2c30f32123f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:46.493947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a97820-2c3d-469e-a8a0-2c30f32123f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:46.494433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a97820-2c3d-469e-a8a0-2c30f32123f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:46.495385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a97820-2c3d-469e-a8a0-2c30f32123f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:46.498178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a97820-2c3d-469e-a8a0-2c30f32123f5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:46.517121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1101/2198] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:46.528810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfca41-183c-4f76-a5f7-ac1e4d7e537e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:46.542172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfca41-183c-4f76-a5f7-ac1e4d7e537e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:46.554638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd57be-4782-449a-94dc-82fd7a655551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:46.555447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd57be-4782-449a-94dc-82fd7a655551 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:46.556413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd57be-4782-449a-94dc-82fd7a655551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:46.557475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd57be-4782-449a-94dc-82fd7a655551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:46.558819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd57be-4782-449a-94dc-82fd7a655551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:46.560819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd57be-4782-449a-94dc-82fd7a655551 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:46.573825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1098/2199] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:46.577905 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a97820-2c3d-469e-a8a0-2c30f32123f5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:46.598527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a97820-2c3d-469e-a8a0-2c30f32123f5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:46.604606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fdcf0-c20f-4cec-b50e-a03ccd781018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:46.605843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fdcf0-c20f-4cec-b50e-a03ccd781018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:46.608158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fdcf0-c20f-4cec-b50e-a03ccd781018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:46.608158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fdcf0-c20f-4cec-b50e-a03ccd781018 admin admin] PATH_INFO: `/v3/projects/47429d6653954fe7b1c28300e69847ff/users/30ed8621f537473db6c828bb771c79a5/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:46.627521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fdcf0-c20f-4cec-b50e-a03ccd781018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47429d6653954fe7b1c28300e69847ff, user_id=30ed8621f537473db6c828bb771c79a5, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:46.631197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fdcf0-c20f-4cec-b50e-a03ccd781018 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:46.663352 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1102/2200] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:46 2022] PUT /identity/v3/projects/47429d6653954fe7b1c28300e69847ff/users/30ed8621f537473db6c828bb771c79a5/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:46.678762 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b653d3-3ff9-4806-9348-db02fa87d986 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:46.680338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b653d3-3ff9-4806-9348-db02fa87d986 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:46.680989 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b653d3-3ff9-4806-9348-db02fa87d986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:46.716638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-71b653d3-3ff9-4806-9348-db02fa87d986 None None] MFA Rules not processed for user `30ed8621f537473db6c828bb771c79a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:46.718130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-71b653d3-3ff9-4806-9348-db02fa87d986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:46.838176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:46.872830 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1099/2201] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:46.873681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fdcf0-c20f-4cec-b50e-a03ccd781018 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:46.975741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:47.038501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fdcf0-c20f-4cec-b50e-a03ccd781018 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:47.044445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0272-ccd1-4546-86e4-98d3a53af7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:47.045568 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0272-ccd1-4546-86e4-98d3a53af7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:47.046248 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0272-ccd1-4546-86e4-98d3a53af7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:47.046769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d0272-ccd1-4546-86e4-98d3a53af7b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:47.049018 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d0272-ccd1-4546-86e4-98d3a53af7b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:47.054241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d0272-ccd1-4546-86e4-98d3a53af7b9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:47.102753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1103/2202] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:46 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:47.108364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b653d3-3ff9-4806-9348-db02fa87d986 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:47.145841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b653d3-3ff9-4806-9348-db02fa87d986 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:47.324396 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469183cc-afc2-4592-9f06-27bf67fd9526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:47.325452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469183cc-afc2-4592-9f06-27bf67fd9526 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:47.325839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469183cc-afc2-4592-9f06-27bf67fd9526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:47.326222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469183cc-afc2-4592-9f06-27bf67fd9526 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:47.327104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469183cc-afc2-4592-9f06-27bf67fd9526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:47.330531 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469183cc-afc2-4592-9f06-27bf67fd9526 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:47.361281 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1100/2203] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:47 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:47.365935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0272-ccd1-4546-86e4-98d3a53af7b9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:47.378981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d0272-ccd1-4546-86e4-98d3a53af7b9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:47.384710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2f60f-4485-4ba1-9f6e-c27f57f5d902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:47.385863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2f60f-4485-4ba1-9f6e-c27f57f5d902 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:47.386391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2f60f-4485-4ba1-9f6e-c27f57f5d902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:47.386750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2f60f-4485-4ba1-9f6e-c27f57f5d902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:47.387637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2f60f-4485-4ba1-9f6e-c27f57f5d902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:47.389403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2f60f-4485-4ba1-9f6e-c27f57f5d902 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:47.408690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1104/2204] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:47.413794 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469183cc-afc2-4592-9f06-27bf67fd9526 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:47.430659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469183cc-afc2-4592-9f06-27bf67fd9526 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:47.439770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2e472-17aa-4d7f-a2d5-87a4d8bb4f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:47.441543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e472-17aa-4d7f-a2d5-87a4d8bb4f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:47.441889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e472-17aa-4d7f-a2d5-87a4d8bb4f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:47.442232 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2e472-17aa-4d7f-a2d5-87a4d8bb4f65 admin admin] PATH_INFO: `/v3/projects/26f4d8c8ec5a454783bbb1d37cc17d74/users/d33c28c94c6d43a48fc79cb5a3004e28/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:47.461306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2e472-17aa-4d7f-a2d5-87a4d8bb4f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f4d8c8ec5a454783bbb1d37cc17d74, user_id=d33c28c94c6d43a48fc79cb5a3004e28, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:47.464052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2e472-17aa-4d7f-a2d5-87a4d8bb4f65 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:47.478754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1101/2205] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:47 2022] PUT /identity/v3/projects/26f4d8c8ec5a454783bbb1d37cc17d74/users/d33c28c94c6d43a48fc79cb5a3004e28/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:47.482602 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2f60f-4485-4ba1-9f6e-c27f57f5d902 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:47.493894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2f60f-4485-4ba1-9f6e-c27f57f5d902 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:47.563859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e6c35-5afd-497e-9b90-99027cd42ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:47.564165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e6c35-5afd-497e-9b90-99027cd42ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:47.564667 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e6c35-5afd-497e-9b90-99027cd42ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:47.564956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e6c35-5afd-497e-9b90-99027cd42ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:47.565700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e6c35-5afd-497e-9b90-99027cd42ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:47.567331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e6c35-5afd-497e-9b90-99027cd42ee5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:47.578318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1105/2206] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:47.582956 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2e472-17aa-4d7f-a2d5-87a4d8bb4f65 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:47.593381 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2e472-17aa-4d7f-a2d5-87a4d8bb4f65 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:47.598214 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda712-5281-4168-a75f-eb9b0744d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:47.599111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda712-5281-4168-a75f-eb9b0744d745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:47.599404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda712-5281-4168-a75f-eb9b0744d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:47.599683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda712-5281-4168-a75f-eb9b0744d745 admin admin] PATH_INFO: `/v3/projects/26f4d8c8ec5a454783bbb1d37cc17d74/users/d33c28c94c6d43a48fc79cb5a3004e28/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:47.602272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cda712-5281-4168-a75f-eb9b0744d745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f4d8c8ec5a454783bbb1d37cc17d74, user_id=d33c28c94c6d43a48fc79cb5a3004e28, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:47.605597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cda712-5281-4168-a75f-eb9b0744d745 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:47.620266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1102/2207] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:47 2022] PUT /identity/v3/projects/26f4d8c8ec5a454783bbb1d37cc17d74/users/d33c28c94c6d43a48fc79cb5a3004e28/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:47.629359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1eec7-a98e-4957-8c45-24758c448271 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:47.629657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1eec7-a98e-4957-8c45-24758c448271 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:47.629943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1eec7-a98e-4957-8c45-24758c448271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:47.661771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d8b1eec7-a98e-4957-8c45-24758c448271 None None] MFA Rules not processed for user `d33c28c94c6d43a48fc79cb5a3004e28`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:47.663118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d8b1eec7-a98e-4957-8c45-24758c448271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:47.735840 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1106/2208] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:47.749773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda712-5281-4168-a75f-eb9b0744d745 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:47.752193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-21cda712-5281-4168-a75f-eb9b0744d745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:47.837075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda712-5281-4168-a75f-eb9b0744d745 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:47.841362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e9309-5c8e-4694-8c96-92f2faf6b8c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:47.841916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e9309-5c8e-4694-8c96-92f2faf6b8c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:47.842203 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e9309-5c8e-4694-8c96-92f2faf6b8c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:47.842480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e9309-5c8e-4694-8c96-92f2faf6b8c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:47.908522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:47.920812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e9309-5c8e-4694-8c96-92f2faf6b8c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:47.922976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e9309-5c8e-4694-8c96-92f2faf6b8c8 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:47.941603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1103/2209] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:49.314470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1eec7-a98e-4957-8c45-24758c448271 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:49.317319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d8b1eec7-a98e-4957-8c45-24758c448271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:49.387122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:49.445984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1eec7-a98e-4957-8c45-24758c448271 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:49.472640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:49.473624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:49.475245 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:49.476298 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] PATH_INFO: `/v3/users/fd041e076f5046a9aa9e5e69fe8911f8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:49.479724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd041e076f5046a9aa9e5e69fe8911f8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:49.486330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:49.615175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd041e076f5046a9aa9e5e69fe8911f8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:49.643940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd041e076f5046a9aa9e5e69fe8911f8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:49.660129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd041e076f5046a9aa9e5e69fe8911f8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:49.660925 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd041e076f5046a9aa9e5e69fe8911f8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:49.671387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd041e076f5046a9aa9e5e69fe8911f8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:49.706376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1107/2210] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:49 2022] DELETE /identity/v3/users/fd041e076f5046a9aa9e5e69fe8911f8 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:49.710976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1a727-299b-48d0-b02b-92483c3722d2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:49.711461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1a727-299b-48d0-b02b-92483c3722d2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:49.711552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1a727-299b-48d0-b02b-92483c3722d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:49.750780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a0d1a727-299b-48d0-b02b-92483c3722d2 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:49.750780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a0d1a727-299b-48d0-b02b-92483c3722d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:49.899219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1104/2211] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:49.909806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:49.911650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:49.991929 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8727e18-ed76-451e-8f81-a1a865b6f78d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:49.996414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb2365-2608-467b-a17d-2da9acd773bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:49.997690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2365-2608-467b-a17d-2da9acd773bc service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:49.997690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2365-2608-467b-a17d-2da9acd773bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:49.997690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2365-2608-467b-a17d-2da9acd773bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:50.010977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb2365-2608-467b-a17d-2da9acd773bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:50.012517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb2365-2608-467b-a17d-2da9acd773bc service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:50.024418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1108/2212] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:50.645888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1a727-299b-48d0-b02b-92483c3722d2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:50.648272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a0d1a727-299b-48d0-b02b-92483c3722d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:50.683497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1a727-299b-48d0-b02b-92483c3722d2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:50.689382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:50.691498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:50.691786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:50.692097 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] PATH_INFO: `/v3/projects/445d4c798d6540dfb51cd54e702bf4a9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:50.694171 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=445d4c798d6540dfb51cd54e702bf4a9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:50.701624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:50.715010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7f47b-c113-4000-9981-9ee925fa4d4b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:50.715951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7f47b-c113-4000-9981-9ee925fa4d4b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:50.716397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7f47b-c113-4000-9981-9ee925fa4d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:50.799371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1cc7f47b-c113-4000-9981-9ee925fa4d4b None None] MFA Rules not processed for user `2e95d22987c0471ba3007d00075850c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:50.800643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1cc7f47b-c113-4000-9981-9ee925fa4d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:50.810280 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445d4c798d6540dfb51cd54e702bf4a9', 'request_id': 'req-c61a49b8-2343-47e9-9a73-2346eeee2982'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:50.827618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445d4c798d6540dfb51cd54e702bf4a9', 'request_id': 'req-c61a49b8-2343-47e9-9a73-2346eeee2982'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:50.841602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445d4c798d6540dfb51cd54e702bf4a9', 'request_id': 'req-c61a49b8-2343-47e9-9a73-2346eeee2982'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:50.861521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] The token cache is being invalidate because project 445d4c798d6540dfb51cd54e702bf4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:50.862061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:50.863056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:50.865570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1105/2213] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:50 2022] DELETE /identity/v3/projects/445d4c798d6540dfb51cd54e702bf4a9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:50.868240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:50.869516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:50.871193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:50.921027 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1109/2214] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:50.922635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7f47b-c113-4000-9981-9ee925fa4d4b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:50.924448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1cc7f47b-c113-4000-9981-9ee925fa4d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:50.968263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a49b8-2343-47e9-9a73-2346eeee2982 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:50.984136 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:50.986153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:50.986618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:50.987686 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] PATH_INFO: `/v3/users/7d8d28a4a38a4784ae740e818c057c58` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:50.990122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8d28a4a38a4784ae740e818c057c58)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:50.992317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:51.012774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:51.037841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7f47b-c113-4000-9981-9ee925fa4d4b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:51.045069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48bebb-bad8-4a2f-bf75-f39450afb083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:51.046563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48bebb-bad8-4a2f-bf75-f39450afb083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:51.046930 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48bebb-bad8-4a2f-bf75-f39450afb083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:51.050669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48bebb-bad8-4a2f-bf75-f39450afb083 admin admin] PATH_INFO: `/v3/users/30ed8621f537473db6c828bb771c79a5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:51.050669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48bebb-bad8-4a2f-bf75-f39450afb083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ed8621f537473db6c828bb771c79a5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:51.051735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48bebb-bad8-4a2f-bf75-f39450afb083 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:51.062879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8d28a4a38a4784ae740e818c057c58'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.078821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8d28a4a38a4784ae740e818c057c58'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.090308 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8d28a4a38a4784ae740e818c057c58'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.091813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8d28a4a38a4784ae740e818c057c58'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.105036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8d28a4a38a4784ae740e818c057c58'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.113003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1106/2215] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:50 2022] DELETE /identity/v3/users/7d8d28a4a38a4784ae740e818c057c58 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:51.116941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:51.118447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:51.141944 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6a48bebb-bad8-4a2f-bf75-f39450afb083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ed8621f537473db6c828bb771c79a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.174926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6a48bebb-bad8-4a2f-bf75-f39450afb083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ed8621f537473db6c828bb771c79a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.185401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6a48bebb-bad8-4a2f-bf75-f39450afb083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ed8621f537473db6c828bb771c79a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.187149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6a48bebb-bad8-4a2f-bf75-f39450afb083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ed8621f537473db6c828bb771c79a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.199741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6a48bebb-bad8-4a2f-bf75-f39450afb083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ed8621f537473db6c828bb771c79a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.211253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1110/2216] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:50 2022] DELETE /identity/v3/users/30ed8621f537473db6c828bb771c79a5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:51.214391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18824e4-5fd8-4ac3-85ce-67bf19cac220 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:51.214947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18824e4-5fd8-4ac3-85ce-67bf19cac220 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:51.215237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18824e4-5fd8-4ac3-85ce-67bf19cac220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:51.226962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232b83d-fd42-4e62-b9ff-de7384a380e2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:51.257394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d18824e4-5fd8-4ac3-85ce-67bf19cac220 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:51.259158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d18824e4-5fd8-4ac3-85ce-67bf19cac220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:51.341119 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f94cd-c825-4cb6-8122-01aaa024035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:51.342159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f94cd-c825-4cb6-8122-01aaa024035c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:51.342448 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f94cd-c825-4cb6-8122-01aaa024035c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:51.342736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f94cd-c825-4cb6-8122-01aaa024035c admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:51.343487 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f94cd-c825-4cb6-8122-01aaa024035c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:51.346650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f94cd-c825-4cb6-8122-01aaa024035c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:51.376556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1111/2217] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:51.391601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18824e4-5fd8-4ac3-85ce-67bf19cac220 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:51.393353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d18824e4-5fd8-4ac3-85ce-67bf19cac220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:51.396447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1107/2218] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:51 2022] POST /identity/v3/projects => generated 373 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:51.399142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:51.402279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f94cd-c825-4cb6-8122-01aaa024035c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:51.404181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3a8f94cd-c825-4cb6-8122-01aaa024035c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:51.455890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:51.503064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18824e4-5fd8-4ac3-85ce-67bf19cac220 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:51.531385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f94cd-c825-4cb6-8122-01aaa024035c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:51.537403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdedd1-632f-469b-9d32-ffe91b558564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:51.538098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdedd1-632f-469b-9d32-ffe91b558564 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:51.538386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdedd1-632f-469b-9d32-ffe91b558564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:51.538668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdedd1-632f-469b-9d32-ffe91b558564 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:51.540708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdedd1-632f-469b-9d32-ffe91b558564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:51.543052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdedd1-632f-469b-9d32-ffe91b558564 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:51.570188 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1108/2219] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:51 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:51.574203 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdedd1-632f-469b-9d32-ffe91b558564 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:51.585868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe4770-a82b-4591-ba3d-acecf8442f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:51.586656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe4770-a82b-4591-ba3d-acecf8442f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:51.587424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe4770-a82b-4591-ba3d-acecf8442f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:51.587574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdedd1-632f-469b-9d32-ffe91b558564 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:51.587790 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe4770-a82b-4591-ba3d-acecf8442f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:51.593025 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b807c24-7f1b-49c8-94e9-9ab5f7498e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:51.593971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b807c24-7f1b-49c8-94e9-9ab5f7498e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:51.594866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b807c24-7f1b-49c8-94e9-9ab5f7498e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:51.595325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b807c24-7f1b-49c8-94e9-9ab5f7498e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:51.596122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b807c24-7f1b-49c8-94e9-9ab5f7498e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:51.597798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b807c24-7f1b-49c8-94e9-9ab5f7498e8b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:51.610107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1109/2220] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:51.615378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe4770-a82b-4591-ba3d-acecf8442f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:51.615537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b807c24-7f1b-49c8-94e9-9ab5f7498e8b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:51.617390 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe4770-a82b-4591-ba3d-acecf8442f69 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:51.628688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b807c24-7f1b-49c8-94e9-9ab5f7498e8b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:51.632131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1112/2221] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:51.633531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe4770-a82b-4591-ba3d-acecf8442f69 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:51.634863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f7fe4770-a82b-4591-ba3d-acecf8442f69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:51.634973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e0bcd-23bd-42a2-92d7-2637c1ecac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:51.635995 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e0bcd-23bd-42a2-92d7-2637c1ecac03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:51.636402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e0bcd-23bd-42a2-92d7-2637c1ecac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:51.636782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e0bcd-23bd-42a2-92d7-2637c1ecac03 admin admin] PATH_INFO: `/v3/projects/e9d1e8b7e5a34cebbf965768e7225ccd/users/bff805aa627b4ee3b2d9241b13e58780/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:51.652313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe4770-a82b-4591-ba3d-acecf8442f69 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:51.678862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:51.682853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:51.691660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:51.692061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] PATH_INFO: `/v3/projects/be03a4d36d52483a9de269142bbd156b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:51.693073 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e0bcd-23bd-42a2-92d7-2637c1ecac03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d1e8b7e5a34cebbf965768e7225ccd, user_id=bff805aa627b4ee3b2d9241b13e58780, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:51.696637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be03a4d36d52483a9de269142bbd156b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:51.702723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:51.703164 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e0bcd-23bd-42a2-92d7-2637c1ecac03 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:51.727047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1110/2222] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:51 2022] PUT /identity/v3/projects/e9d1e8b7e5a34cebbf965768e7225ccd/users/bff805aa627b4ee3b2d9241b13e58780/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:51.732197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e0bcd-23bd-42a2-92d7-2637c1ecac03 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:51.794418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be03a4d36d52483a9de269142bbd156b', 'request_id': 'req-0302971e-6fdf-47ff-a69a-ed8db9abf969'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.802134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be03a4d36d52483a9de269142bbd156b', 'request_id': 'req-0302971e-6fdf-47ff-a69a-ed8db9abf969'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.810492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be03a4d36d52483a9de269142bbd156b', 'request_id': 'req-0302971e-6fdf-47ff-a69a-ed8db9abf969'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.836312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] The token cache is being invalidate because project be03a4d36d52483a9de269142bbd156b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:51.836897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.837982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0302971e-6fdf-47ff-a69a-ed8db9abf969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:51.839799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1113/2223] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:51 2022] DELETE /identity/v3/projects/be03a4d36d52483a9de269142bbd156b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:51.847625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288b7c-652f-4b79-a77d-a87f6eedc8a6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:51.848336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288b7c-652f-4b79-a77d-a87f6eedc8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:51.848931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288b7c-652f-4b79-a77d-a87f6eedc8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:51.858899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e0bcd-23bd-42a2-92d7-2637c1ecac03 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:51.875922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-df288b7c-652f-4b79-a77d-a87f6eedc8a6 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:51.877229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-df288b7c-652f-4b79-a77d-a87f6eedc8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:51.956623 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:51.966337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb8d94-187d-4ac9-af2d-127218eeae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:51.967647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8d94-187d-4ac9-af2d-127218eeae08 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:51.969593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8d94-187d-4ac9-af2d-127218eeae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:51.970765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8d94-187d-4ac9-af2d-127218eeae08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:51.973087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb8d94-187d-4ac9-af2d-127218eeae08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:51.975857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb8d94-187d-4ac9-af2d-127218eeae08 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:51.987468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1114/2224] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:52.004160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1111/2225] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:52.004923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9bc4c-1e22-44db-ada0-f2ae32d5a112 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:52.005220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9bc4c-1e22-44db-ada0-f2ae32d5a112 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:52.005920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9bc4c-1e22-44db-ada0-f2ae32d5a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:52.009775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb8d94-187d-4ac9-af2d-127218eeae08 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:52.014617 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fdeb8d94-187d-4ac9-af2d-127218eeae08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:52.025556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-edd9bc4c-1e22-44db-ada0-f2ae32d5a112 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:52.026783 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-edd9bc4c-1e22-44db-ada0-f2ae32d5a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:52.038919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1115/2226] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:52.039827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9bc4c-1e22-44db-ada0-f2ae32d5a112 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:52.041404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-edd9bc4c-1e22-44db-ada0-f2ae32d5a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:52.059484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9bc4c-1e22-44db-ada0-f2ae32d5a112 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:52.065578 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb8d94-187d-4ac9-af2d-127218eeae08 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:52.065708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:52.066732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:52.067191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:52.067572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] PATH_INFO: `/v3/projects/47429d6653954fe7b1c28300e69847ff` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:52.069112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=47429d6653954fe7b1c28300e69847ff)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:52.070490 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d849d-743d-4dd5-8f5c-84714d975eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:52.071266 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:52.071377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d849d-743d-4dd5-8f5c-84714d975eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:52.071649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d849d-743d-4dd5-8f5c-84714d975eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:52.071955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d849d-743d-4dd5-8f5c-84714d975eff admin admin] PATH_INFO: `/v3/projects/e9d1e8b7e5a34cebbf965768e7225ccd/users/bff805aa627b4ee3b2d9241b13e58780/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:52.074773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d849d-743d-4dd5-8f5c-84714d975eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d1e8b7e5a34cebbf965768e7225ccd, user_id=bff805aa627b4ee3b2d9241b13e58780, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:52.081249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d849d-743d-4dd5-8f5c-84714d975eff admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:52.098229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1112/2227] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:52 2022] PUT /identity/v3/projects/e9d1e8b7e5a34cebbf965768e7225ccd/users/bff805aa627b4ee3b2d9241b13e58780/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:52.098229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d849d-743d-4dd5-8f5c-84714d975eff admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:52.119205 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:52.139958 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47429d6653954fe7b1c28300e69847ff', 'request_id': 'req-c0c118df-d381-4821-a729-f5c3a30abd2f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:52.147556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47429d6653954fe7b1c28300e69847ff', 'request_id': 'req-c0c118df-d381-4821-a729-f5c3a30abd2f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:52.154019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47429d6653954fe7b1c28300e69847ff', 'request_id': 'req-c0c118df-d381-4821-a729-f5c3a30abd2f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:52.172168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] The token cache is being invalidate because project 47429d6653954fe7b1c28300e69847ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:52.172464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:52.173559 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:52.178659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1116/2228] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:52 2022] DELETE /identity/v3/projects/47429d6653954fe7b1c28300e69847ff => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:52.190563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:52.194324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:52.209770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d849d-743d-4dd5-8f5c-84714d975eff admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:52.335081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c118df-d381-4821-a729-f5c3a30abd2f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:52.337112 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91726a20-252d-45e5-bcfa-ee2990a41590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:52.337971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91726a20-252d-45e5-bcfa-ee2990a41590 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:52.338261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91726a20-252d-45e5-bcfa-ee2990a41590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:52.338696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91726a20-252d-45e5-bcfa-ee2990a41590 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:52.341086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91726a20-252d-45e5-bcfa-ee2990a41590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:52.342295 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:52.343322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91726a20-252d-45e5-bcfa-ee2990a41590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:52.343784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:52.344277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:52.344747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] PATH_INFO: `/v3/users/d33c28c94c6d43a48fc79cb5a3004e28` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:52.345034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91726a20-252d-45e5-bcfa-ee2990a41590 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:52.347089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33c28c94c6d43a48fc79cb5a3004e28)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:52.349561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:52.364425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1113/2229] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:52.368709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91726a20-252d-45e5-bcfa-ee2990a41590 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:52.371288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-91726a20-252d-45e5-bcfa-ee2990a41590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:52.401004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91726a20-252d-45e5-bcfa-ee2990a41590 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:52.408207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5322226-c95f-433a-8dbc-1b0718a093c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:52.408960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5322226-c95f-433a-8dbc-1b0718a093c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:52.409322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5322226-c95f-433a-8dbc-1b0718a093c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:52.409748 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5322226-c95f-433a-8dbc-1b0718a093c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:52.410623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5322226-c95f-433a-8dbc-1b0718a093c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:52.414893 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5322226-c95f-433a-8dbc-1b0718a093c3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:52.468215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33c28c94c6d43a48fc79cb5a3004e28'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:52.501853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1114/2230] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:52 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:52.502685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:52.503346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5322226-c95f-433a-8dbc-1b0718a093c3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:52.506078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33c28c94c6d43a48fc79cb5a3004e28'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:52.523664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33c28c94c6d43a48fc79cb5a3004e28'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:52.525227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33c28c94c6d43a48fc79cb5a3004e28'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:52.541552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33c28c94c6d43a48fc79cb5a3004e28'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:52.569854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1117/2231] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:52 2022] DELETE /identity/v3/users/d33c28c94c6d43a48fc79cb5a3004e28 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:52.641151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5322226-c95f-433a-8dbc-1b0718a093c3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:52.704836 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:52.769350 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b049c-dde8-4743-81a0-fb8643efa027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:52.770067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b049c-dde8-4743-81a0-fb8643efa027 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:52.770327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b049c-dde8-4743-81a0-fb8643efa027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:52.770685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b049c-dde8-4743-81a0-fb8643efa027 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:52.771545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b049c-dde8-4743-81a0-fb8643efa027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:52.774037 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b049c-dde8-4743-81a0-fb8643efa027 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:52.852328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1115/2232] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:52 2022] POST /identity/v3/users => generated 293 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:24:52.855318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:52.857181 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:52.882285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ada525-9aa7-4812-bb48-76f53bad674c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:52.899759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99458b7-c2d3-4320-9415-5e7bf7e1d2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:52.900547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99458b7-c2d3-4320-9415-5e7bf7e1d2cf admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:52.900845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99458b7-c2d3-4320-9415-5e7bf7e1d2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:52.901710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99458b7-c2d3-4320-9415-5e7bf7e1d2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:52.902472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99458b7-c2d3-4320-9415-5e7bf7e1d2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:52.904753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99458b7-c2d3-4320-9415-5e7bf7e1d2cf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:52.927764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b049c-dde8-4743-81a0-fb8643efa027 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:52.930886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1118/2233] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:52.950641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b049c-dde8-4743-81a0-fb8643efa027 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:52.958390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284680c0-8d49-43a6-a0d8-2d3a51f5c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:52.959419 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284680c0-8d49-43a6-a0d8-2d3a51f5c0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:52.959720 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284680c0-8d49-43a6-a0d8-2d3a51f5c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:52.960142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284680c0-8d49-43a6-a0d8-2d3a51f5c0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:52.964439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284680c0-8d49-43a6-a0d8-2d3a51f5c0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:52.966750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284680c0-8d49-43a6-a0d8-2d3a51f5c0c8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:52.979283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1116/2234] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:52.983381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99458b7-c2d3-4320-9415-5e7bf7e1d2cf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:52.997624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99458b7-c2d3-4320-9415-5e7bf7e1d2cf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:53.011275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747d3a5-27e1-479b-bb98-118707305b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:53.012332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d3a5-27e1-479b-bb98-118707305b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:53.012716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d3a5-27e1-479b-bb98-118707305b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:53.013002 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d3a5-27e1-479b-bb98-118707305b1d admin admin] PATH_INFO: `/v3/projects/69b4146d83854a99b3182c5c1ab9cc4e/users/aa44061fca0b4dc28d832a0c9f8f9f7c/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:53.047119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747d3a5-27e1-479b-bb98-118707305b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b4146d83854a99b3182c5c1ab9cc4e, user_id=aa44061fca0b4dc28d832a0c9f8f9f7c, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:53.050689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747d3a5-27e1-479b-bb98-118707305b1d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:53.080045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1119/2235] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:52 2022] PUT /identity/v3/projects/69b4146d83854a99b3182c5c1ab9cc4e/users/aa44061fca0b4dc28d832a0c9f8f9f7c/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:53.082139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb7039-c6f3-4247-9770-51c2a6b52634 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:53.082507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb7039-c6f3-4247-9770-51c2a6b52634 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:53.082863 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb7039-c6f3-4247-9770-51c2a6b52634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:53.114581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-35bb7039-c6f3-4247-9770-51c2a6b52634 None None] MFA Rules not processed for user `aa44061fca0b4dc28d832a0c9f8f9f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:53.117623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-35bb7039-c6f3-4247-9770-51c2a6b52634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:53.201794 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1117/2236] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:53.206956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747d3a5-27e1-479b-bb98-118707305b1d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:53.307242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747d3a5-27e1-479b-bb98-118707305b1d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:53.314029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e769d-6669-4f42-b8b5-31bdb5dbc571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:53.314972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e769d-6669-4f42-b8b5-31bdb5dbc571 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:53.315862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e769d-6669-4f42-b8b5-31bdb5dbc571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:53.316255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e769d-6669-4f42-b8b5-31bdb5dbc571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:53.317126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e769d-6669-4f42-b8b5-31bdb5dbc571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:53.319322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e769d-6669-4f42-b8b5-31bdb5dbc571 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:53.380381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1120/2237] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:53 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:53.382028 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb7039-c6f3-4247-9770-51c2a6b52634 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:53.396160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb7039-c6f3-4247-9770-51c2a6b52634 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:53.493722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8606c87-0a87-4bc5-b7c2-7e44d6a876b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:53.494764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8606c87-0a87-4bc5-b7c2-7e44d6a876b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:53.495418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8606c87-0a87-4bc5-b7c2-7e44d6a876b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:53.495840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8606c87-0a87-4bc5-b7c2-7e44d6a876b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:53.496849 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8606c87-0a87-4bc5-b7c2-7e44d6a876b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:53.498999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8606c87-0a87-4bc5-b7c2-7e44d6a876b6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:53.532132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1118/2238] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:53 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:53.534521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e769d-6669-4f42-b8b5-31bdb5dbc571 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:53.565785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e769d-6669-4f42-b8b5-31bdb5dbc571 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:53.571573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6653e2-7cfb-46d0-8bd2-cdb52d0112e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:53.572365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6653e2-7cfb-46d0-8bd2-cdb52d0112e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:53.572657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6653e2-7cfb-46d0-8bd2-cdb52d0112e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:53.572988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6653e2-7cfb-46d0-8bd2-cdb52d0112e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:53.573907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6653e2-7cfb-46d0-8bd2-cdb52d0112e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:53.576075 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6653e2-7cfb-46d0-8bd2-cdb52d0112e5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:53.596794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1121/2239] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:53.599761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8606c87-0a87-4bc5-b7c2-7e44d6a876b6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:53.613650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8606c87-0a87-4bc5-b7c2-7e44d6a876b6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:53.621111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6653e2-7cfb-46d0-8bd2-cdb52d0112e5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:53.622463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b66b9-7fad-42e2-91f2-705fe58bcac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:53.622931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1d6653e2-7cfb-46d0-8bd2-cdb52d0112e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:53.624159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b66b9-7fad-42e2-91f2-705fe58bcac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:53.624688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b66b9-7fad-42e2-91f2-705fe58bcac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:53.626342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b66b9-7fad-42e2-91f2-705fe58bcac3 admin admin] PATH_INFO: `/v3/projects/73048b8e0e334cbf8bd4f0797da2ea07/users/3566a083d49245da913f0a8147c99506/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:53.643500 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6653e2-7cfb-46d0-8bd2-cdb52d0112e5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:53.649559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b66b9-7fad-42e2-91f2-705fe58bcac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73048b8e0e334cbf8bd4f0797da2ea07, user_id=3566a083d49245da913f0a8147c99506, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:53.653547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b66b9-7fad-42e2-91f2-705fe58bcac3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:53.662199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:53.663265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:53.663552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:53.663857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] PATH_INFO: `/v3/projects/26f4d8c8ec5a454783bbb1d37cc17d74` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:53.667533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f4d8c8ec5a454783bbb1d37cc17d74)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:53.669528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:53.682975 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1119/2240] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:53 2022] PUT /identity/v3/projects/73048b8e0e334cbf8bd4f0797da2ea07/users/3566a083d49245da913f0a8147c99506/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:53.689757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b66b9-7fad-42e2-91f2-705fe58bcac3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:53.703055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:53.786093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f4d8c8ec5a454783bbb1d37cc17d74', 'request_id': 'req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:53.794482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b66b9-7fad-42e2-91f2-705fe58bcac3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:53.797630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f4d8c8ec5a454783bbb1d37cc17d74', 'request_id': 'req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:53.815030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f4d8c8ec5a454783bbb1d37cc17d74', 'request_id': 'req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:53.843681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] The token cache is being invalidate because project 26f4d8c8ec5a454783bbb1d37cc17d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:53.846396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:53.847678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b696d1a6-a6e5-4a4b-9051-1e8c43042a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:53.852997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1122/2241] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:53 2022] DELETE /identity/v3/projects/26f4d8c8ec5a454783bbb1d37cc17d74 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:53.857939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971c937-e70f-4d49-8b91-877de7cfe3d0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:53.858585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971c937-e70f-4d49-8b91-877de7cfe3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:53.858585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971c937-e70f-4d49-8b91-877de7cfe3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:53.873393 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:53.901419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4971c937-e70f-4d49-8b91-877de7cfe3d0 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:53.904838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4971c937-e70f-4d49-8b91-877de7cfe3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:53.932958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a374e-b719-4dc9-ae49-42ac53d0f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:53.933940 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a374e-b719-4dc9-ae49-42ac53d0f176 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:53.934378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a374e-b719-4dc9-ae49-42ac53d0f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:53.934763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a374e-b719-4dc9-ae49-42ac53d0f176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:53.935606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a374e-b719-4dc9-ae49-42ac53d0f176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:53.938075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a374e-b719-4dc9-ae49-42ac53d0f176 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:53.976683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1120/2242] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:53.983619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a374e-b719-4dc9-ae49-42ac53d0f176 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:53.985915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-034a374e-b719-4dc9-ae49-42ac53d0f176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:54.002215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a374e-b719-4dc9-ae49-42ac53d0f176 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:54.009042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7c427-e30d-4a13-90a4-d7594c984973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:54.010363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7c427-e30d-4a13-90a4-d7594c984973 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:54.010822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7c427-e30d-4a13-90a4-d7594c984973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:54.011352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7c427-e30d-4a13-90a4-d7594c984973 admin admin] PATH_INFO: `/v3/projects/73048b8e0e334cbf8bd4f0797da2ea07/users/3566a083d49245da913f0a8147c99506/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:54.013756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7c427-e30d-4a13-90a4-d7594c984973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73048b8e0e334cbf8bd4f0797da2ea07, user_id=3566a083d49245da913f0a8147c99506, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:54.018751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7c427-e30d-4a13-90a4-d7594c984973 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:54.033092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1121/2243] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:53 2022] PUT /identity/v3/projects/73048b8e0e334cbf8bd4f0797da2ea07/users/3566a083d49245da913f0a8147c99506/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:54.046960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20ccb-02a8-4f69-bab7-2a0cfe66a442 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:54.047345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20ccb-02a8-4f69-bab7-2a0cfe66a442 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:54.047722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20ccb-02a8-4f69-bab7-2a0cfe66a442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:54.083325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-63b20ccb-02a8-4f69-bab7-2a0cfe66a442 None None] MFA Rules not processed for user `3566a083d49245da913f0a8147c99506`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:54.092939 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-63b20ccb-02a8-4f69-bab7-2a0cfe66a442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:54.104562 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1123/2244] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:54.112655 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d93cad-89f4-47eb-9783-302211ea315e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:54.113196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d93cad-89f4-47eb-9783-302211ea315e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:54.113695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d93cad-89f4-47eb-9783-302211ea315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:54.177038 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-20d93cad-89f4-47eb-9783-302211ea315e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:54.180913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-20d93cad-89f4-47eb-9783-302211ea315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:54.194935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1122/2245] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:54.203410 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b20ccb-02a8-4f69-bab7-2a0cfe66a442 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:54.205716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-63b20ccb-02a8-4f69-bab7-2a0cfe66a442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:54.246212 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:54.295129 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b20ccb-02a8-4f69-bab7-2a0cfe66a442 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:54.299337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b30b0-c0cc-4665-8669-e07bb70a818b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:54.300122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b30b0-c0cc-4665-8669-e07bb70a818b service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:54.300412 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b30b0-c0cc-4665-8669-e07bb70a818b service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:54.301024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b30b0-c0cc-4665-8669-e07bb70a818b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:54.315334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b30b0-c0cc-4665-8669-e07bb70a818b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:54.316938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b30b0-c0cc-4665-8669-e07bb70a818b service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:54.328869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1124/2246] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:54.331356 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1123/2247] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:54.340961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d93cad-89f4-47eb-9783-302211ea315e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:54.362034 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d93cad-89f4-47eb-9783-302211ea315e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:54.375242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a895a-98ca-4a2a-891d-fc1139a5e866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:54.376190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a895a-98ca-4a2a-891d-fc1139a5e866 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:54.376661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a895a-98ca-4a2a-891d-fc1139a5e866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:54.378488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a895a-98ca-4a2a-891d-fc1139a5e866 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:54.379891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b30b0-c0cc-4665-8669-e07bb70a818b service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:54.389253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a895a-98ca-4a2a-891d-fc1139a5e866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:54.390136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a895a-98ca-4a2a-891d-fc1139a5e866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:54.393516 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a895a-98ca-4a2a-891d-fc1139a5e866 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:54.406087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b30b0-c0cc-4665-8669-e07bb70a818b service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:54.412302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1125/2248] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:54.413219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fc628-1df5-4967-8a24-dd084a25b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:54.414101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc628-1df5-4967-8a24-dd084a25b78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:54.414388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc628-1df5-4967-8a24-dd084a25b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:54.414703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc628-1df5-4967-8a24-dd084a25b78a admin admin] PATH_INFO: `/v3/users/aa44061fca0b4dc28d832a0c9f8f9f7c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:54.416687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a895a-98ca-4a2a-891d-fc1139a5e866 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:54.417737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fc628-1df5-4967-8a24-dd084a25b78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa44061fca0b4dc28d832a0c9f8f9f7c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:54.420615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fc628-1df5-4967-8a24-dd084a25b78a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:54.433009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a895a-98ca-4a2a-891d-fc1139a5e866 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:54.439293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5eb10-d4a7-4527-bcc4-22f579e2cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:54.440304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5eb10-d4a7-4527-bcc4-22f579e2cad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:54.440608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5eb10-d4a7-4527-bcc4-22f579e2cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:54.440892 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5eb10-d4a7-4527-bcc4-22f579e2cad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:54.441592 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5eb10-d4a7-4527-bcc4-22f579e2cad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:54.443878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5eb10-d4a7-4527-bcc4-22f579e2cad6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:54.492653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1126/2249] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:54 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:54.497215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5eb10-d4a7-4527-bcc4-22f579e2cad6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:54.519451 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b32fc628-1df5-4967-8a24-dd084a25b78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa44061fca0b4dc28d832a0c9f8f9f7c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:54.554754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b32fc628-1df5-4967-8a24-dd084a25b78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa44061fca0b4dc28d832a0c9f8f9f7c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:54.568118 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b32fc628-1df5-4967-8a24-dd084a25b78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa44061fca0b4dc28d832a0c9f8f9f7c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:54.569135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b32fc628-1df5-4967-8a24-dd084a25b78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa44061fca0b4dc28d832a0c9f8f9f7c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:54.591006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b32fc628-1df5-4967-8a24-dd084a25b78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa44061fca0b4dc28d832a0c9f8f9f7c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:54.606302 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1124/2250] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:54 2022] DELETE /identity/v3/users/aa44061fca0b4dc28d832a0c9f8f9f7c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:24:54.611317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61ee7a-c857-47ea-b67a-d27f763b2a29 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:54.612218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61ee7a-c857-47ea-b67a-d27f763b2a29 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:54.612587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61ee7a-c857-47ea-b67a-d27f763b2a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:54.614920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5eb10-d4a7-4527-bcc4-22f579e2cad6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:54.632554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:54.652996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8d61ee7a-c857-47ea-b67a-d27f763b2a29 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:54.658965 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8d61ee7a-c857-47ea-b67a-d27f763b2a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:54.700710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dedfe1-9f4f-48c8-b5c6-1c5c8dc6c252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:54.701404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dedfe1-9f4f-48c8-b5c6-1c5c8dc6c252 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:54.701688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dedfe1-9f4f-48c8-b5c6-1c5c8dc6c252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:54.701967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dedfe1-9f4f-48c8-b5c6-1c5c8dc6c252 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:54.702681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dedfe1-9f4f-48c8-b5c6-1c5c8dc6c252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:54.706846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dedfe1-9f4f-48c8-b5c6-1c5c8dc6c252 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:54.765369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1127/2251] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:54 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:54.766787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dedfe1-9f4f-48c8-b5c6-1c5c8dc6c252 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:54.768672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-90dedfe1-9f4f-48c8-b5c6-1c5c8dc6c252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:54.801869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dedfe1-9f4f-48c8-b5c6-1c5c8dc6c252 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:54.811825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d45676-6222-47f5-8ae8-ef9fab957739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:54.812605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d45676-6222-47f5-8ae8-ef9fab957739 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:54.812895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d45676-6222-47f5-8ae8-ef9fab957739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:54.813370 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d45676-6222-47f5-8ae8-ef9fab957739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:54.817742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d45676-6222-47f5-8ae8-ef9fab957739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:54.819711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d45676-6222-47f5-8ae8-ef9fab957739 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:54.837610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1125/2252] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:54.873556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1128/2253] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:54.875033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61ee7a-c857-47ea-b67a-d27f763b2a29 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:54.889283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61ee7a-c857-47ea-b67a-d27f763b2a29 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:54.900839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a12e4-8554-4037-8f79-e2b4b3610af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:54.904777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d45676-6222-47f5-8ae8-ef9fab957739 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:54.907393 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-25d45676-6222-47f5-8ae8-ef9fab957739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:54.909431 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a12e4-8554-4037-8f79-e2b4b3610af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:54.912174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a12e4-8554-4037-8f79-e2b4b3610af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:54.917017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a12e4-8554-4037-8f79-e2b4b3610af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:54.922723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a12e4-8554-4037-8f79-e2b4b3610af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:54.927576 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a12e4-8554-4037-8f79-e2b4b3610af4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:54.970010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1126/2254] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:54.973516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a12e4-8554-4037-8f79-e2b4b3610af4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:55.045437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a12e4-8554-4037-8f79-e2b4b3610af4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:55.072910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d3513-46ae-4f72-88cc-a5cbfec3f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:55.075406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d3513-46ae-4f72-88cc-a5cbfec3f93b admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:55.075836 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d3513-46ae-4f72-88cc-a5cbfec3f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:55.076221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d3513-46ae-4f72-88cc-a5cbfec3f93b admin admin] PATH_INFO: `/v3/projects/78fbd3bc664f469190e44538fc80259d/users/596fdda6cba74e049aa4b8e61c7da558/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:55.096652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d3513-46ae-4f72-88cc-a5cbfec3f93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78fbd3bc664f469190e44538fc80259d, user_id=596fdda6cba74e049aa4b8e61c7da558, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:55.099920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d3513-46ae-4f72-88cc-a5cbfec3f93b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:55.138634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1127/2255] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:54 2022] PUT /identity/v3/projects/78fbd3bc664f469190e44538fc80259d/users/596fdda6cba74e049aa4b8e61c7da558/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:55.144338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d45676-6222-47f5-8ae8-ef9fab957739 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:55.149493 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22046d-d753-4c8f-b47e-be449797ab5f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:55.151627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22046d-d753-4c8f-b47e-be449797ab5f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:55.152513 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22046d-d753-4c8f-b47e-be449797ab5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:55.167285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:55.217786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ee22046d-d753-4c8f-b47e-be449797ab5f None None] MFA Rules not processed for user `596fdda6cba74e049aa4b8e61c7da558`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:55.220715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ee22046d-d753-4c8f-b47e-be449797ab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:55.274813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba02bd2-d178-486e-b02c-9eff7111a8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:55.275488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02bd2-d178-486e-b02c-9eff7111a8bb service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:55.275771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02bd2-d178-486e-b02c-9eff7111a8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:55.276172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba02bd2-d178-486e-b02c-9eff7111a8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:55.342060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1128/2256] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:55.360055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22046d-d753-4c8f-b47e-be449797ab5f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:55.361922 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ee22046d-d753-4c8f-b47e-be449797ab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:55.392673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba02bd2-d178-486e-b02c-9eff7111a8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:55.394213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba02bd2-d178-486e-b02c-9eff7111a8bb service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:55.402122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:55.412148 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1129/2257] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:55.497821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22046d-d753-4c8f-b47e-be449797ab5f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:55.503218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45169cac-02d8-4174-a42b-77f7ee03fddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:55.504288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169cac-02d8-4174-a42b-77f7ee03fddd service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:55.504783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169cac-02d8-4174-a42b-77f7ee03fddd service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:55.505466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169cac-02d8-4174-a42b-77f7ee03fddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:55.517881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45169cac-02d8-4174-a42b-77f7ee03fddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:55.519892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45169cac-02d8-4174-a42b-77f7ee03fddd service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:55.534797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1129/2258] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:24:56.144273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba02bd2-d178-486e-b02c-9eff7111a8bb service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:56.146250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7ba02bd2-d178-486e-b02c-9eff7111a8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:56.196488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba02bd2-d178-486e-b02c-9eff7111a8bb service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:56.218332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:56.220358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:56.222205 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:56.223711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] PATH_INFO: `/v3/projects/69b4146d83854a99b3182c5c1ab9cc4e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:56.230507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b4146d83854a99b3182c5c1ab9cc4e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:56.238311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:56.393294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b4146d83854a99b3182c5c1ab9cc4e', 'request_id': 'req-aacf8b56-540d-463d-9204-afb0ffcaf837'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:56.406130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b4146d83854a99b3182c5c1ab9cc4e', 'request_id': 'req-aacf8b56-540d-463d-9204-afb0ffcaf837'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:56.420720 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b4146d83854a99b3182c5c1ab9cc4e', 'request_id': 'req-aacf8b56-540d-463d-9204-afb0ffcaf837'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:56.446480 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] The token cache is being invalidate because project 69b4146d83854a99b3182c5c1ab9cc4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:56.446894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:56.448128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:56.452561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1130/2259] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:56 2022] DELETE /identity/v3/projects/69b4146d83854a99b3182c5c1ab9cc4e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:56.456801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45169cac-02d8-4174-a42b-77f7ee03fddd service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:56.493285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45169cac-02d8-4174-a42b-77f7ee03fddd service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:56.620943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815239de-cc10-4a4c-b18c-a5055e0d398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:56.621821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815239de-cc10-4a4c-b18c-a5055e0d398d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:56.622777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815239de-cc10-4a4c-b18c-a5055e0d398d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:56.623057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815239de-cc10-4a4c-b18c-a5055e0d398d admin admin] PATH_INFO: `/v3/users/3566a083d49245da913f0a8147c99506` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:56.624328 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815239de-cc10-4a4c-b18c-a5055e0d398d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3566a083d49245da913f0a8147c99506)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:56.626633 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815239de-cc10-4a4c-b18c-a5055e0d398d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:56.795986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:56.825431 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-815239de-cc10-4a4c-b18c-a5055e0d398d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3566a083d49245da913f0a8147c99506'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:56.868042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-815239de-cc10-4a4c-b18c-a5055e0d398d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3566a083d49245da913f0a8147c99506'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:56.887151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-815239de-cc10-4a4c-b18c-a5055e0d398d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3566a083d49245da913f0a8147c99506'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:56.888003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-815239de-cc10-4a4c-b18c-a5055e0d398d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3566a083d49245da913f0a8147c99506'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:56.908571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-815239de-cc10-4a4c-b18c-a5055e0d398d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3566a083d49245da913f0a8147c99506'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:56.915763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1130/2260] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:24:56 2022] DELETE /identity/v3/users/3566a083d49245da913f0a8147c99506 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:57.868358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:57.870704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:57.892658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf8b56-540d-463d-9204-afb0ffcaf837 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:57.972267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:57.974588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:57.975206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:57.975730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] PATH_INFO: `/v3/projects/73048b8e0e334cbf8bd4f0797da2ea07` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:57.977498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] RBAC: Authorizing `identity:delete_project(project_id=73048b8e0e334cbf8bd4f0797da2ea07)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:57.980182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:58.048046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73048b8e0e334cbf8bd4f0797da2ea07', 'request_id': 'req-d5929391-fd72-4d98-81e6-3198af75267c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:58.058232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73048b8e0e334cbf8bd4f0797da2ea07', 'request_id': 'req-d5929391-fd72-4d98-81e6-3198af75267c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:58.066564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73048b8e0e334cbf8bd4f0797da2ea07', 'request_id': 'req-d5929391-fd72-4d98-81e6-3198af75267c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:58.087176 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] The token cache is being invalidate because project 73048b8e0e334cbf8bd4f0797da2ea07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:24:58.087774 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:58.088672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d5929391-fd72-4d98-81e6-3198af75267c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:24:58.090489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1131/2261] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:24:57 2022] DELETE /identity/v3/projects/73048b8e0e334cbf8bd4f0797da2ea07 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:58.095717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666dc1-e7f1-49bb-90bf-38f2c9df2395 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:58.096210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666dc1-e7f1-49bb-90bf-38f2c9df2395 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:58.096411 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666dc1-e7f1-49bb-90bf-38f2c9df2395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:58.119309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-30666dc1-e7f1-49bb-90bf-38f2c9df2395 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:58.120993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-30666dc1-e7f1-49bb-90bf-38f2c9df2395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:58.202831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1131/2262] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:58.213337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77706951-edd5-41a5-be1c-ad17e6639b71 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:58.213557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77706951-edd5-41a5-be1c-ad17e6639b71 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:58.213891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77706951-edd5-41a5-be1c-ad17e6639b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:58.250999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-77706951-edd5-41a5-be1c-ad17e6639b71 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:58.252276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-77706951-edd5-41a5-be1c-ad17e6639b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:58.293042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1132/2263] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:58.293956 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30666dc1-e7f1-49bb-90bf-38f2c9df2395 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:58.311562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30666dc1-e7f1-49bb-90bf-38f2c9df2395 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:58.323445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9fa4c-13e2-4dba-9cff-16a26b468354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:58.324155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9fa4c-13e2-4dba-9cff-16a26b468354 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:58.324443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9fa4c-13e2-4dba-9cff-16a26b468354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:58.324723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9fa4c-13e2-4dba-9cff-16a26b468354 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:58.325474 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9fa4c-13e2-4dba-9cff-16a26b468354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:24:58.325784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9fa4c-13e2-4dba-9cff-16a26b468354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:58.327400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9fa4c-13e2-4dba-9cff-16a26b468354 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:58.355363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1132/2264] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:24:58.356752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77706951-edd5-41a5-be1c-ad17e6639b71 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:58.368423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77706951-edd5-41a5-be1c-ad17e6639b71 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:58.377301 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981fee7-59a8-4494-808a-a33623cac7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:58.378397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981fee7-59a8-4494-808a-a33623cac7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:58.379674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981fee7-59a8-4494-808a-a33623cac7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:58.380537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981fee7-59a8-4494-808a-a33623cac7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:58.381802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981fee7-59a8-4494-808a-a33623cac7f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:58.386680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981fee7-59a8-4494-808a-a33623cac7f6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:58.392715 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:58.442513 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1133/2265] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:58 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:58.442910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9fa4c-13e2-4dba-9cff-16a26b468354 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:58.470274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9fa4c-13e2-4dba-9cff-16a26b468354 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:58.561969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d1cea-7ac0-4445-9c98-fc2a4ff6913e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:58.562986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1cea-7ac0-4445-9c98-fc2a4ff6913e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:58.563326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1cea-7ac0-4445-9c98-fc2a4ff6913e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:58.563537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1cea-7ac0-4445-9c98-fc2a4ff6913e admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:58.564271 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d1cea-7ac0-4445-9c98-fc2a4ff6913e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:58.566354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d1cea-7ac0-4445-9c98-fc2a4ff6913e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:58.590374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1133/2266] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:58 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:58.595135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981fee7-59a8-4494-808a-a33623cac7f6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:58.607270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981fee7-59a8-4494-808a-a33623cac7f6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:58.612232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f25a9-b911-40bd-8925-c033d388407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:58.612904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f25a9-b911-40bd-8925-c033d388407f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:58.613187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f25a9-b911-40bd-8925-c033d388407f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:58.613462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f25a9-b911-40bd-8925-c033d388407f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:58.614195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f25a9-b911-40bd-8925-c033d388407f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:58.615829 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f25a9-b911-40bd-8925-c033d388407f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:58.627644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1134/2267] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:58.631336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d1cea-7ac0-4445-9c98-fc2a4ff6913e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:58.642307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d1cea-7ac0-4445-9c98-fc2a4ff6913e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:58.647102 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1a072-9a93-445b-977d-c79417f4e132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:58.647763 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1a072-9a93-445b-977d-c79417f4e132 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:58.648097 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1a072-9a93-445b-977d-c79417f4e132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:58.648377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1a072-9a93-445b-977d-c79417f4e132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:58.649106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1a072-9a93-445b-977d-c79417f4e132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:58.650705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1a072-9a93-445b-977d-c79417f4e132 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:58.661444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1134/2268] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:58.665824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f25a9-b911-40bd-8925-c033d388407f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:58.677076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f25a9-b911-40bd-8925-c033d388407f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:58.682222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bae281-d7ad-4b57-a50b-20b812190b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:58.683121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bae281-d7ad-4b57-a50b-20b812190b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:58.683388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bae281-d7ad-4b57-a50b-20b812190b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:58.683858 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bae281-d7ad-4b57-a50b-20b812190b24 admin admin] PATH_INFO: `/v3/projects/ce078ef00c3641a599399caaad3683ab/users/96eec105e5a14a458bd5650ab46d4076/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:58.700418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bae281-d7ad-4b57-a50b-20b812190b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce078ef00c3641a599399caaad3683ab, user_id=96eec105e5a14a458bd5650ab46d4076, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:58.704434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bae281-d7ad-4b57-a50b-20b812190b24 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:58.732584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b5735-cc95-449b-a88e-e683a9f818be None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:58.732955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b5735-cc95-449b-a88e-e683a9f818be None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:58.733317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b5735-cc95-449b-a88e-e683a9f818be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:58.736166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1135/2269] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:58 2022] PUT /identity/v3/projects/ce078ef00c3641a599399caaad3683ab/users/96eec105e5a14a458bd5650ab46d4076/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:58.764278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-193b5735-cc95-449b-a88e-e683a9f818be None None] MFA Rules not processed for user `96eec105e5a14a458bd5650ab46d4076`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:58.766152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-193b5735-cc95-449b-a88e-e683a9f818be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:58.775881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:58.872638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1135/2270] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:58.873790 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bae281-d7ad-4b57-a50b-20b812190b24 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:58.927601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33330d57-96c8-43c9-bac6-8ef79dd297ab None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:58.928012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33330d57-96c8-43c9-bac6-8ef79dd297ab None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:58.928583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33330d57-96c8-43c9-bac6-8ef79dd297ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:58.948772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-33330d57-96c8-43c9-bac6-8ef79dd297ab None None] MFA Rules not processed for user `90f0f8e04a9e412b93411903705dd45f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:58.950178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-33330d57-96c8-43c9-bac6-8ef79dd297ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:59.008531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bae281-d7ad-4b57-a50b-20b812190b24 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:59.017792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638a52e-7579-4773-9e27-de8c9dc20e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:59.018474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638a52e-7579-4773-9e27-de8c9dc20e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:59.018771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638a52e-7579-4773-9e27-de8c9dc20e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:59.019217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638a52e-7579-4773-9e27-de8c9dc20e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:59.019939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638a52e-7579-4773-9e27-de8c9dc20e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:59.024702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638a52e-7579-4773-9e27-de8c9dc20e9d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:59.074378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1136/2271] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:24:59.077835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1136/2272] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:24:58 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:59.083012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33330d57-96c8-43c9-bac6-8ef79dd297ab None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:59.099648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33330d57-96c8-43c9-bac6-8ef79dd297ab None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:59.180355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab5fa-0bbc-4398-b3e5-92bd28ba3487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:59.181079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab5fa-0bbc-4398-b3e5-92bd28ba3487 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:59.181416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab5fa-0bbc-4398-b3e5-92bd28ba3487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:59.181704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab5fa-0bbc-4398-b3e5-92bd28ba3487 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:59.182572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bab5fa-0bbc-4398-b3e5-92bd28ba3487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:59.184676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bab5fa-0bbc-4398-b3e5-92bd28ba3487 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:59.210676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1137/2273] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:24:59 2022] POST /identity/v3/users => generated 297 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:24:59.214541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638a52e-7579-4773-9e27-de8c9dc20e9d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:59.231588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638a52e-7579-4773-9e27-de8c9dc20e9d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:59.241010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5574e-172b-4b5d-854c-854dd224bfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:59.241855 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5574e-172b-4b5d-854c-854dd224bfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:59.242394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5574e-172b-4b5d-854c-854dd224bfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:59.242762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5574e-172b-4b5d-854c-854dd224bfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:59.244798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5574e-172b-4b5d-854c-854dd224bfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:59.247600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5574e-172b-4b5d-854c-854dd224bfb0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:59.270566 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1137/2274] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:24:59.274541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab5fa-0bbc-4398-b3e5-92bd28ba3487 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:59.290276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab5fa-0bbc-4398-b3e5-92bd28ba3487 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:59.298042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105598e-8394-4fca-88b5-d6cb2404590d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:59.298944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105598e-8394-4fca-88b5-d6cb2404590d admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:59.299326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105598e-8394-4fca-88b5-d6cb2404590d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:59.299494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105598e-8394-4fca-88b5-d6cb2404590d admin admin] PATH_INFO: `/v3/projects/441babb76dd74b8187a1aa81929c719e/users/a4e7d92b159e4a53af6c16b3985a1b99/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:59.327502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105598e-8394-4fca-88b5-d6cb2404590d admin admin] RBAC: Authorizing `identity:create_grant(project_id=441babb76dd74b8187a1aa81929c719e, user_id=a4e7d92b159e4a53af6c16b3985a1b99, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:59.331163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105598e-8394-4fca-88b5-d6cb2404590d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:59.351169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1138/2275] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:59 2022] PUT /identity/v3/projects/441babb76dd74b8187a1aa81929c719e/users/a4e7d92b159e4a53af6c16b3985a1b99/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:59.356376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5574e-172b-4b5d-854c-854dd224bfb0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:59.367625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5574e-172b-4b5d-854c-854dd224bfb0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:59.452607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fbdfa-43bf-4972-89fb-0841bb296618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:59.453851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fbdfa-43bf-4972-89fb-0841bb296618 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:59.454143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fbdfa-43bf-4972-89fb-0841bb296618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:59.454605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fbdfa-43bf-4972-89fb-0841bb296618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:59.455492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fbdfa-43bf-4972-89fb-0841bb296618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:59.457007 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fbdfa-43bf-4972-89fb-0841bb296618 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:59.470643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1138/2276] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:24:59.471889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105598e-8394-4fca-88b5-d6cb2404590d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:59.484843 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105598e-8394-4fca-88b5-d6cb2404590d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:59.490062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9cc38-ed03-4e01-8ced-9ea42be53898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:59.490958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9cc38-ed03-4e01-8ced-9ea42be53898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:59.491243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9cc38-ed03-4e01-8ced-9ea42be53898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:59.491521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9cc38-ed03-4e01-8ced-9ea42be53898 admin admin] PATH_INFO: `/v3/projects/441babb76dd74b8187a1aa81929c719e/users/a4e7d92b159e4a53af6c16b3985a1b99/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:59.493628 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9cc38-ed03-4e01-8ced-9ea42be53898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=441babb76dd74b8187a1aa81929c719e, user_id=a4e7d92b159e4a53af6c16b3985a1b99, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:59.496480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9cc38-ed03-4e01-8ced-9ea42be53898 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:59.521191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1139/2277] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:24:59 2022] PUT /identity/v3/projects/441babb76dd74b8187a1aa81929c719e/users/a4e7d92b159e4a53af6c16b3985a1b99/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:24:59.533315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd37f-434d-4263-aed4-a56a6b09cb3c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:59.533837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd37f-434d-4263-aed4-a56a6b09cb3c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:59.534222 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbd37f-434d-4263-aed4-a56a6b09cb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:59.590881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8bfbd37f-434d-4263-aed4-a56a6b09cb3c None None] MFA Rules not processed for user `a4e7d92b159e4a53af6c16b3985a1b99`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:59.596676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8bfbd37f-434d-4263-aed4-a56a6b09cb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:59.616533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:59.748905 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1139/2278] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:24:59.762339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9cc38-ed03-4e01-8ced-9ea42be53898 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:24:59.764134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3fe9cc38-ed03-4e01-8ced-9ea42be53898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:24:59.775061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:24:59.874716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9cc38-ed03-4e01-8ced-9ea42be53898 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:24:59.881376 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716c47b-5953-4566-b855-5113a2fd70d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:24:59.882041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716c47b-5953-4566-b855-5113a2fd70d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:59.882323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716c47b-5953-4566-b855-5113a2fd70d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:59.882604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716c47b-5953-4566-b855-5113a2fd70d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:59.901826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716c47b-5953-4566-b855-5113a2fd70d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:24:59.903460 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716c47b-5953-4566-b855-5113a2fd70d9 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:24:59.928815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1140/2279] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:24:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:24:59.944267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680469-56bb-4acf-b408-10dc33d08f34 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:24:59.944743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680469-56bb-4acf-b408-10dc33d08f34 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:24:59.944834 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680469-56bb-4acf-b408-10dc33d08f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:24:59.992078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-34680469-56bb-4acf-b408-10dc33d08f34 None None] MFA Rules not processed for user `bff805aa627b4ee3b2d9241b13e58780`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:24:59.995901 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-34680469-56bb-4acf-b408-10dc33d08f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:00.160242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1140/2280] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:24:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:00.166210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716c47b-5953-4566-b855-5113a2fd70d9 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:00.169214 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b716c47b-5953-4566-b855-5113a2fd70d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:00.292606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716c47b-5953-4566-b855-5113a2fd70d9 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:00.301504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf70d72-1e71-4b48-b4af-10df58f19f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:00.302261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70d72-1e71-4b48-b4af-10df58f19f7b service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:00.302738 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70d72-1e71-4b48-b4af-10df58f19f7b service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:00.303061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70d72-1e71-4b48-b4af-10df58f19f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:00.305648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dcf70d72-1e71-4b48-b4af-10df58f19f7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:00.459808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf70d72-1e71-4b48-b4af-10df58f19f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:00.463677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf70d72-1e71-4b48-b4af-10df58f19f7b service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:00.494773 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1141/2281] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:25:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:25:00.496382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34680469-56bb-4acf-b408-10dc33d08f34 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:00.510124 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34680469-56bb-4acf-b408-10dc33d08f34 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:00.518158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476c1a7-cb68-4c79-a3c2-05db3761aad1 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e7d92b159e4a53af6c16b3985a1b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441babb76dd74b8187a1aa81929c719e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:00.519114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476c1a7-cb68-4c79-a3c2-05db3761aad1 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:00.519405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476c1a7-cb68-4c79-a3c2-05db3761aad1 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:00.519979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476c1a7-cb68-4c79-a3c2-05db3761aad1 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:00.521257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476c1a7-cb68-4c79-a3c2-05db3761aad1 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:25:00.523167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476c1a7-cb68-4c79-a3c2-05db3761aad1 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:00.525864 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476c1a7-cb68-4c79-a3c2-05db3761aad1 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:00.557887 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1141/2282] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:25:00.560603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf70d72-1e71-4b48-b4af-10df58f19f7b service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:00.582777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf70d72-1e71-4b48-b4af-10df58f19f7b service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:00.597837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058fe05-4463-4592-beea-7d537c19d899 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e7d92b159e4a53af6c16b3985a1b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441babb76dd74b8187a1aa81929c719e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:00.598776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058fe05-4463-4592-beea-7d537c19d899 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:00.599259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058fe05-4463-4592-beea-7d537c19d899 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:00.599685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058fe05-4463-4592-beea-7d537c19d899 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:00.603091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058fe05-4463-4592-beea-7d537c19d899 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:00.605419 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058fe05-4463-4592-beea-7d537c19d899 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:00.675076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1142/2283] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:25:00 2022] POST /identity/v3/projects => generated 355 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:25:00.678999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476c1a7-cb68-4c79-a3c2-05db3761aad1 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:00.696505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476c1a7-cb68-4c79-a3c2-05db3761aad1 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:00.857177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2de2b-be0e-44b9-8af6-ea81eb9479ba tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e7d92b159e4a53af6c16b3985a1b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441babb76dd74b8187a1aa81929c719e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:00.858112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2de2b-be0e-44b9-8af6-ea81eb9479ba tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:00.858541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2de2b-be0e-44b9-8af6-ea81eb9479ba tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:00.858810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2de2b-be0e-44b9-8af6-ea81eb9479ba tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:00.860617 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2de2b-be0e-44b9-8af6-ea81eb9479ba tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:25:00.861167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2de2b-be0e-44b9-8af6-ea81eb9479ba tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:00.862812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2de2b-be0e-44b9-8af6-ea81eb9479ba tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:00.880062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1142/2284] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:25:00.929549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058fe05-4463-4592-beea-7d537c19d899 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:00.944672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058fe05-4463-4592-beea-7d537c19d899 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:00.958266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e7d92b159e4a53af6c16b3985a1b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441babb76dd74b8187a1aa81929c719e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:00.959447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:00.959702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:00.960125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] PATH_INFO: `/v3/projects/7c98156293e549038c1bd6e02af5e46b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:00.961967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7c98156293e549038c1bd6e02af5e46b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:00.964855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:00.999109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:01.036573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c98156293e549038c1bd6e02af5e46b', 'request_id': 'req-577e3da5-bb20-41f1-88cf-e88e30949de9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:01.044743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c98156293e549038c1bd6e02af5e46b', 'request_id': 'req-577e3da5-bb20-41f1-88cf-e88e30949de9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:01.051376 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c98156293e549038c1bd6e02af5e46b', 'request_id': 'req-577e3da5-bb20-41f1-88cf-e88e30949de9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:01.068702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] The token cache is being invalidate because project 7c98156293e549038c1bd6e02af5e46b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:25:01.069007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:01.069833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-577e3da5-bb20-41f1-88cf-e88e30949de9 tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:01.072063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1143/2285] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:25:00 2022] DELETE /identity/v3/projects/7c98156293e549038c1bd6e02af5e46b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:25:01.298506 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2de2b-be0e-44b9-8af6-ea81eb9479ba tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:01.300548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b7d2de2b-be0e-44b9-8af6-ea81eb9479ba tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:01.318091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:01.388189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2de2b-be0e-44b9-8af6-ea81eb9479ba tempest-VolumeQuotaClassesTest-1078459142 tempest-VolumeQuotaClassesTest-1078459142-project-admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:01.473665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:01.475710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:01.476129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:01.476556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] PATH_INFO: `/v3/users/96eec105e5a14a458bd5650ab46d4076` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:01.489463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96eec105e5a14a458bd5650ab46d4076)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:01.492473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:01.566947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96eec105e5a14a458bd5650ab46d4076'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:01.583367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96eec105e5a14a458bd5650ab46d4076'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:01.594410 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96eec105e5a14a458bd5650ab46d4076'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:01.596642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96eec105e5a14a458bd5650ab46d4076'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:01.606572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96eec105e5a14a458bd5650ab46d4076'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:01.614015 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1143/2286] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:25:01 2022] DELETE /identity/v3/users/96eec105e5a14a458bd5650ab46d4076 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:25:01.622700 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eea6c1-3cc2-4dbc-ad0c-a5e0d6ed98b2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:01.623116 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eea6c1-3cc2-4dbc-ad0c-a5e0d6ed98b2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:01.623471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eea6c1-3cc2-4dbc-ad0c-a5e0d6ed98b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:01.646408 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-99eea6c1-3cc2-4dbc-ad0c-a5e0d6ed98b2 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:01.647800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-99eea6c1-3cc2-4dbc-ad0c-a5e0d6ed98b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:01.754514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1144/2287] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:01.761859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:01.763679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:01.850393 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:01.880821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2b7a8-a6d8-4432-ae82-37497858aca4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:01.885378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778df5-d55d-4416-a23e-a308fb6e8dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:01.886078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778df5-d55d-4416-a23e-a308fb6e8dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:01.886362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778df5-d55d-4416-a23e-a308fb6e8dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:01.886643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778df5-d55d-4416-a23e-a308fb6e8dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:01.916565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0778df5-d55d-4416-a23e-a308fb6e8dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:01.918436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0778df5-d55d-4416-a23e-a308fb6e8dd4 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:01.951588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1144/2288] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:25:02.600508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f669f-055a-4e47-a3f8-66ac6945889b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:02.600745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f669f-055a-4e47-a3f8-66ac6945889b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:02.601113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f669f-055a-4e47-a3f8-66ac6945889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:02.655662 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d40f669f-055a-4e47-a3f8-66ac6945889b None None] MFA Rules not processed for user `2e95d22987c0471ba3007d00075850c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:02.664141 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d40f669f-055a-4e47-a3f8-66ac6945889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:02.805201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1145/2289] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:03.163537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778df5-d55d-4416-a23e-a308fb6e8dd4 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:03.166263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0778df5-d55d-4416-a23e-a308fb6e8dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:03.214457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778df5-d55d-4416-a23e-a308fb6e8dd4 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:03.230424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:03.234371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:03.234798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:03.237570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] PATH_INFO: `/v3/projects/ce078ef00c3641a599399caaad3683ab` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:03.240799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce078ef00c3641a599399caaad3683ab)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:03.247792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:03.383519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce078ef00c3641a599399caaad3683ab', 'request_id': 'req-7587bdb5-55b1-450b-b198-843ff87fa713'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:03.395319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce078ef00c3641a599399caaad3683ab', 'request_id': 'req-7587bdb5-55b1-450b-b198-843ff87fa713'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:03.423098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce078ef00c3641a599399caaad3683ab', 'request_id': 'req-7587bdb5-55b1-450b-b198-843ff87fa713'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:03.452464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] The token cache is being invalidate because project ce078ef00c3641a599399caaad3683ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:25:03.453842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:03.455226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:03.459396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1145/2290] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:25:03 2022] DELETE /identity/v3/projects/ce078ef00c3641a599399caaad3683ab => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:25:03.464282 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f669f-055a-4e47-a3f8-66ac6945889b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:03.490982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f669f-055a-4e47-a3f8-66ac6945889b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:03.643603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:03.666397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4175dc-c317-4dd3-93d8-4b86b52d5f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:03.667297 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4175dc-c317-4dd3-93d8-4b86b52d5f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:03.667580 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4175dc-c317-4dd3-93d8-4b86b52d5f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:03.668061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4175dc-c317-4dd3-93d8-4b86b52d5f46 admin admin] PATH_INFO: `/v3/users/a4e7d92b159e4a53af6c16b3985a1b99` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:03.672008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4175dc-c317-4dd3-93d8-4b86b52d5f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e7d92b159e4a53af6c16b3985a1b99)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:03.675312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4175dc-c317-4dd3-93d8-4b86b52d5f46 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:03.768382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ba4175dc-c317-4dd3-93d8-4b86b52d5f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e7d92b159e4a53af6c16b3985a1b99'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:03.786535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ba4175dc-c317-4dd3-93d8-4b86b52d5f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e7d92b159e4a53af6c16b3985a1b99'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:03.802351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ba4175dc-c317-4dd3-93d8-4b86b52d5f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e7d92b159e4a53af6c16b3985a1b99'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:03.803902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ba4175dc-c317-4dd3-93d8-4b86b52d5f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e7d92b159e4a53af6c16b3985a1b99'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:03.821924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ba4175dc-c317-4dd3-93d8-4b86b52d5f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e7d92b159e4a53af6c16b3985a1b99'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:03.837546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1146/2291] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:25:03 2022] DELETE /identity/v3/users/a4e7d92b159e4a53af6c16b3985a1b99 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:25:04.217672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:04.219364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:04.233104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587bdb5-55b1-450b-b198-843ff87fa713 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:04.304664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:04.305543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:04.305829 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:04.306109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] PATH_INFO: `/v3/projects/441babb76dd74b8187a1aa81929c719e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:04.307346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=441babb76dd74b8187a1aa81929c719e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:04.309311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:04.359484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441babb76dd74b8187a1aa81929c719e', 'request_id': 'req-f0859bae-332b-4776-a388-5bff2f7548cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:04.366860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441babb76dd74b8187a1aa81929c719e', 'request_id': 'req-f0859bae-332b-4776-a388-5bff2f7548cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:04.372750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441babb76dd74b8187a1aa81929c719e', 'request_id': 'req-f0859bae-332b-4776-a388-5bff2f7548cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:04.375470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:04.397678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] The token cache is being invalidate because project 441babb76dd74b8187a1aa81929c719e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:25:04.398056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:04.398825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f0859bae-332b-4776-a388-5bff2f7548cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:04.406934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1146/2292] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:25:04 2022] DELETE /identity/v3/projects/441babb76dd74b8187a1aa81929c719e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:25:04.407495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bedb-9a20-4e1b-8970-d16767e858bc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:04.407904 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bedb-9a20-4e1b-8970-d16767e858bc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:04.408201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bedb-9a20-4e1b-8970-d16767e858bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:04.432290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f691bedb-9a20-4e1b-8970-d16767e858bc None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:04.433543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f691bedb-9a20-4e1b-8970-d16767e858bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:04.510055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1147/2293] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:04.518847 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0d03-2439-4252-b627-6763df0094b6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:04.519141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0d03-2439-4252-b627-6763df0094b6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:04.519426 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0d03-2439-4252-b627-6763df0094b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:04.539413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-18ad0d03-2439-4252-b627-6763df0094b6 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:04.540843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-18ad0d03-2439-4252-b627-6763df0094b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:04.552461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1147/2294] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:04.553750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691bedb-9a20-4e1b-8970-d16767e858bc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:04.566987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691bedb-9a20-4e1b-8970-d16767e858bc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:04.572654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68478f40-3a36-46e8-8d30-a5140751d444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:04.573494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478f40-3a36-46e8-8d30-a5140751d444 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:04.573879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478f40-3a36-46e8-8d30-a5140751d444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:04.574259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478f40-3a36-46e8-8d30-a5140751d444 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:04.575118 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68478f40-3a36-46e8-8d30-a5140751d444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:25:04.575612 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68478f40-3a36-46e8-8d30-a5140751d444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:04.577322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68478f40-3a36-46e8-8d30-a5140751d444 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:04.596469 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1148/2295] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:25:04.597867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad0d03-2439-4252-b627-6763df0094b6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:04.608583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad0d03-2439-4252-b627-6763df0094b6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:04.616948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c985a4-55c7-4360-9d8a-75032c8fa1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:04.617394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c985a4-55c7-4360-9d8a-75032c8fa1cb admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:04.617688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c985a4-55c7-4360-9d8a-75032c8fa1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:04.617975 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c985a4-55c7-4360-9d8a-75032c8fa1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:04.618690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c985a4-55c7-4360-9d8a-75032c8fa1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:04.620967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c985a4-55c7-4360-9d8a-75032c8fa1cb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:04.656869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1148/2296] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:25:04 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:25:04.660879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68478f40-3a36-46e8-8d30-a5140751d444 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:04.672740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68478f40-3a36-46e8-8d30-a5140751d444 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:04.743570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bee00-eef1-4aae-bd77-7ec607630fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:04.744374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bee00-eef1-4aae-bd77-7ec607630fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:04.744729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bee00-eef1-4aae-bd77-7ec607630fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:04.745077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bee00-eef1-4aae-bd77-7ec607630fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:04.745857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bee00-eef1-4aae-bd77-7ec607630fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:04.748114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bee00-eef1-4aae-bd77-7ec607630fc2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:04.755190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:04.772303 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1149/2297] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:25:04 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:25:04.776122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c985a4-55c7-4360-9d8a-75032c8fa1cb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:04.788243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c985a4-55c7-4360-9d8a-75032c8fa1cb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:04.793956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1f22a-7268-44de-a0db-fae0b3ddb8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:04.794819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1f22a-7268-44de-a0db-fae0b3ddb8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:04.795174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1f22a-7268-44de-a0db-fae0b3ddb8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:04.795512 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1f22a-7268-44de-a0db-fae0b3ddb8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:04.796360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1f22a-7268-44de-a0db-fae0b3ddb8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:04.798128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1f22a-7268-44de-a0db-fae0b3ddb8d5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:04.818082 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1149/2298] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:25:04.822268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bee00-eef1-4aae-bd77-7ec607630fc2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:04.834017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bee00-eef1-4aae-bd77-7ec607630fc2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:04.839045 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3eb842-6b2c-4ba2-ad39-536c49e9c2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:04.839723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eb842-6b2c-4ba2-ad39-536c49e9c2af admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:04.840036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eb842-6b2c-4ba2-ad39-536c49e9c2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:04.840332 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eb842-6b2c-4ba2-ad39-536c49e9c2af admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:04.841079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3eb842-6b2c-4ba2-ad39-536c49e9c2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:04.842812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3eb842-6b2c-4ba2-ad39-536c49e9c2af admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:04.854911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1150/2299] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:25:04.859367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1f22a-7268-44de-a0db-fae0b3ddb8d5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:04.872250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1f22a-7268-44de-a0db-fae0b3ddb8d5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:04.877867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db081f82-e3ae-4fdf-bd27-4bd39e8b507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:04.878774 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db081f82-e3ae-4fdf-bd27-4bd39e8b507e admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:04.879056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db081f82-e3ae-4fdf-bd27-4bd39e8b507e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:04.879339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db081f82-e3ae-4fdf-bd27-4bd39e8b507e admin admin] PATH_INFO: `/v3/projects/e21b0b533bee45f5b961b0b226a2ca58/users/733f9ce179894e739b62dc903d9e784f/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:04.896302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db081f82-e3ae-4fdf-bd27-4bd39e8b507e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21b0b533bee45f5b961b0b226a2ca58, user_id=733f9ce179894e739b62dc903d9e784f, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:04.899075 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db081f82-e3ae-4fdf-bd27-4bd39e8b507e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:04.913378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1150/2300] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:25:04 2022] PUT /identity/v3/projects/e21b0b533bee45f5b961b0b226a2ca58/users/733f9ce179894e739b62dc903d9e784f/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:25:04.918418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ab7f-4cf0-4f74-afaa-03eca867b63b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:04.918803 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ab7f-4cf0-4f74-afaa-03eca867b63b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:04.919118 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ab7f-4cf0-4f74-afaa-03eca867b63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:04.937166 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9f40ab7f-4cf0-4f74-afaa-03eca867b63b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:04.938390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9f40ab7f-4cf0-4f74-afaa-03eca867b63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:05.034425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1151/2301] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:05.043917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db081f82-e3ae-4fdf-bd27-4bd39e8b507e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:05.045790 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-db081f82-e3ae-4fdf-bd27-4bd39e8b507e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:05.112329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db081f82-e3ae-4fdf-bd27-4bd39e8b507e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:05.115951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca63ed5-bbfd-49b4-ba3b-d299d270cf68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:05.116810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca63ed5-bbfd-49b4-ba3b-d299d270cf68 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:05.117096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca63ed5-bbfd-49b4-ba3b-d299d270cf68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:05.117375 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca63ed5-bbfd-49b4-ba3b-d299d270cf68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:05.127782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca63ed5-bbfd-49b4-ba3b-d299d270cf68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:05.129278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca63ed5-bbfd-49b4-ba3b-d299d270cf68 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:05.139166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1151/2302] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:25:10.758881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc519fe-9bcf-428e-b65b-7c816b4a73c1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:10.763025 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc519fe-9bcf-428e-b65b-7c816b4a73c1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:10.763285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc519fe-9bcf-428e-b65b-7c816b4a73c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:10.811694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2fc519fe-9bcf-428e-b65b-7c816b4a73c1 None None] MFA Rules not processed for user `733f9ce179894e739b62dc903d9e784f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:10.811694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2fc519fe-9bcf-428e-b65b-7c816b4a73c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:10.895212 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1152/2303] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:10.899104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca63ed5-bbfd-49b4-ba3b-d299d270cf68 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:10.910368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca63ed5-bbfd-49b4-ba3b-d299d270cf68 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:10.918061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbfb99-7076-4cd5-9429-5468b49584b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:10.918918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbfb99-7076-4cd5-9429-5468b49584b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:10.919041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbfb99-7076-4cd5-9429-5468b49584b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:10.919274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbfb99-7076-4cd5-9429-5468b49584b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:10.919978 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbfb99-7076-4cd5-9429-5468b49584b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:10.922049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbfb99-7076-4cd5-9429-5468b49584b9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:10.956405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1152/2304] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:25:10 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:25:10.957619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc519fe-9bcf-428e-b65b-7c816b4a73c1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:10.970054 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc519fe-9bcf-428e-b65b-7c816b4a73c1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:11.028061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a31e3-59e3-4669-a385-a42eee95f39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:11.028775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a31e3-59e3-4669-a385-a42eee95f39e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:11.029056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a31e3-59e3-4669-a385-a42eee95f39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:11.029333 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a31e3-59e3-4669-a385-a42eee95f39e admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:11.030202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a31e3-59e3-4669-a385-a42eee95f39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:11.032529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a31e3-59e3-4669-a385-a42eee95f39e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:11.050077 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:11.062276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1153/2305] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:25:10 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:25:11.063601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbfb99-7076-4cd5-9429-5468b49584b9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:11.074367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbfb99-7076-4cd5-9429-5468b49584b9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:11.080142 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdc3b3-2741-4df5-8f54-6ba86f84c264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:11.080979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdc3b3-2741-4df5-8f54-6ba86f84c264 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:11.081418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdc3b3-2741-4df5-8f54-6ba86f84c264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:11.081794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdc3b3-2741-4df5-8f54-6ba86f84c264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:11.082634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdc3b3-2741-4df5-8f54-6ba86f84c264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:11.084359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdc3b3-2741-4df5-8f54-6ba86f84c264 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:11.096435 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1153/2306] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:25:11.100649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a31e3-59e3-4669-a385-a42eee95f39e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:11.112008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a31e3-59e3-4669-a385-a42eee95f39e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:11.116856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eba6ea-c67d-4604-8c9e-262d4f9f2a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:11.117749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba6ea-c67d-4604-8c9e-262d4f9f2a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:11.118034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba6ea-c67d-4604-8c9e-262d4f9f2a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:11.118311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba6ea-c67d-4604-8c9e-262d4f9f2a0c admin admin] PATH_INFO: `/v3/projects/cfc064c859914edda3db692ebf54f2a7/users/7a4ec88d2d694e648a23710990cf9c81/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:11.137020 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eba6ea-c67d-4604-8c9e-262d4f9f2a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc064c859914edda3db692ebf54f2a7, user_id=7a4ec88d2d694e648a23710990cf9c81, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:11.139641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eba6ea-c67d-4604-8c9e-262d4f9f2a0c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:11.157039 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1154/2307] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:25:11 2022] PUT /identity/v3/projects/cfc064c859914edda3db692ebf54f2a7/users/7a4ec88d2d694e648a23710990cf9c81/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:25:11.161188 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdc3b3-2741-4df5-8f54-6ba86f84c264 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:11.182949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdc3b3-2741-4df5-8f54-6ba86f84c264 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:11.243032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04f663-66a9-4515-9bba-2b7c005f4fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:11.243943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f663-66a9-4515-9bba-2b7c005f4fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:11.244337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f663-66a9-4515-9bba-2b7c005f4fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:11.244696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f663-66a9-4515-9bba-2b7c005f4fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:11.245515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04f663-66a9-4515-9bba-2b7c005f4fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:11.247224 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04f663-66a9-4515-9bba-2b7c005f4fe8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:11.248769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:11.262702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1154/2308] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:25:11.263828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eba6ea-c67d-4604-8c9e-262d4f9f2a0c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:11.274997 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eba6ea-c67d-4604-8c9e-262d4f9f2a0c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:11.279829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c400dde-bcea-4466-8920-2f7c3d6379d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:11.281298 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c400dde-bcea-4466-8920-2f7c3d6379d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:11.281582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c400dde-bcea-4466-8920-2f7c3d6379d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:11.281856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c400dde-bcea-4466-8920-2f7c3d6379d2 admin admin] PATH_INFO: `/v3/projects/cfc064c859914edda3db692ebf54f2a7/users/7a4ec88d2d694e648a23710990cf9c81/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:11.283916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c400dde-bcea-4466-8920-2f7c3d6379d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc064c859914edda3db692ebf54f2a7, user_id=7a4ec88d2d694e648a23710990cf9c81, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:11.286751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c400dde-bcea-4466-8920-2f7c3d6379d2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:11.298202 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1155/2309] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:25:11 2022] PUT /identity/v3/projects/cfc064c859914edda3db692ebf54f2a7/users/7a4ec88d2d694e648a23710990cf9c81/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:25:16.881270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4eb68-735b-44bb-ad5c-f32da8166158 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:16.882178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4eb68-735b-44bb-ad5c-f32da8166158 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:16.882452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4eb68-735b-44bb-ad5c-f32da8166158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:16.921717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0fc4eb68-735b-44bb-ad5c-f32da8166158 None None] MFA Rules not processed for user `7a4ec88d2d694e648a23710990cf9c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:16.923124 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0fc4eb68-735b-44bb-ad5c-f32da8166158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:16.994744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1155/2310] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:17.007031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c400dde-bcea-4466-8920-2f7c3d6379d2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:17.009255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7c400dde-bcea-4466-8920-2f7c3d6379d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:17.071704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c400dde-bcea-4466-8920-2f7c3d6379d2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:17.075479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24fe98-e2fa-4dd6-b69b-bd3abd34ab3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd82125a47ce044b389684b97c7097ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:17.076580 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24fe98-e2fa-4dd6-b69b-bd3abd34ab3a service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:17.076859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24fe98-e2fa-4dd6-b69b-bd3abd34ab3a service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:17.077284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24fe98-e2fa-4dd6-b69b-bd3abd34ab3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:17.148715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24fe98-e2fa-4dd6-b69b-bd3abd34ab3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:17.150313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24fe98-e2fa-4dd6-b69b-bd3abd34ab3a service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:17.160971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1156/2311] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:25:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:25:17.273846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46797b24-78dc-4281-b5b3-e7990bdfb0f3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:17.274170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46797b24-78dc-4281-b5b3-e7990bdfb0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:17.274463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46797b24-78dc-4281-b5b3-e7990bdfb0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:17.293395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-46797b24-78dc-4281-b5b3-e7990bdfb0f3 None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:17.294599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-46797b24-78dc-4281-b5b3-e7990bdfb0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:17.386485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1156/2312] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:25:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:17.436313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24fe98-e2fa-4dd6-b69b-bd3abd34ab3a service glance] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:17.438893 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4d24fe98-e2fa-4dd6-b69b-bd3abd34ab3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:17.528870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24fe98-e2fa-4dd6-b69b-bd3abd34ab3a service glance] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:17.539442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56792d-4160-4aa7-9f44-e535adbcda2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:17.540738 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56792d-4160-4aa7-9f44-e535adbcda2c service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:17.541519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56792d-4160-4aa7-9f44-e535adbcda2c service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:17.542011 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56792d-4160-4aa7-9f44-e535adbcda2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:17.554549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56792d-4160-4aa7-9f44-e535adbcda2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:17.556351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56792d-4160-4aa7-9f44-e535adbcda2c service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:17.593092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1157/2313] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:25:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:25:25.158336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46797b24-78dc-4281-b5b3-e7990bdfb0f3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:25.160509 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-46797b24-78dc-4281-b5b3-e7990bdfb0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:25.259620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46797b24-78dc-4281-b5b3-e7990bdfb0f3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:25.268220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:25.269353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:25.269741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:25.270127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] PATH_INFO: `/v3/users/596fdda6cba74e049aa4b8e61c7da558` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:25.271539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=596fdda6cba74e049aa4b8e61c7da558)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:25.273771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:25.323867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:25.361263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596fdda6cba74e049aa4b8e61c7da558'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:25.374488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596fdda6cba74e049aa4b8e61c7da558'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:25.386368 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596fdda6cba74e049aa4b8e61c7da558'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:25.386787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596fdda6cba74e049aa4b8e61c7da558'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:25.401967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596fdda6cba74e049aa4b8e61c7da558'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:25.410405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1157/2314] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:25:25 2022] DELETE /identity/v3/users/596fdda6cba74e049aa4b8e61c7da558 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:25:25.414693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21bbf7-dd9a-45b2-873b-3de623181d4b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:25.415643 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21bbf7-dd9a-45b2-873b-3de623181d4b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:25.416181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21bbf7-dd9a-45b2-873b-3de623181d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:25.424598 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:25.444566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5f21bbf7-dd9a-45b2-873b-3de623181d4b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:25.446265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5f21bbf7-dd9a-45b2-873b-3de623181d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:25.626252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1158/2315] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:25.629388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:25.631203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:25.732425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f366e1b-e2f5-462a-82d0-c71832996b51 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:25.738837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450b7ba-8abe-49f0-ae9e-3d70bb1270b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:25.739785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450b7ba-8abe-49f0-ae9e-3d70bb1270b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:25.740343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450b7ba-8abe-49f0-ae9e-3d70bb1270b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:25.740681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450b7ba-8abe-49f0-ae9e-3d70bb1270b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:25.798482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450b7ba-8abe-49f0-ae9e-3d70bb1270b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:25.800172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450b7ba-8abe-49f0-ae9e-3d70bb1270b1 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:25.826385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1158/2316] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:25:26.196954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21bbf7-dd9a-45b2-873b-3de623181d4b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:26.198824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5f21bbf7-dd9a-45b2-873b-3de623181d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:26.219089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21bbf7-dd9a-45b2-873b-3de623181d4b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:26.230972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:26.231933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:26.232324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:26.232671 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] PATH_INFO: `/v3/projects/78fbd3bc664f469190e44538fc80259d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:26.235223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78fbd3bc664f469190e44538fc80259d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:26.238591 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:26.305589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78fbd3bc664f469190e44538fc80259d', 'request_id': 'req-efec8af0-12c7-41d6-ba64-a14b5c24c140'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:26.313314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78fbd3bc664f469190e44538fc80259d', 'request_id': 'req-efec8af0-12c7-41d6-ba64-a14b5c24c140'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:26.322362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78fbd3bc664f469190e44538fc80259d', 'request_id': 'req-efec8af0-12c7-41d6-ba64-a14b5c24c140'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:26.341524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] The token cache is being invalidate because project 78fbd3bc664f469190e44538fc80259d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:25:26.341822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:26.343400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-efec8af0-12c7-41d6-ba64-a14b5c24c140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:25:26.345386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1159/2317] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:25:26 2022] DELETE /identity/v3/projects/78fbd3bc664f469190e44538fc80259d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:25:26.351488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae159f65-d2af-4437-abaf-868cc2c601df None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:26.352038 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae159f65-d2af-4437-abaf-868cc2c601df None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:26.352126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae159f65-d2af-4437-abaf-868cc2c601df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:26.378594 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ae159f65-d2af-4437-abaf-868cc2c601df None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:26.380420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ae159f65-d2af-4437-abaf-868cc2c601df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:26.460955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1159/2318] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:26.468753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fb0d4-164b-4856-a54c-f5715cbf13ed None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:26.469251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fb0d4-164b-4856-a54c-f5715cbf13ed None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:26.469353 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fb0d4-164b-4856-a54c-f5715cbf13ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:26.489652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8b4fb0d4-164b-4856-a54c-f5715cbf13ed None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:26.491263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8b4fb0d4-164b-4856-a54c-f5715cbf13ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:26.501067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1160/2319] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:26.505361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae159f65-d2af-4437-abaf-868cc2c601df None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:26.516932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae159f65-d2af-4437-abaf-868cc2c601df None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:26.521762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3905e-0e15-4e77-923d-fb54c83f850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:26.522431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3905e-0e15-4e77-923d-fb54c83f850c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:26.522718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3905e-0e15-4e77-923d-fb54c83f850c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:26.522999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3905e-0e15-4e77-923d-fb54c83f850c admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:26.523732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3905e-0e15-4e77-923d-fb54c83f850c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:25:26.524068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3905e-0e15-4e77-923d-fb54c83f850c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:26.528011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3905e-0e15-4e77-923d-fb54c83f850c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:26.539479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1160/2320] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:25:26.545165 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fb0d4-164b-4856-a54c-f5715cbf13ed None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:26.555440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fb0d4-164b-4856-a54c-f5715cbf13ed None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:26.560257 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e502d-e402-4166-aee1-d0b90cf176ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:26.561248 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e502d-e402-4166-aee1-d0b90cf176ed admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:26.561775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e502d-e402-4166-aee1-d0b90cf176ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:26.562279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e502d-e402-4166-aee1-d0b90cf176ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:26.563205 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e502d-e402-4166-aee1-d0b90cf176ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:26.565439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e502d-e402-4166-aee1-d0b90cf176ed admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:26.597963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1161/2321] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:25:26 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:25:26.602322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3905e-0e15-4e77-923d-fb54c83f850c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:26.625977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3905e-0e15-4e77-923d-fb54c83f850c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:26.664499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:26.699556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222170ad-226e-4413-a6b7-828d021d8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:26.700648 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222170ad-226e-4413-a6b7-828d021d8020 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:26.701151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222170ad-226e-4413-a6b7-828d021d8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:26.702262 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222170ad-226e-4413-a6b7-828d021d8020 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:26.706470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222170ad-226e-4413-a6b7-828d021d8020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:26.708585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222170ad-226e-4413-a6b7-828d021d8020 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:26.739474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1161/2322] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:25:26 2022] POST /identity/v3/users => generated 282 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:25:26.743507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e502d-e402-4166-aee1-d0b90cf176ed admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:26.757982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e502d-e402-4166-aee1-d0b90cf176ed admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:26.764174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839dd7f-c02b-42f2-878e-aae668ccf41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:26.766004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839dd7f-c02b-42f2-878e-aae668ccf41d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:26.766220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839dd7f-c02b-42f2-878e-aae668ccf41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:26.766575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839dd7f-c02b-42f2-878e-aae668ccf41d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:26.767319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839dd7f-c02b-42f2-878e-aae668ccf41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:26.768970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839dd7f-c02b-42f2-878e-aae668ccf41d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:26.784060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1162/2323] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:25:26.787485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222170ad-226e-4413-a6b7-828d021d8020 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:26.801202 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222170ad-226e-4413-a6b7-828d021d8020 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:26.813340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c1514-9cce-48b8-9fce-98f5eaeba6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:26.813340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c1514-9cce-48b8-9fce-98f5eaeba6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:26.813340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c1514-9cce-48b8-9fce-98f5eaeba6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:26.813340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c1514-9cce-48b8-9fce-98f5eaeba6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:26.813833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c1514-9cce-48b8-9fce-98f5eaeba6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:26.813833 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c1514-9cce-48b8-9fce-98f5eaeba6ff admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:26.829736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1162/2324] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:25:26.829925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839dd7f-c02b-42f2-878e-aae668ccf41d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:26.842436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839dd7f-c02b-42f2-878e-aae668ccf41d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:26.849798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083770-8ea4-4360-aaca-95e23842cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:26.850693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083770-8ea4-4360-aaca-95e23842cfe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:26.851002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083770-8ea4-4360-aaca-95e23842cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:26.851276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083770-8ea4-4360-aaca-95e23842cfe5 admin admin] PATH_INFO: `/v3/projects/b2ea3d1b601c499687bb62d6825b4529/users/bf2a56bfd6a0429c80a8f7b6d5f60135/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:26.869671 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083770-8ea4-4360-aaca-95e23842cfe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ea3d1b601c499687bb62d6825b4529, user_id=bf2a56bfd6a0429c80a8f7b6d5f60135, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:26.872413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083770-8ea4-4360-aaca-95e23842cfe5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:26.891488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1163/2325] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:25:26 2022] PUT /identity/v3/projects/b2ea3d1b601c499687bb62d6825b4529/users/bf2a56bfd6a0429c80a8f7b6d5f60135/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:25:26.898816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd7f76-07d1-4301-8561-8a4cf0b7aa2d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:26.898816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd7f76-07d1-4301-8561-8a4cf0b7aa2d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:26.899068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd7f76-07d1-4301-8561-8a4cf0b7aa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:26.927367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a4cd7f76-07d1-4301-8561-8a4cf0b7aa2d None None] MFA Rules not processed for user `bf2a56bfd6a0429c80a8f7b6d5f60135`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:26.929074 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a4cd7f76-07d1-4301-8561-8a4cf0b7aa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:27.005002 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1163/2326] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:27.019430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083770-8ea4-4360-aaca-95e23842cfe5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:27.020327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-48083770-8ea4-4360-aaca-95e23842cfe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:27.060117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:27.105905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083770-8ea4-4360-aaca-95e23842cfe5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:27.113108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0a229-5bf7-4e44-b054-15d2edb9d95a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:27.113766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0a229-5bf7-4e44-b054-15d2edb9d95a service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:27.114058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0a229-5bf7-4e44-b054-15d2edb9d95a service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:27.114346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0a229-5bf7-4e44-b054-15d2edb9d95a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:27.126663 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0a229-5bf7-4e44-b054-15d2edb9d95a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:27.130301 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0a229-5bf7-4e44-b054-15d2edb9d95a service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:27.142065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1164/2327] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:25:28.743949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dde30-4c94-4e46-aa1c-c329daf87b1a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:28.744535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dde30-4c94-4e46-aa1c-c329daf87b1a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:28.744535 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dde30-4c94-4e46-aa1c-c329daf87b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:28.761666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bf6dde30-4c94-4e46-aa1c-c329daf87b1a None None] MFA Rules not processed for user `733f9ce179894e739b62dc903d9e784f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:28.762844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bf6dde30-4c94-4e46-aa1c-c329daf87b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:28.818229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1164/2328] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:25:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:30.101228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177e4f8-27ae-4b93-81aa-435b59bad844 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:30.101809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177e4f8-27ae-4b93-81aa-435b59bad844 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:30.101809 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177e4f8-27ae-4b93-81aa-435b59bad844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:30.124956 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d177e4f8-27ae-4b93-81aa-435b59bad844 None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:30.126290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d177e4f8-27ae-4b93-81aa-435b59bad844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:30.212091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1165/2329] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:25:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:30.230672 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dde30-4c94-4e46-aa1c-c329daf87b1a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:30.232209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bf6dde30-4c94-4e46-aa1c-c329daf87b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:30.332099 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:30.361919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dde30-4c94-4e46-aa1c-c329daf87b1a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:30.368315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866de51-4188-4a83-9add-db40291e4984 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:30.368979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866de51-4188-4a83-9add-db40291e4984 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:30.369270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866de51-4188-4a83-9add-db40291e4984 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:30.369556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866de51-4188-4a83-9add-db40291e4984 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:30.380322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866de51-4188-4a83-9add-db40291e4984 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:30.381794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866de51-4188-4a83-9add-db40291e4984 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:30.391286 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1165/2330] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:25:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:25:34.289530 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f497f86-52f6-45c7-a30a-459e49e7603b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:34.290144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f497f86-52f6-45c7-a30a-459e49e7603b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:34.290144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f497f86-52f6-45c7-a30a-459e49e7603b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:34.327619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2f497f86-52f6-45c7-a30a-459e49e7603b None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:34.330403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2f497f86-52f6-45c7-a30a-459e49e7603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:34.351912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1166/2331] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:34.364310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866de51-4188-4a83-9add-db40291e4984 service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:34.383952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866de51-4188-4a83-9add-db40291e4984 service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:34.405060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff4138-71b4-4661-9174-dd960f2dcbcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:34.405755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4138-71b4-4661-9174-dd960f2dcbcb service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:34.406047 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4138-71b4-4661-9174-dd960f2dcbcb service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:34.406336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4138-71b4-4661-9174-dd960f2dcbcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:34.447362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff4138-71b4-4661-9174-dd960f2dcbcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:34.449066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff4138-71b4-4661-9174-dd960f2dcbcb service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:34.512793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1166/2332] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:25:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:25:44.311569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=43 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:44.477127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=16 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:25:57.800895 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ca37f-2fb0-4d03-8177-f16ad8bd1dbf None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:57.801420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ca37f-2fb0-4d03-8177-f16ad8bd1dbf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:57.801564 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ca37f-2fb0-4d03-8177-f16ad8bd1dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:57.834139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-097ca37f-2fb0-4d03-8177-f16ad8bd1dbf None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:25:57.835355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-097ca37f-2fb0-4d03-8177-f16ad8bd1dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:25:57.863105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1167/2333] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:25:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:25:57.876997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff4138-71b4-4661-9174-dd960f2dcbcb service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:25:57.918906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff4138-71b4-4661-9174-dd960f2dcbcb service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:25:57.929191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368baa7f-857a-482a-8a47-6c4319426d97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:25:57.929861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368baa7f-857a-482a-8a47-6c4319426d97 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:25:57.930151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368baa7f-857a-482a-8a47-6c4319426d97 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:25:57.930435 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368baa7f-857a-482a-8a47-6c4319426d97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:25:57.940338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368baa7f-857a-482a-8a47-6c4319426d97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:25:57.941936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368baa7f-857a-482a-8a47-6c4319426d97 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:25:57.950021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1167/2334] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:25:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:26:02.788185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeb15f-f0dc-4967-8d5a-a92ee9c16e88 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:02.788974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeb15f-f0dc-4967-8d5a-a92ee9c16e88 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:02.788974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeb15f-f0dc-4967-8d5a-a92ee9c16e88 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:02.790825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1168/2335] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:26:02.810303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5561e-186e-418f-ba4c-49e7b6d2988e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:02.811983 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5561e-186e-418f-ba4c-49e7b6d2988e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:02.812145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5561e-186e-418f-ba4c-49e7b6d2988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:02.923646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-85b5561e-186e-418f-ba4c-49e7b6d2988e None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:02.925026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-85b5561e-186e-418f-ba4c-49e7b6d2988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:03.034344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1168/2336] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:26:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:03.047723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eeb15f-f0dc-4967-8d5a-a92ee9c16e88 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:03.049946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f3eeb15f-f0dc-4967-8d5a-a92ee9c16e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:03.128172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eeb15f-f0dc-4967-8d5a-a92ee9c16e88 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:03.133933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1717b40-2814-4426-b9be-3b4ad358c21d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd82125a47ce044b389684b97c7097ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:03.135453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1717b40-2814-4426-b9be-3b4ad358c21d service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:03.135935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1717b40-2814-4426-b9be-3b4ad358c21d service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:03.136460 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1717b40-2814-4426-b9be-3b4ad358c21d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:03.151069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1717b40-2814-4426-b9be-3b4ad358c21d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:03.153532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1717b40-2814-4426-b9be-3b4ad358c21d service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:03.169266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1169/2337] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:26:03.289826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1777-fc4a-474c-b864-e8780dc2c01e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:03.298607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1777-fc4a-474c-b864-e8780dc2c01e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:03.299100 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1777-fc4a-474c-b864-e8780dc2c01e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:03.307965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1169/2338] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:26:03 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:26:03.348126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba51b-ca5c-4bcb-962d-ea2871e1639e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:03.349569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba51b-ca5c-4bcb-962d-ea2871e1639e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:03.351315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba51b-ca5c-4bcb-962d-ea2871e1639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:03.415200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-13cba51b-ca5c-4bcb-962d-ea2871e1639e None None] MFA Rules not processed for user `b37002ecc6384dc08fca3ddf6ca2f9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:03.417670 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-13cba51b-ca5c-4bcb-962d-ea2871e1639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:03.626913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1170/2339] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:26:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:03.638382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb1777-fc4a-474c-b864-e8780dc2c01e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:03.641691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d9cb1777-fc4a-474c-b864-e8780dc2c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:03.676361 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb1777-fc4a-474c-b864-e8780dc2c01e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:03.699723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22c160-4690-45c1-82c3-8a52f188ad79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:03.704767 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22c160-4690-45c1-82c3-8a52f188ad79 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:03.706956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22c160-4690-45c1-82c3-8a52f188ad79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:03.707129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22c160-4690-45c1-82c3-8a52f188ad79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:03.738807 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22c160-4690-45c1-82c3-8a52f188ad79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:03.740337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22c160-4690-45c1-82c3-8a52f188ad79 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:03.759253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1170/2340] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:26:04.031558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203a05-21e7-432e-83ed-1444df8594b2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:04.032760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203a05-21e7-432e-83ed-1444df8594b2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:04.033126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee203a05-21e7-432e-83ed-1444df8594b2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:04.035070 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1171/2341] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:26:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:26:04.053754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9015-4f9d-467a-943a-c946bb1ed76e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:04.054288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9015-4f9d-467a-943a-c946bb1ed76e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:04.054414 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9015-4f9d-467a-943a-c946bb1ed76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:04.088505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5e2d9015-4f9d-467a-943a-c946bb1ed76e None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:04.088505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5e2d9015-4f9d-467a-943a-c946bb1ed76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:04.119159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1171/2342] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:26:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:26:04.133106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee203a05-21e7-432e-83ed-1444df8594b2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:04.164747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee203a05-21e7-432e-83ed-1444df8594b2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:04.169469 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7ce9c-9740-41ec-9178-8bde508d76ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:04.171047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7ce9c-9740-41ec-9178-8bde508d76ea service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:04.171327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7ce9c-9740-41ec-9178-8bde508d76ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:04.171645 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7ce9c-9740-41ec-9178-8bde508d76ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:04.183834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7ce9c-9740-41ec-9178-8bde508d76ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:04.185515 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7ce9c-9740-41ec-9178-8bde508d76ea service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:04.213650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1172/2343] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:26:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:26:06.101488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207d7f8-7fa2-4469-a917-8ff1ba8407dd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:06.101981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207d7f8-7fa2-4469-a917-8ff1ba8407dd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:06.102343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207d7f8-7fa2-4469-a917-8ff1ba8407dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:06.125548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3207d7f8-7fa2-4469-a917-8ff1ba8407dd None None] MFA Rules not processed for user `7f78f3daa4744f41a914c0563982b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:06.127190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3207d7f8-7fa2-4469-a917-8ff1ba8407dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:06.209444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1172/2344] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:14.192700 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=80 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:15.191879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e2f37-78ac-4f0a-ad6b-0b0ba4c0cc7f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:15.193000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e2f37-78ac-4f0a-ad6b-0b0ba4c0cc7f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:15.197382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e2f37-78ac-4f0a-ad6b-0b0ba4c0cc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:15.233116 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8e3e2f37-78ac-4f0a-ad6b-0b0ba4c0cc7f None None] MFA Rules not processed for user `bd7324f7539840b08c17d39d297eb99e`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:15.235818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8e3e2f37-78ac-4f0a-ad6b-0b0ba4c0cc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:15.365121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1173/2345] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:16.200637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:16.575108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffb596-1a52-4965-9f51-446a04e837dd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:16.575768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffb596-1a52-4965-9f51-446a04e837dd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:16.576914 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffb596-1a52-4965-9f51-446a04e837dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:16.610113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b0ffb596-1a52-4965-9f51-446a04e837dd None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:16.611354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0ffb596-1a52-4965-9f51-446a04e837dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:16.647287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1173/2346] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:26:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:16.659021 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e2f37-78ac-4f0a-ad6b-0b0ba4c0cc7f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:16.670651 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffb596-1a52-4965-9f51-446a04e837dd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:16.685941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e2f37-78ac-4f0a-ad6b-0b0ba4c0cc7f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:16.705563 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295678e-ecd5-485b-90ef-e1217bf9d59c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:16.707017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295678e-ecd5-485b-90ef-e1217bf9d59c service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:16.707630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295678e-ecd5-485b-90ef-e1217bf9d59c service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:16.708186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295678e-ecd5-485b-90ef-e1217bf9d59c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:16.729317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295678e-ecd5-485b-90ef-e1217bf9d59c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:16.733990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295678e-ecd5-485b-90ef-e1217bf9d59c service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:16.751072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1174/2347] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:26:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:26:16.892671 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffb596-1a52-4965-9f51-446a04e837dd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:16.904679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:16.905994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:16.906552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:16.907106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] PATH_INFO: `/v3/users/bf2a56bfd6a0429c80a8f7b6d5f60135` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:16.912534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2a56bfd6a0429c80a8f7b6d5f60135)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:16.915088 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:17.031026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2a56bfd6a0429c80a8f7b6d5f60135'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:17.056796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2a56bfd6a0429c80a8f7b6d5f60135'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:17.068375 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2a56bfd6a0429c80a8f7b6d5f60135'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:17.069612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2a56bfd6a0429c80a8f7b6d5f60135'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:17.083206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2a56bfd6a0429c80a8f7b6d5f60135'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:17.109398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1174/2348] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:26:16 2022] DELETE /identity/v3/users/bf2a56bfd6a0429c80a8f7b6d5f60135 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:26:17.110690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6359c8-3924-4214-a23d-fdf54cf10df0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:17.111131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6359c8-3924-4214-a23d-fdf54cf10df0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:17.111576 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6359c8-3924-4214-a23d-fdf54cf10df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:17.223108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bf6359c8-3924-4214-a23d-fdf54cf10df0 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:17.224931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bf6359c8-3924-4214-a23d-fdf54cf10df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:17.409613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1175/2349] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:17.414166 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:17.415806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:17.545257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:17.553471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cdcf1-af76-4c68-ab76-4c8dc6b6d610 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:17.578247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e839e82-997d-4cca-80de-f34049119a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:17.579387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839e82-997d-4cca-80de-f34049119a9b service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:17.579387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839e82-997d-4cca-80de-f34049119a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:17.579686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839e82-997d-4cca-80de-f34049119a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:17.604455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e839e82-997d-4cca-80de-f34049119a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:17.605956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e839e82-997d-4cca-80de-f34049119a9b service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:17.645326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1175/2350] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:26:18.301842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6359c8-3924-4214-a23d-fdf54cf10df0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:18.304434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bf6359c8-3924-4214-a23d-fdf54cf10df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:18.339497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6359c8-3924-4214-a23d-fdf54cf10df0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:18.347227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:18.349920 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:18.350929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:18.352287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] PATH_INFO: `/v3/projects/b2ea3d1b601c499687bb62d6825b4529` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:18.355357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ea3d1b601c499687bb62d6825b4529)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:18.362737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:18.483050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ea3d1b601c499687bb62d6825b4529', 'request_id': 'req-9b28939f-a576-4ce5-815d-77725b2d016b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:18.508910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ea3d1b601c499687bb62d6825b4529', 'request_id': 'req-9b28939f-a576-4ce5-815d-77725b2d016b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:18.539367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ea3d1b601c499687bb62d6825b4529', 'request_id': 'req-9b28939f-a576-4ce5-815d-77725b2d016b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:18.564707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:18.578560 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] The token cache is being invalidate because project b2ea3d1b601c499687bb62d6825b4529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:26:18.579274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:18.583929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9b28939f-a576-4ce5-815d-77725b2d016b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:18.595185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1176/2351] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:26:18 2022] DELETE /identity/v3/projects/b2ea3d1b601c499687bb62d6825b4529 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:26:18.597044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a409c0-cf20-4bd6-8c0b-db256600f93f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:18.598136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a409c0-cf20-4bd6-8c0b-db256600f93f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:18.598842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a409c0-cf20-4bd6-8c0b-db256600f93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:18.761270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-39a409c0-cf20-4bd6-8c0b-db256600f93f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:18.789502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-39a409c0-cf20-4bd6-8c0b-db256600f93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:19.071740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1176/2352] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:26:19.080865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe56e9-8a67-4c8b-a582-9c7efd356fdb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:19.080865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe56e9-8a67-4c8b-a582-9c7efd356fdb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:19.080865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe56e9-8a67-4c8b-a582-9c7efd356fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:19.124179 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f4fe56e9-8a67-4c8b-a582-9c7efd356fdb None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:19.125442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f4fe56e9-8a67-4c8b-a582-9c7efd356fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:19.158757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1177/2353] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:26:19.163553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a409c0-cf20-4bd6-8c0b-db256600f93f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:19.175400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a409c0-cf20-4bd6-8c0b-db256600f93f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:19.180537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8c776-42d2-4e02-b1bb-1806f2420ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:19.181419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c776-42d2-4e02-b1bb-1806f2420ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:19.181887 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c776-42d2-4e02-b1bb-1806f2420ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:19.182333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8c776-42d2-4e02-b1bb-1806f2420ff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:19.183312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8c776-42d2-4e02-b1bb-1806f2420ff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:26:19.183794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8c776-42d2-4e02-b1bb-1806f2420ff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:19.186314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8c776-42d2-4e02-b1bb-1806f2420ff4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:19.213608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1177/2354] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:26:19.213753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe56e9-8a67-4c8b-a582-9c7efd356fdb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:19.235162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe56e9-8a67-4c8b-a582-9c7efd356fdb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:19.249032 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddabf8-e0e3-4ff5-95a7-2ce0490a26b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:19.250012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddabf8-e0e3-4ff5-95a7-2ce0490a26b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:19.250530 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddabf8-e0e3-4ff5-95a7-2ce0490a26b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:19.250904 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddabf8-e0e3-4ff5-95a7-2ce0490a26b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:19.251721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddabf8-e0e3-4ff5-95a7-2ce0490a26b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:19.257788 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddabf8-e0e3-4ff5-95a7-2ce0490a26b1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:19.310661 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1178/2355] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:26:19 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:26:19.314712 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8c776-42d2-4e02-b1bb-1806f2420ff4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:19.330330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8c776-42d2-4e02-b1bb-1806f2420ff4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:19.441859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2efe5-b82f-4645-b4ed-425ad3d076c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:19.442395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2efe5-b82f-4645-b4ed-425ad3d076c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:19.442687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2efe5-b82f-4645-b4ed-425ad3d076c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:19.442974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2efe5-b82f-4645-b4ed-425ad3d076c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:19.443689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2efe5-b82f-4645-b4ed-425ad3d076c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:19.449466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2efe5-b82f-4645-b4ed-425ad3d076c2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:19.520170 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddabf8-e0e3-4ff5-95a7-2ce0490a26b1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:19.520575 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1178/2356] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:26:19 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:26:19.532934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddabf8-e0e3-4ff5-95a7-2ce0490a26b1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:19.537746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856c0fd-7813-4a8b-a1c4-47284f4a8773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:19.538425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c0fd-7813-4a8b-a1c4-47284f4a8773 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:19.538714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c0fd-7813-4a8b-a1c4-47284f4a8773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:19.538998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c0fd-7813-4a8b-a1c4-47284f4a8773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:19.539805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856c0fd-7813-4a8b-a1c4-47284f4a8773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:19.541774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856c0fd-7813-4a8b-a1c4-47284f4a8773 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:19.560386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1179/2357] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:26:19.561917 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2efe5-b82f-4645-b4ed-425ad3d076c2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:19.573356 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2efe5-b82f-4645-b4ed-425ad3d076c2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:19.579475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5746146-91f6-440b-a458-6db357d97c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:19.580199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5746146-91f6-440b-a458-6db357d97c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:19.580489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5746146-91f6-440b-a458-6db357d97c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:19.580768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5746146-91f6-440b-a458-6db357d97c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:19.581508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5746146-91f6-440b-a458-6db357d97c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:19.584524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5746146-91f6-440b-a458-6db357d97c33 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:19.599479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1179/2358] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:26:19.600742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856c0fd-7813-4a8b-a1c4-47284f4a8773 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:19.619238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856c0fd-7813-4a8b-a1c4-47284f4a8773 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:19.637231 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cae359-76a7-4911-b538-c9673cb97029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:19.638199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cae359-76a7-4911-b538-c9673cb97029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:19.638488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cae359-76a7-4911-b538-c9673cb97029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:19.639275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cae359-76a7-4911-b538-c9673cb97029 admin admin] PATH_INFO: `/v3/projects/68e3c5c1e08b4321b6ac7c55b0e0d92a/users/0b6bc0676dbf4349ab7fd812899cd55f/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:19.661179 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cae359-76a7-4911-b538-c9673cb97029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e3c5c1e08b4321b6ac7c55b0e0d92a, user_id=0b6bc0676dbf4349ab7fd812899cd55f, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:19.665310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cae359-76a7-4911-b538-c9673cb97029 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:19.684221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1180/2359] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:26:19 2022] PUT /identity/v3/projects/68e3c5c1e08b4321b6ac7c55b0e0d92a/users/0b6bc0676dbf4349ab7fd812899cd55f/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:26:19.695399 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d587-94b1-46de-a333-aeacd76bf714 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:19.696215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d587-94b1-46de-a333-aeacd76bf714 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:19.696777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d587-94b1-46de-a333-aeacd76bf714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:19.729172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-49a0d587-94b1-46de-a333-aeacd76bf714 None None] MFA Rules not processed for user `0b6bc0676dbf4349ab7fd812899cd55f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:19.730817 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-49a0d587-94b1-46de-a333-aeacd76bf714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:19.796478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:19.877805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cae359-76a7-4911-b538-c9673cb97029 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:19.879180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1180/2360] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:19.881111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-94cae359-76a7-4911-b538-c9673cb97029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:20.066442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cae359-76a7-4911-b538-c9673cb97029 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:20.070471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbf583-1b0a-41db-9191-8bb8866d8da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:20.071131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbf583-1b0a-41db-9191-8bb8866d8da0 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:20.071532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbf583-1b0a-41db-9191-8bb8866d8da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:20.071917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbf583-1b0a-41db-9191-8bb8866d8da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:20.091917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbf583-1b0a-41db-9191-8bb8866d8da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:20.093544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbf583-1b0a-41db-9191-8bb8866d8da0 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:20.115826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1181/2361] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:26:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:26:25.743652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0d587-94b1-46de-a333-aeacd76bf714 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:25.745252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-49a0d587-94b1-46de-a333-aeacd76bf714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:25.838924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0d587-94b1-46de-a333-aeacd76bf714 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:25.843163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5a0e7-ba5a-4587-8a66-b6799d153dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:25.843821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a0e7-ba5a-4587-8a66-b6799d153dbd service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:25.844154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a0e7-ba5a-4587-8a66-b6799d153dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:25.844440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a0e7-ba5a-4587-8a66-b6799d153dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:25.846462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-73c5a0e7-ba5a-4587-8a66-b6799d153dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:25.972794 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5a0e7-ba5a-4587-8a66-b6799d153dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:25.974500 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5a0e7-ba5a-4587-8a66-b6799d153dbd service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:25.997071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1181/2362] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:26:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:26:26.191668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b3f73-21ba-470a-a397-d3c1b01940a0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:26.192603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b3f73-21ba-470a-a397-d3c1b01940a0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:26.193057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b3f73-21ba-470a-a397-d3c1b01940a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:26.229290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3a6b3f73-21ba-470a-a397-d3c1b01940a0 None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:26.230700 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3a6b3f73-21ba-470a-a397-d3c1b01940a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:26.368012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1182/2363] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 12:26:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:26.394001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5a0e7-ba5a-4587-8a66-b6799d153dbd service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:26.395541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-73c5a0e7-ba5a-4587-8a66-b6799d153dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:26.567555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5a0e7-ba5a-4587-8a66-b6799d153dbd service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:26.580644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576fd6f-f8a7-463f-9f77-600160c4d890 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:26.583600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576fd6f-f8a7-463f-9f77-600160c4d890 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:26.583600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576fd6f-f8a7-463f-9f77-600160c4d890 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:26.583600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576fd6f-f8a7-463f-9f77-600160c4d890 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:26.594228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576fd6f-f8a7-463f-9f77-600160c4d890 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:26.626717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576fd6f-f8a7-463f-9f77-600160c4d890 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:26.673852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1182/2364] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:26:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:26:30.567467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b3f73-21ba-470a-a397-d3c1b01940a0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:30.569653 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3a6b3f73-21ba-470a-a397-d3c1b01940a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:30.613511 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:30.671413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b3f73-21ba-470a-a397-d3c1b01940a0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:30.676584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28e90-5d25-4d75-ab48-e306c89e37e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:30.677470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28e90-5d25-4d75-ab48-e306c89e37e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:30.677759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28e90-5d25-4d75-ab48-e306c89e37e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:30.678038 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28e90-5d25-4d75-ab48-e306c89e37e4 admin admin] PATH_INFO: `/v3/users/90f0f8e04a9e412b93411903705dd45f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:30.679276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f28e90-5d25-4d75-ab48-e306c89e37e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f0f8e04a9e412b93411903705dd45f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:30.681267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f28e90-5d25-4d75-ab48-e306c89e37e4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:30.793022 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-07f28e90-5d25-4d75-ab48-e306c89e37e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f0f8e04a9e412b93411903705dd45f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:30.811498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-07f28e90-5d25-4d75-ab48-e306c89e37e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f0f8e04a9e412b93411903705dd45f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:30.823426 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-07f28e90-5d25-4d75-ab48-e306c89e37e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f0f8e04a9e412b93411903705dd45f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:30.824376 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-07f28e90-5d25-4d75-ab48-e306c89e37e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f0f8e04a9e412b93411903705dd45f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:30.836314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-07f28e90-5d25-4d75-ab48-e306c89e37e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f0f8e04a9e412b93411903705dd45f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:30.848167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1183/2365] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:26:30 2022] DELETE /identity/v3/users/90f0f8e04a9e412b93411903705dd45f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:26:31.087338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576fd6f-f8a7-463f-9f77-600160c4d890 service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:31.108976 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576fd6f-f8a7-463f-9f77-600160c4d890 service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:31.121540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:31.214700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:31.216539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:31.216900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:31.217248 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] PATH_INFO: `/v3/projects/72897590cf744b51a753a273e18e58b1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:31.218897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72897590cf744b51a753a273e18e58b1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:31.221437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:31.336214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72897590cf744b51a753a273e18e58b1', 'request_id': 'req-4e9aa394-bee3-4243-86a8-a27fbebfaa31'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:31.345636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72897590cf744b51a753a273e18e58b1', 'request_id': 'req-4e9aa394-bee3-4243-86a8-a27fbebfaa31'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:31.352969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72897590cf744b51a753a273e18e58b1', 'request_id': 'req-4e9aa394-bee3-4243-86a8-a27fbebfaa31'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:31.368456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] The token cache is being invalidate because project 72897590cf744b51a753a273e18e58b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:26:31.368959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:31.369665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4e9aa394-bee3-4243-86a8-a27fbebfaa31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:31.375936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1183/2366] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:26:31 2022] DELETE /identity/v3/projects/72897590cf744b51a753a273e18e58b1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:26:31.377364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff86c1-6a3d-465e-8228-17dfff66af93 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:31.377699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff86c1-6a3d-465e-8228-17dfff66af93 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:31.378287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff86c1-6a3d-465e-8228-17dfff66af93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:31.404540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-19ff86c1-6a3d-465e-8228-17dfff66af93 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:31.415782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-19ff86c1-6a3d-465e-8228-17dfff66af93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:31.519343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1184/2367] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:26:31.521442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900925-2cad-473e-a3f6-7e51f78b3fae None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:31.521442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900925-2cad-473e-a3f6-7e51f78b3fae None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:31.522102 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900925-2cad-473e-a3f6-7e51f78b3fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:31.545354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-83900925-2cad-473e-a3f6-7e51f78b3fae None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:31.546777 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-83900925-2cad-473e-a3f6-7e51f78b3fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:31.559151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1184/2368] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:26:31.564102 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff86c1-6a3d-465e-8228-17dfff66af93 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:31.574215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff86c1-6a3d-465e-8228-17dfff66af93 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:31.579838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500c542-89d9-420e-8b39-c6a649840b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:31.580563 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500c542-89d9-420e-8b39-c6a649840b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:31.580846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500c542-89d9-420e-8b39-c6a649840b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:31.581122 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500c542-89d9-420e-8b39-c6a649840b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:31.582019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500c542-89d9-420e-8b39-c6a649840b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:26:31.582324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500c542-89d9-420e-8b39-c6a649840b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:31.584478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500c542-89d9-420e-8b39-c6a649840b7c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:31.603090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1185/2369] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:26:31.604869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83900925-2cad-473e-a3f6-7e51f78b3fae None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:31.615267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83900925-2cad-473e-a3f6-7e51f78b3fae None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:31.622720 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6cb4-f698-4baa-90ac-8c796afff5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:31.624407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6cb4-f698-4baa-90ac-8c796afff5db admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:31.625371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6cb4-f698-4baa-90ac-8c796afff5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:31.625699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6cb4-f698-4baa-90ac-8c796afff5db admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:31.626420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6cb4-f698-4baa-90ac-8c796afff5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:31.628430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6cb4-f698-4baa-90ac-8c796afff5db admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:31.671317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1185/2370] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:26:31 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:26:31.672526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500c542-89d9-420e-8b39-c6a649840b7c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:31.683299 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500c542-89d9-420e-8b39-c6a649840b7c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:31.711181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:31.748996 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccd905-1ada-4c9c-a03c-55a6a9add056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:31.749924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd905-1ada-4c9c-a03c-55a6a9add056 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:31.750213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd905-1ada-4c9c-a03c-55a6a9add056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:31.750495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd905-1ada-4c9c-a03c-55a6a9add056 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:31.751197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccd905-1ada-4c9c-a03c-55a6a9add056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:31.753442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccd905-1ada-4c9c-a03c-55a6a9add056 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:31.776652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1186/2371] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:26:31 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:26:31.781353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6cb4-f698-4baa-90ac-8c796afff5db admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:31.793246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6cb4-f698-4baa-90ac-8c796afff5db admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:31.798340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f38d-d637-4037-84a4-23e29450aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:31.799143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f38d-d637-4037-84a4-23e29450aea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:31.799432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f38d-d637-4037-84a4-23e29450aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:31.799718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f38d-d637-4037-84a4-23e29450aea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:31.800492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79f38d-d637-4037-84a4-23e29450aea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:31.802153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79f38d-d637-4037-84a4-23e29450aea8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:31.816061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1186/2372] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:26:31.818432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccd905-1ada-4c9c-a03c-55a6a9add056 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:31.834966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccd905-1ada-4c9c-a03c-55a6a9add056 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:31.839859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3f8af-a46c-4427-a381-7eab369413c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:31.840593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3f8af-a46c-4427-a381-7eab369413c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:31.840883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3f8af-a46c-4427-a381-7eab369413c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:31.841166 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3f8af-a46c-4427-a381-7eab369413c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:31.841932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3f8af-a46c-4427-a381-7eab369413c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:31.843540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3f8af-a46c-4427-a381-7eab369413c2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:31.856933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1187/2373] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:26:31.858454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f38d-d637-4037-84a4-23e29450aea8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:31.870064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f38d-d637-4037-84a4-23e29450aea8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:31.875386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4efef-08e8-40ea-a9bc-59b50fe5c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:31.876411 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4efef-08e8-40ea-a9bc-59b50fe5c54d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:31.876701 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4efef-08e8-40ea-a9bc-59b50fe5c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:31.876986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4efef-08e8-40ea-a9bc-59b50fe5c54d admin admin] PATH_INFO: `/v3/projects/c77d08077c39475bbb73e39fc6a40f04/users/ce4e586b71bf48d98c0974edfa7ce644/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:31.896668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4efef-08e8-40ea-a9bc-59b50fe5c54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77d08077c39475bbb73e39fc6a40f04, user_id=ce4e586b71bf48d98c0974edfa7ce644, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:31.899474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4efef-08e8-40ea-a9bc-59b50fe5c54d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:31.913622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1187/2374] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:26:31 2022] PUT /identity/v3/projects/c77d08077c39475bbb73e39fc6a40f04/users/ce4e586b71bf48d98c0974edfa7ce644/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:26:31.919705 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15755509-1687-4d73-9262-c7cb9a588be5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:31.919909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15755509-1687-4d73-9262-c7cb9a588be5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:31.920714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15755509-1687-4d73-9262-c7cb9a588be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:31.939586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-15755509-1687-4d73-9262-c7cb9a588be5 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:31.940827 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-15755509-1687-4d73-9262-c7cb9a588be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:32.035833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1188/2375] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:32.049823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4efef-08e8-40ea-a9bc-59b50fe5c54d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:32.052620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e2f4efef-08e8-40ea-a9bc-59b50fe5c54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:32.115660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:32.129621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4efef-08e8-40ea-a9bc-59b50fe5c54d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:32.133647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd4207-007c-4969-bc2d-966aa0874657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:32.134341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd4207-007c-4969-bc2d-966aa0874657 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:32.134706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd4207-007c-4969-bc2d-966aa0874657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:32.135062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd4207-007c-4969-bc2d-966aa0874657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:32.144965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd4207-007c-4969-bc2d-966aa0874657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:32.146502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd4207-007c-4969-bc2d-966aa0874657 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:32.157660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1188/2376] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:26:33.145643 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15755509-1687-4d73-9262-c7cb9a588be5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:33.147980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-15755509-1687-4d73-9262-c7cb9a588be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:33.160440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15755509-1687-4d73-9262-c7cb9a588be5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:33.165528 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:33.166673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:33.166957 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:33.167230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] PATH_INFO: `/v3/users/0b6bc0676dbf4349ab7fd812899cd55f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:33.168683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6bc0676dbf4349ab7fd812899cd55f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:33.171173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:33.228599 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6bc0676dbf4349ab7fd812899cd55f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:33.243462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6bc0676dbf4349ab7fd812899cd55f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:33.254270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6bc0676dbf4349ab7fd812899cd55f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:33.254877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6bc0676dbf4349ab7fd812899cd55f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:33.264677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6bc0676dbf4349ab7fd812899cd55f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:33.271676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1189/2377] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:26:33 2022] DELETE /identity/v3/users/0b6bc0676dbf4349ab7fd812899cd55f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:26:33.276973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bdf62-1858-491e-be43-c28a02bada6a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:33.277443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bdf62-1858-491e-be43-c28a02bada6a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:33.278681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bdf62-1858-491e-be43-c28a02bada6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:33.297228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-909bdf62-1858-491e-be43-c28a02bada6a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:33.298572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-909bdf62-1858-491e-be43-c28a02bada6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:33.385721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1189/2378] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:33.396768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:33.398510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:33.429173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:33.509605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42900f91-eaaa-460f-8c10-529013e29fcb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:33.517919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794539af-94c1-414f-9f42-dc27f09e3676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:33.518593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794539af-94c1-414f-9f42-dc27f09e3676 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:33.518884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794539af-94c1-414f-9f42-dc27f09e3676 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:33.519163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794539af-94c1-414f-9f42-dc27f09e3676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:33.534175 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794539af-94c1-414f-9f42-dc27f09e3676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:33.537443 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794539af-94c1-414f-9f42-dc27f09e3676 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:33.558649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1190/2379] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:26:33.687936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bdf62-1858-491e-be43-c28a02bada6a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:33.689949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-909bdf62-1858-491e-be43-c28a02bada6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:33.707286 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bdf62-1858-491e-be43-c28a02bada6a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:33.716082 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3b436-76cf-4a92-808c-70f15cad32fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:33.716987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b436-76cf-4a92-808c-70f15cad32fe service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:33.718750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b436-76cf-4a92-808c-70f15cad32fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:33.719214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b436-76cf-4a92-808c-70f15cad32fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:33.722524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-19a3b436-76cf-4a92-808c-70f15cad32fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:33.817545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3b436-76cf-4a92-808c-70f15cad32fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:33.819029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3b436-76cf-4a92-808c-70f15cad32fe service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:33.849703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1190/2380] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:26:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:26:34.375009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794539af-94c1-414f-9f42-dc27f09e3676 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:34.377870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-794539af-94c1-414f-9f42-dc27f09e3676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:34.393842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794539af-94c1-414f-9f42-dc27f09e3676 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:34.400694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:34.401745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:34.402272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:34.403992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] PATH_INFO: `/v3/projects/68e3c5c1e08b4321b6ac7c55b0e0d92a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:34.405695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e3c5c1e08b4321b6ac7c55b0e0d92a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:34.409478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:34.496349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e3c5c1e08b4321b6ac7c55b0e0d92a', 'request_id': 'req-33e5c9c5-4654-4694-9cb9-04becb32602f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:34.507944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e3c5c1e08b4321b6ac7c55b0e0d92a', 'request_id': 'req-33e5c9c5-4654-4694-9cb9-04becb32602f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:34.517677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e3c5c1e08b4321b6ac7c55b0e0d92a', 'request_id': 'req-33e5c9c5-4654-4694-9cb9-04becb32602f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:34.565490 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] The token cache is being invalidate because project 68e3c5c1e08b4321b6ac7c55b0e0d92a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:26:34.565980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:34.566807 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-33e5c9c5-4654-4694-9cb9-04becb32602f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:26:34.569295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1191/2381] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:26:34 2022] DELETE /identity/v3/projects/68e3c5c1e08b4321b6ac7c55b0e0d92a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:26:40.676635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3b436-76cf-4a92-808c-70f15cad32fe service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:40.678146 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-19a3b436-76cf-4a92-808c-70f15cad32fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:40.780367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:40.789765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3b436-76cf-4a92-808c-70f15cad32fe service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:40.874014 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ae067-354f-4a36-9757-2dfa5f6cdb76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:40.874640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae067-354f-4a36-9757-2dfa5f6cdb76 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:40.875046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae067-354f-4a36-9757-2dfa5f6cdb76 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:40.875424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ae067-354f-4a36-9757-2dfa5f6cdb76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:40.877919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dd8ae067-354f-4a36-9757-2dfa5f6cdb76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:40.891188 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ae067-354f-4a36-9757-2dfa5f6cdb76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:40.892923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ae067-354f-4a36-9757-2dfa5f6cdb76 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:40.904219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1191/2382] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:26:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:26:41.605969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb7c12-649d-4875-b069-0d2304ff4b69 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:41.606815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb7c12-649d-4875-b069-0d2304ff4b69 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:41.607256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb7c12-649d-4875-b069-0d2304ff4b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:41.638497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e9cb7c12-649d-4875-b069-0d2304ff4b69 None None] MFA Rules not processed for user `ce4e586b71bf48d98c0974edfa7ce644`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:41.639755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e9cb7c12-649d-4875-b069-0d2304ff4b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:41.710285 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1192/2383] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:41.714811 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ae067-354f-4a36-9757-2dfa5f6cdb76 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:41.717019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dd8ae067-354f-4a36-9757-2dfa5f6cdb76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:41.797994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ae067-354f-4a36-9757-2dfa5f6cdb76 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:41.803590 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ebe77-ce3a-4bb8-bb53-f833a68c2fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:41.804425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ebe77-ce3a-4bb8-bb53-f833a68c2fdb admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:41.804810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ebe77-ce3a-4bb8-bb53-f833a68c2fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:41.805210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ebe77-ce3a-4bb8-bb53-f833a68c2fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:41.808128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ebe77-ce3a-4bb8-bb53-f833a68c2fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:41.809933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ebe77-ce3a-4bb8-bb53-f833a68c2fdb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:41.847700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1192/2384] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:26:41 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:26:41.848827 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb7c12-649d-4875-b069-0d2304ff4b69 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:41.860700 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb7c12-649d-4875-b069-0d2304ff4b69 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:41.900844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:41.933679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d18aac-bc16-43a9-80cf-9c018c140e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:41.935187 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d18aac-bc16-43a9-80cf-9c018c140e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:41.936303 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d18aac-bc16-43a9-80cf-9c018c140e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:41.936788 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d18aac-bc16-43a9-80cf-9c018c140e95 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:41.937832 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d18aac-bc16-43a9-80cf-9c018c140e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:41.939972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d18aac-bc16-43a9-80cf-9c018c140e95 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:41.961743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1193/2385] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:26:41 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:26:41.966331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ebe77-ce3a-4bb8-bb53-f833a68c2fdb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:41.977122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ebe77-ce3a-4bb8-bb53-f833a68c2fdb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:41.981743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc96bae-f359-4274-bf83-9032d9641752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:41.982395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc96bae-f359-4274-bf83-9032d9641752 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:41.982680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc96bae-f359-4274-bf83-9032d9641752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:41.982956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc96bae-f359-4274-bf83-9032d9641752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:41.983688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc96bae-f359-4274-bf83-9032d9641752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:41.985313 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc96bae-f359-4274-bf83-9032d9641752 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:41.997860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1193/2386] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:26:42.001978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d18aac-bc16-43a9-80cf-9c018c140e95 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:42.012826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d18aac-bc16-43a9-80cf-9c018c140e95 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:42.017987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9baee-ce15-4718-ab5e-5d97ff029d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:42.018862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9baee-ce15-4718-ab5e-5d97ff029d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:42.019151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9baee-ce15-4718-ab5e-5d97ff029d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:42.019431 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9baee-ce15-4718-ab5e-5d97ff029d4e admin admin] PATH_INFO: `/v3/projects/45395f868c4645b09f761aa6cc41799b/users/4affee8c2a454541aeddf4f6dc00e5b6/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:42.034855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9baee-ce15-4718-ab5e-5d97ff029d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45395f868c4645b09f761aa6cc41799b, user_id=4affee8c2a454541aeddf4f6dc00e5b6, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:42.037582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9baee-ce15-4718-ab5e-5d97ff029d4e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:42.050304 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1194/2387] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:26:42 2022] PUT /identity/v3/projects/45395f868c4645b09f761aa6cc41799b/users/4affee8c2a454541aeddf4f6dc00e5b6/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:26:42.054198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc96bae-f359-4274-bf83-9032d9641752 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:42.064947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc96bae-f359-4274-bf83-9032d9641752 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:42.124330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c0cad-d1c5-4f21-810d-f5ea0834f915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:42.125010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c0cad-d1c5-4f21-810d-f5ea0834f915 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:42.125300 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c0cad-d1c5-4f21-810d-f5ea0834f915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:42.125584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c0cad-d1c5-4f21-810d-f5ea0834f915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:42.126315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c0cad-d1c5-4f21-810d-f5ea0834f915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:42.127923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c0cad-d1c5-4f21-810d-f5ea0834f915 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:42.130098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:42.139462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1194/2388] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:26:42.143580 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9baee-ce15-4718-ab5e-5d97ff029d4e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:42.154411 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9baee-ce15-4718-ab5e-5d97ff029d4e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:42.159218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81b8e8-2838-4335-a80a-3ed75432904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:42.160155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81b8e8-2838-4335-a80a-3ed75432904e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:42.160444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81b8e8-2838-4335-a80a-3ed75432904e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:42.160729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81b8e8-2838-4335-a80a-3ed75432904e admin admin] PATH_INFO: `/v3/projects/45395f868c4645b09f761aa6cc41799b/users/4affee8c2a454541aeddf4f6dc00e5b6/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:42.162857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81b8e8-2838-4335-a80a-3ed75432904e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45395f868c4645b09f761aa6cc41799b, user_id=4affee8c2a454541aeddf4f6dc00e5b6, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:42.165683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81b8e8-2838-4335-a80a-3ed75432904e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:42.176786 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1195/2389] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:26:42 2022] PUT /identity/v3/projects/45395f868c4645b09f761aa6cc41799b/users/4affee8c2a454541aeddf4f6dc00e5b6/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:26:47.005437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe047c-6d6b-45d6-80e2-2d781cf335b4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:47.005956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe047c-6d6b-45d6-80e2-2d781cf335b4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:47.006053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe047c-6d6b-45d6-80e2-2d781cf335b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:47.036375 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c1fe047c-6d6b-45d6-80e2-2d781cf335b4 None None] MFA Rules not processed for user `4affee8c2a454541aeddf4f6dc00e5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:47.038152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c1fe047c-6d6b-45d6-80e2-2d781cf335b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:47.108745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1195/2390] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:47.122630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81b8e8-2838-4335-a80a-3ed75432904e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:47.124583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7e81b8e8-2838-4335-a80a-3ed75432904e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:47.222128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81b8e8-2838-4335-a80a-3ed75432904e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:47.227579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991313dd-5e0f-4ae2-98a1-f6379139ce20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:47.228279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991313dd-5e0f-4ae2-98a1-f6379139ce20 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:47.228622 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991313dd-5e0f-4ae2-98a1-f6379139ce20 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:47.228928 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991313dd-5e0f-4ae2-98a1-f6379139ce20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:47.287615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991313dd-5e0f-4ae2-98a1-f6379139ce20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:47.289174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991313dd-5e0f-4ae2-98a1-f6379139ce20 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:47.298988 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1196/2391] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:26:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:26:47.802048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d3731-3e61-4d44-a7ef-929553b6232a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:47.802341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d3731-3e61-4d44-a7ef-929553b6232a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:47.802622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d3731-3e61-4d44-a7ef-929553b6232a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:47.860204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-793d3731-3e61-4d44-a7ef-929553b6232a None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:26:47.861412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-793d3731-3e61-4d44-a7ef-929553b6232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:47.933352 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1196/2392] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:26:47.946471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991313dd-5e0f-4ae2-98a1-f6379139ce20 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:26:47.947899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-991313dd-5e0f-4ae2-98a1-f6379139ce20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:26:47.952765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:48.048972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991313dd-5e0f-4ae2-98a1-f6379139ce20 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:26:48.063249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a65f-ce34-43dd-94a1-8700fa315105 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:26:48.063971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a65f-ce34-43dd-94a1-8700fa315105 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:26:48.064305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a65f-ce34-43dd-94a1-8700fa315105 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:26:48.064585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084a65f-ce34-43dd-94a1-8700fa315105 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:26:48.074144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084a65f-ce34-43dd-94a1-8700fa315105 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:26:48.075869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084a65f-ce34-43dd-94a1-8700fa315105 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:26:48.085901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1197/2393] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:26:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:26:57.930436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=75 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:26:58.082364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=39 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:27:11.126763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5a1ed-e447-4643-b5a8-18f40da5ba33 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:11.127293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5a1ed-e447-4643-b5a8-18f40da5ba33 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:11.127416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5a1ed-e447-4643-b5a8-18f40da5ba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:11.145853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b8f5a1ed-e447-4643-b5a8-18f40da5ba33 None None] MFA Rules not processed for user `ce4e586b71bf48d98c0974edfa7ce644`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:27:11.147063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b8f5a1ed-e447-4643-b5a8-18f40da5ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:27:11.154990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1197/2394] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:27:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:27:21.140479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:27:31.646982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a65f-ce34-43dd-94a1-8700fa315105 service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:27:31.648451 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e084a65f-ce34-43dd-94a1-8700fa315105 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:27:31.704529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084a65f-ce34-43dd-94a1-8700fa315105 service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:27:31.708117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46fcf2-878e-41d5-b39b-dab518a2ffb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:27:31.708759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46fcf2-878e-41d5-b39b-dab518a2ffb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:31.709042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46fcf2-878e-41d5-b39b-dab518a2ffb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:31.709319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46fcf2-878e-41d5-b39b-dab518a2ffb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:31.718175 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46fcf2-878e-41d5-b39b-dab518a2ffb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:27:31.719600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46fcf2-878e-41d5-b39b-dab518a2ffb7 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:27:31.729892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1198/2395] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:27:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:27:39.163176 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5a1ed-e447-4643-b5a8-18f40da5ba33 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:27:39.164844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b8f5a1ed-e447-4643-b5a8-18f40da5ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:27:39.232500 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5a1ed-e447-4643-b5a8-18f40da5ba33 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:27:39.237175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8e2a3-415a-4b10-a7ce-50f2eb011e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:27:39.238051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8e2a3-415a-4b10-a7ce-50f2eb011e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:39.238339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8e2a3-415a-4b10-a7ce-50f2eb011e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:39.238618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8e2a3-415a-4b10-a7ce-50f2eb011e01 admin admin] PATH_INFO: `/v3/users/bd7324f7539840b08c17d39d297eb99e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:39.239825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8e2a3-415a-4b10-a7ce-50f2eb011e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7324f7539840b08c17d39d297eb99e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:27:39.241822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8e2a3-415a-4b10-a7ce-50f2eb011e01 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:27:39.290627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5c8e2a3-415a-4b10-a7ce-50f2eb011e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7324f7539840b08c17d39d297eb99e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:39.302841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5c8e2a3-415a-4b10-a7ce-50f2eb011e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7324f7539840b08c17d39d297eb99e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:39.310340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5c8e2a3-415a-4b10-a7ce-50f2eb011e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7324f7539840b08c17d39d297eb99e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:39.311039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5c8e2a3-415a-4b10-a7ce-50f2eb011e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7324f7539840b08c17d39d297eb99e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:39.318043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5c8e2a3-415a-4b10-a7ce-50f2eb011e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7324f7539840b08c17d39d297eb99e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:39.324194 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1198/2396] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:27:39 2022] DELETE /identity/v3/users/bd7324f7539840b08c17d39d297eb99e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:27:39.505669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46fcf2-878e-41d5-b39b-dab518a2ffb7 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:27:39.517489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46fcf2-878e-41d5-b39b-dab518a2ffb7 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:27:39.580326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:27:39.581173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:39.581459 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:39.581739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] PATH_INFO: `/v3/projects/7c31c09dc65e417288a36b2146a926cb` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:39.582955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c31c09dc65e417288a36b2146a926cb)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:27:39.584912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:27:39.633483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c31c09dc65e417288a36b2146a926cb', 'request_id': 'req-32b7d406-0414-4afa-be3f-534c4a59b0a2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:39.639616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c31c09dc65e417288a36b2146a926cb', 'request_id': 'req-32b7d406-0414-4afa-be3f-534c4a59b0a2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:39.646253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c31c09dc65e417288a36b2146a926cb', 'request_id': 'req-32b7d406-0414-4afa-be3f-534c4a59b0a2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:39.658913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] The token cache is being invalidate because project 7c31c09dc65e417288a36b2146a926cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:27:39.658913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:39.659533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-32b7d406-0414-4afa-be3f-534c4a59b0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:39.661238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1199/2397] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:27:39 2022] DELETE /identity/v3/projects/7c31c09dc65e417288a36b2146a926cb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:27:39.666154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69f98-495d-4f1f-8547-1a3ac3986aa5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:39.666443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69f98-495d-4f1f-8547-1a3ac3986aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:39.666724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69f98-495d-4f1f-8547-1a3ac3986aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:39.686748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e2a69f98-495d-4f1f-8547-1a3ac3986aa5 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:27:39.687927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e2a69f98-495d-4f1f-8547-1a3ac3986aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:27:39.752911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1199/2398] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:27:39.760559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045571-b14f-494d-8c8b-c5bf3b96278e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:39.760854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045571-b14f-494d-8c8b-c5bf3b96278e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:39.761138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045571-b14f-494d-8c8b-c5bf3b96278e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:39.780223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-53045571-b14f-494d-8c8b-c5bf3b96278e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:27:39.781431 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-53045571-b14f-494d-8c8b-c5bf3b96278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:27:39.790320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1200/2399] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:27:39.794573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a69f98-495d-4f1f-8547-1a3ac3986aa5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:27:39.805275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a69f98-495d-4f1f-8547-1a3ac3986aa5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:27:39.812547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafff35-44d4-4c44-bdea-1425953e94b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:27:39.813224 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafff35-44d4-4c44-bdea-1425953e94b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:39.813514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafff35-44d4-4c44-bdea-1425953e94b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:39.814151 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafff35-44d4-4c44-bdea-1425953e94b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:39.814531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafff35-44d4-4c44-bdea-1425953e94b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:27:39.814843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafff35-44d4-4c44-bdea-1425953e94b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:27:39.816547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafff35-44d4-4c44-bdea-1425953e94b2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:27:39.828899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1200/2400] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:27:39.833364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53045571-b14f-494d-8c8b-c5bf3b96278e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:27:39.843464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53045571-b14f-494d-8c8b-c5bf3b96278e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:27:39.848134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3181c-8877-48d6-80ae-cb4ecd24b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:27:39.848807 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3181c-8877-48d6-80ae-cb4ecd24b58a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:39.849081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3181c-8877-48d6-80ae-cb4ecd24b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:39.849358 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3181c-8877-48d6-80ae-cb4ecd24b58a admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:39.850060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3181c-8877-48d6-80ae-cb4ecd24b58a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:27:39.852116 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3181c-8877-48d6-80ae-cb4ecd24b58a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:27:39.880383 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1201/2401] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:27:39 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:27:39.881517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafff35-44d4-4c44-bdea-1425953e94b2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:27:39.891931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafff35-44d4-4c44-bdea-1425953e94b2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:27:39.895617 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:27:39.950292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf678ec1-5777-4900-8c33-f071c42cf05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:27:39.950960 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf678ec1-5777-4900-8c33-f071c42cf05e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:39.951249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf678ec1-5777-4900-8c33-f071c42cf05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:39.951533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf678ec1-5777-4900-8c33-f071c42cf05e admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:39.952252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf678ec1-5777-4900-8c33-f071c42cf05e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:27:39.954397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf678ec1-5777-4900-8c33-f071c42cf05e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:27:39.974229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1201/2402] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:27:39 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:27:39.978201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3181c-8877-48d6-80ae-cb4ecd24b58a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:27:39.985388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:27:39.989221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3181c-8877-48d6-80ae-cb4ecd24b58a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:27:39.995378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccfbc6-29c9-4642-8c50-2929b2e5ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:27:39.996244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccfbc6-29c9-4642-8c50-2929b2e5ea5f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:39.996586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccfbc6-29c9-4642-8c50-2929b2e5ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:39.997004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccfbc6-29c9-4642-8c50-2929b2e5ea5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:39.998296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccfbc6-29c9-4642-8c50-2929b2e5ea5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:27:40.000513 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccfbc6-29c9-4642-8c50-2929b2e5ea5f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:27:40.012068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1202/2403] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:27:40.016417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf678ec1-5777-4900-8c33-f071c42cf05e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:27:40.026506 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf678ec1-5777-4900-8c33-f071c42cf05e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:27:40.031838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54b9ab-ec60-43bd-a7ca-b29cdab725f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:27:40.032517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54b9ab-ec60-43bd-a7ca-b29cdab725f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:40.032808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54b9ab-ec60-43bd-a7ca-b29cdab725f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:40.033087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54b9ab-ec60-43bd-a7ca-b29cdab725f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:40.033816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54b9ab-ec60-43bd-a7ca-b29cdab725f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:27:40.035458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54b9ab-ec60-43bd-a7ca-b29cdab725f0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:27:40.046177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1202/2404] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:27:40.050453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccfbc6-29c9-4642-8c50-2929b2e5ea5f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:27:40.060349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccfbc6-29c9-4642-8c50-2929b2e5ea5f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:27:40.064885 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3023e-13f4-47fb-8c5a-90117d6127ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:27:40.065781 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3023e-13f4-47fb-8c5a-90117d6127ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:40.066057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3023e-13f4-47fb-8c5a-90117d6127ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:40.066327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3023e-13f4-47fb-8c5a-90117d6127ac admin admin] PATH_INFO: `/v3/projects/7e1a443d939c49569dbf4b2d54118cc4/users/e692897a4cec4577baa506929ce70047/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:40.080790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3023e-13f4-47fb-8c5a-90117d6127ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1a443d939c49569dbf4b2d54118cc4, user_id=e692897a4cec4577baa506929ce70047, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:27:40.083433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3023e-13f4-47fb-8c5a-90117d6127ac admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:27:40.097291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1203/2405] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:27:40 2022] PUT /identity/v3/projects/7e1a443d939c49569dbf4b2d54118cc4/users/e692897a4cec4577baa506929ce70047/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:27:40.106922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937eb06-b4f4-43d6-9ee2-1df802b9f4fe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:40.107215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937eb06-b4f4-43d6-9ee2-1df802b9f4fe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:40.107526 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937eb06-b4f4-43d6-9ee2-1df802b9f4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:40.133278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0937eb06-b4f4-43d6-9ee2-1df802b9f4fe None None] MFA Rules not processed for user `e692897a4cec4577baa506929ce70047`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:27:40.134551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0937eb06-b4f4-43d6-9ee2-1df802b9f4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:27:40.199063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1203/2406] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:27:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:27:40.210322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3023e-13f4-47fb-8c5a-90117d6127ac admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:27:40.212088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4db3023e-13f4-47fb-8c5a-90117d6127ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:27:40.269161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3023e-13f4-47fb-8c5a-90117d6127ac admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:27:40.273145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6661e-9dbc-4ad6-9c0d-919281bf698c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:27:40.273821 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6661e-9dbc-4ad6-9c0d-919281bf698c service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:40.274115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6661e-9dbc-4ad6-9c0d-919281bf698c service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:40.274398 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6661e-9dbc-4ad6-9c0d-919281bf698c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:40.283413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6661e-9dbc-4ad6-9c0d-919281bf698c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:27:40.284870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6661e-9dbc-4ad6-9c0d-919281bf698c service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:27:40.293712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1204/2407] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:27:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:27:50.196109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:27:50.289603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:27:57.786019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead62f1-faa0-44fb-b934-1758012963d6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:57.786551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead62f1-faa0-44fb-b934-1758012963d6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:57.786633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead62f1-faa0-44fb-b934-1758012963d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:57.805779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7ead62f1-faa0-44fb-b934-1758012963d6 None None] MFA Rules not processed for user `76011af8b8b94434bb461d81cff5ae8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:27:57.807253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7ead62f1-faa0-44fb-b934-1758012963d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:27:57.866890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1204/2408] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:27:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:27:59.841051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6661e-9dbc-4ad6-9c0d-919281bf698c service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:27:59.903583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6661e-9dbc-4ad6-9c0d-919281bf698c service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:27:59.909293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:27:59.909952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:27:59.910305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:27:59.910655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] PATH_INFO: `/v3/users/e692897a4cec4577baa506929ce70047` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:27:59.911921 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e692897a4cec4577baa506929ce70047)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:27:59.913869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:27:59.963092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e692897a4cec4577baa506929ce70047'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:59.976340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e692897a4cec4577baa506929ce70047'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:59.984342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e692897a4cec4577baa506929ce70047'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:59.985042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e692897a4cec4577baa506929ce70047'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:59.992707 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e692897a4cec4577baa506929ce70047'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:27:59.998874 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1205/2409] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:27:59 2022] DELETE /identity/v3/users/e692897a4cec4577baa506929ce70047 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:28:00.003305 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08542521-cd57-46d1-956c-53bdd128edd9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:00.003751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08542521-cd57-46d1-956c-53bdd128edd9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:00.003924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08542521-cd57-46d1-956c-53bdd128edd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:00.023273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-08542521-cd57-46d1-956c-53bdd128edd9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:28:00.024511 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-08542521-cd57-46d1-956c-53bdd128edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:00.084350 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1205/2410] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:28:00.096320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:00.097778 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:00.158174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54228a13-70b9-4868-b5a5-e21d54123e64 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:00.162241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bee4a-5b2d-431d-9a15-3c575867693a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:00.162932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bee4a-5b2d-431d-9a15-3c575867693a service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:00.163288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bee4a-5b2d-431d-9a15-3c575867693a service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:00.163615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bee4a-5b2d-431d-9a15-3c575867693a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:00.173182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bee4a-5b2d-431d-9a15-3c575867693a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:00.174739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bee4a-5b2d-431d-9a15-3c575867693a service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:00.184315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1206/2411] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:28:00.470279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08542521-cd57-46d1-956c-53bdd128edd9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:00.471730 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-08542521-cd57-46d1-956c-53bdd128edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:00.483723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08542521-cd57-46d1-956c-53bdd128edd9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:00.489200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:00.490241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:00.490584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:00.490877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] PATH_INFO: `/v3/projects/7e1a443d939c49569dbf4b2d54118cc4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:00.492148 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1a443d939c49569dbf4b2d54118cc4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:00.494107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:00.541157 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1a443d939c49569dbf4b2d54118cc4', 'request_id': 'req-8faaa5ba-68f8-484f-afa0-7c757d9439f2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:28:00.548240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1a443d939c49569dbf4b2d54118cc4', 'request_id': 'req-8faaa5ba-68f8-484f-afa0-7c757d9439f2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:28:00.553964 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1a443d939c49569dbf4b2d54118cc4', 'request_id': 'req-8faaa5ba-68f8-484f-afa0-7c757d9439f2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:28:00.566768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] The token cache is being invalidate because project 7e1a443d939c49569dbf4b2d54118cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:28:00.567063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:28:00.567694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:28:00.569257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1206/2412] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:28:00 2022] DELETE /identity/v3/projects/7e1a443d939c49569dbf4b2d54118cc4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:28:10.179983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:28:10.563736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:28:15.824478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bee4a-5b2d-431d-9a15-3c575867693a service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:15.834052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bee4a-5b2d-431d-9a15-3c575867693a service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:15.881912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46c915-be10-4297-a95b-bd63d9b9721a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:15.882552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46c915-be10-4297-a95b-bd63d9b9721a service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:15.882839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46c915-be10-4297-a95b-bd63d9b9721a service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:15.883121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46c915-be10-4297-a95b-bd63d9b9721a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:15.886348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8b46c915-be10-4297-a95b-bd63d9b9721a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:15.956206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46c915-be10-4297-a95b-bd63d9b9721a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:15.957669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46c915-be10-4297-a95b-bd63d9b9721a service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:15.969226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1207/2413] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:28:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:28:17.146481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:17.147996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:17.161165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaa5ba-68f8-484f-afa0-7c757d9439f2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:17.164808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfa601-ab63-41c0-a0d2-323a18ae16a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:17.165453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa601-ab63-41c0-a0d2-323a18ae16a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:17.165735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa601-ab63-41c0-a0d2-323a18ae16a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:17.166011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfa601-ab63-41c0-a0d2-323a18ae16a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:17.167729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-92bfa601-ab63-41c0-a0d2-323a18ae16a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:17.180688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfa601-ab63-41c0-a0d2-323a18ae16a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:17.182114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfa601-ab63-41c0-a0d2-323a18ae16a0 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:17.192824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1207/2414] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:28:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:28:20.807744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b93c-bc12-4864-b4cd-a0a20d6e0d07 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:20.808351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b93c-bc12-4864-b4cd-a0a20d6e0d07 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:20.808351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b93c-bc12-4864-b4cd-a0a20d6e0d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:20.825261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-10d5b93c-bc12-4864-b4cd-a0a20d6e0d07 None None] MFA Rules not processed for user `7f78f3daa4744f41a914c0563982b79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:28:20.826497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-10d5b93c-bc12-4864-b4cd-a0a20d6e0d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:20.880802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1208/2415] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:28:27.188097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:28:30.874214 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=79 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:28:46.079444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfa601-ab63-41c0-a0d2-323a18ae16a0 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:46.081523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-92bfa601-ab63-41c0-a0d2-323a18ae16a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:46.092741 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfa601-ab63-41c0-a0d2-323a18ae16a0 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:46.096675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99809373-5f4f-4635-ae1c-7f8ba23e1d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:46.097330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99809373-5f4f-4635-ae1c-7f8ba23e1d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:46.097678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99809373-5f4f-4635-ae1c-7f8ba23e1d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:46.098153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99809373-5f4f-4635-ae1c-7f8ba23e1d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:46.100179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-99809373-5f4f-4635-ae1c-7f8ba23e1d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:46.110948 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99809373-5f4f-4635-ae1c-7f8ba23e1d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:46.112403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99809373-5f4f-4635-ae1c-7f8ba23e1d35 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:46.121815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1208/2416] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:28:48.405959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5b93c-bc12-4864-b4cd-a0a20d6e0d07 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:48.407976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-10d5b93c-bc12-4864-b4cd-a0a20d6e0d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:48.464043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5b93c-bc12-4864-b4cd-a0a20d6e0d07 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:48.467644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c1d9-a025-4c29-88d3-fbb2f9d2ab52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:48.468317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c1d9-a025-4c29-88d3-fbb2f9d2ab52 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:48.468605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c1d9-a025-4c29-88d3-fbb2f9d2ab52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:48.468887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c1d9-a025-4c29-88d3-fbb2f9d2ab52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:48.471146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e4b1c1d9-a025-4c29-88d3-fbb2f9d2ab52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:48.529240 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1c1d9-a025-4c29-88d3-fbb2f9d2ab52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:48.530695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1c1d9-a025-4c29-88d3-fbb2f9d2ab52 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:48.540294 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1209/2417] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:28:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:28:53.183324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99809373-5f4f-4635-ae1c-7f8ba23e1d35 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:53.185416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-99809373-5f4f-4635-ae1c-7f8ba23e1d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:53.206656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99809373-5f4f-4635-ae1c-7f8ba23e1d35 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:53.214219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58867728-0908-4c67-886f-51259ae00829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:53.215320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58867728-0908-4c67-886f-51259ae00829 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:53.215704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58867728-0908-4c67-886f-51259ae00829 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:53.216104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58867728-0908-4c67-886f-51259ae00829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:53.218199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-58867728-0908-4c67-886f-51259ae00829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:53.232394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58867728-0908-4c67-886f-51259ae00829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:53.234285 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58867728-0908-4c67-886f-51259ae00829 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:53.250532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1209/2418] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:28:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:28:53.546259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c1d9-a025-4c29-88d3-fbb2f9d2ab52 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:53.568279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c1d9-a025-4c29-88d3-fbb2f9d2ab52 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:53.575286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd7a42-720b-4c33-ab9c-890db2bca37f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:53.576344 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7a42-720b-4c33-ab9c-890db2bca37f service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:53.576841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7a42-720b-4c33-ab9c-890db2bca37f service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:53.577372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7a42-720b-4c33-ab9c-890db2bca37f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:53.579875 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f0bd7a42-720b-4c33-ab9c-890db2bca37f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:53.596458 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd7a42-720b-4c33-ab9c-890db2bca37f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:53.598390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd7a42-720b-4c33-ab9c-890db2bca37f service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:53.622478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1210/2419] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:28:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:28:54.160376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58867728-0908-4c67-886f-51259ae00829 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:54.172417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58867728-0908-4c67-886f-51259ae00829 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:54.181729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a9088-ad75-474d-9f38-01824e9a86f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:54.182400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a9088-ad75-474d-9f38-01824e9a86f7 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:54.182664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a9088-ad75-474d-9f38-01824e9a86f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:54.182944 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a9088-ad75-474d-9f38-01824e9a86f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:54.185278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0a8a9088-ad75-474d-9f38-01824e9a86f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:54.253527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a9088-ad75-474d-9f38-01824e9a86f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:54.255120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a9088-ad75-474d-9f38-01824e9a86f7 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:54.264892 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1210/2420] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:28:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:28:54.814050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef203-ed3d-4db6-8fb2-96c86b366cc4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:54.815047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef203-ed3d-4db6-8fb2-96c86b366cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:54.815206 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef203-ed3d-4db6-8fb2-96c86b366cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:54.839835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2b0ef203-ed3d-4db6-8fb2-96c86b366cc4 None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:28:54.841087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2b0ef203-ed3d-4db6-8fb2-96c86b366cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:54.898060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1211/2421] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 12:28:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:28:54.946875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a9088-ad75-474d-9f38-01824e9a86f7 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:54.948425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0a8a9088-ad75-474d-9f38-01824e9a86f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:55.017591 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a9088-ad75-474d-9f38-01824e9a86f7 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:55.023310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2dbc8-6dc1-49b4-80b4-05b934b5287b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:55.023969 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2dbc8-6dc1-49b4-80b4-05b934b5287b service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:55.024287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2dbc8-6dc1-49b4-80b4-05b934b5287b service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:55.024571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2dbc8-6dc1-49b4-80b4-05b934b5287b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:55.033853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2dbc8-6dc1-49b4-80b4-05b934b5287b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:55.035446 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2dbc8-6dc1-49b4-80b4-05b934b5287b service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:55.043824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1211/2422] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:28:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:28:56.635080 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32655e71-f80d-4e60-b46b-576430b0835c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:56.635627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32655e71-f80d-4e60-b46b-576430b0835c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:56.635627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32655e71-f80d-4e60-b46b-576430b0835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:56.659358 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-32655e71-f80d-4e60-b46b-576430b0835c None None] MFA Rules not processed for user `05ab28ce7db949cb9f322aedc4d5163f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:28:56.661647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-32655e71-f80d-4e60-b46b-576430b0835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:56.683092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1212/2423] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:28:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:28:57.000827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2dbc8-6dc1-49b4-80b4-05b934b5287b service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:57.010710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2dbc8-6dc1-49b4-80b4-05b934b5287b service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:57.014528 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a723da2-dea8-484c-b400-33ead9ba94b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:57.015163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a723da2-dea8-484c-b400-33ead9ba94b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:57.015445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a723da2-dea8-484c-b400-33ead9ba94b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:57.016002 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a723da2-dea8-484c-b400-33ead9ba94b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:57.017821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9a723da2-dea8-484c-b400-33ead9ba94b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:57.027420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a723da2-dea8-484c-b400-33ead9ba94b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:57.029039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a723da2-dea8-484c-b400-33ead9ba94b3 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:57.041998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1212/2424] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:28:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:28:57.390362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32655e71-f80d-4e60-b46b-576430b0835c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:28:57.393424 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-32655e71-f80d-4e60-b46b-576430b0835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:57.468472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:28:57.505622 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32655e71-f80d-4e60-b46b-576430b0835c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:28:57.510816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df98d7-1979-4f40-b4dc-47a5c34e97b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:28:57.511457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df98d7-1979-4f40-b4dc-47a5c34e97b1 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:28:57.511743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df98d7-1979-4f40-b4dc-47a5c34e97b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:28:57.512035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df98d7-1979-4f40-b4dc-47a5c34e97b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:28:57.513914 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-29df98d7-1979-4f40-b4dc-47a5c34e97b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:28:57.540640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df98d7-1979-4f40-b4dc-47a5c34e97b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:28:57.542270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df98d7-1979-4f40-b4dc-47a5c34e97b1 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:28:57.553676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1213/2425] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:28:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:03.274671 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a723da2-dea8-484c-b400-33ead9ba94b3 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:03.289191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a723da2-dea8-484c-b400-33ead9ba94b3 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:03.294297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9f3db-17f3-46dc-9107-c49d5cc1b183 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:03.294977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9f3db-17f3-46dc-9107-c49d5cc1b183 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:03.295268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9f3db-17f3-46dc-9107-c49d5cc1b183 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:03.295546 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9f3db-17f3-46dc-9107-c49d5cc1b183 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:03.297447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-86e9f3db-17f3-46dc-9107-c49d5cc1b183 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:03.309762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9f3db-17f3-46dc-9107-c49d5cc1b183 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:03.311507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9f3db-17f3-46dc-9107-c49d5cc1b183 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:03.327378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1213/2426] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:03.328619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df98d7-1979-4f40-b4dc-47a5c34e97b1 service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:03.331589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-29df98d7-1979-4f40-b4dc-47a5c34e97b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:03.400665 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df98d7-1979-4f40-b4dc-47a5c34e97b1 service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:03.405128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:03.405987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:03.406266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:03.406541 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] PATH_INFO: `/v3/users/733f9ce179894e739b62dc903d9e784f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:03.407736 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=733f9ce179894e739b62dc903d9e784f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:03.409693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:03.459527 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '733f9ce179894e739b62dc903d9e784f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:03.471646 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '733f9ce179894e739b62dc903d9e784f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:03.481126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '733f9ce179894e739b62dc903d9e784f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:03.481927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '733f9ce179894e739b62dc903d9e784f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:03.490131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '733f9ce179894e739b62dc903d9e784f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:03.496750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1214/2427] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:29:03 2022] DELETE /identity/v3/users/733f9ce179894e739b62dc903d9e784f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:29:03.562604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9f3db-17f3-46dc-9107-c49d5cc1b183 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:03.573610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9f3db-17f3-46dc-9107-c49d5cc1b183 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:03.608717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:03.631034 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037059d-f903-43ea-8255-f380a46c5d1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:03.632140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037059d-f903-43ea-8255-f380a46c5d1c service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:03.632898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037059d-f903-43ea-8255-f380a46c5d1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:03.633603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037059d-f903-43ea-8255-f380a46c5d1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:03.635564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d037059d-f903-43ea-8255-f380a46c5d1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:03.682340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:03.684074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:03.712880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037059d-f903-43ea-8255-f380a46c5d1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:03.714875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037059d-f903-43ea-8255-f380a46c5d1c service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:03.725544 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1214/2428] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:03.752939 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:03.770586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef4976-6031-4762-b0c2-c3a02675aa33 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:03.775357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:03.776266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:03.776557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:03.776842 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] PATH_INFO: `/v3/projects/e21b0b533bee45f5b961b0b226a2ca58` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:03.778024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21b0b533bee45f5b961b0b226a2ca58)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:03.779997 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:03.830604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21b0b533bee45f5b961b0b226a2ca58', 'request_id': 'req-519d0f6d-21de-4eb4-a85d-4ab57100e118'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:03.837448 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21b0b533bee45f5b961b0b226a2ca58', 'request_id': 'req-519d0f6d-21de-4eb4-a85d-4ab57100e118'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:03.843581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21b0b533bee45f5b961b0b226a2ca58', 'request_id': 'req-519d0f6d-21de-4eb4-a85d-4ab57100e118'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:03.858506 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] The token cache is being invalidate because project e21b0b533bee45f5b961b0b226a2ca58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:29:03.858800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:03.859457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:03.861611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1215/2429] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:29:03 2022] DELETE /identity/v3/projects/e21b0b533bee45f5b961b0b226a2ca58 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:29:03.865722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037059d-f903-43ea-8255-f380a46c5d1c service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:03.877171 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037059d-f903-43ea-8255-f380a46c5d1c service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:03.940866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:03.941984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:03.942236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:03.942597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] PATH_INFO: `/v3/users/7a4ec88d2d694e648a23710990cf9c81` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:03.945516 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4ec88d2d694e648a23710990cf9c81)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:03.948281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:04.006721 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4ec88d2d694e648a23710990cf9c81'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:04.023433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4ec88d2d694e648a23710990cf9c81'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:04.033412 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4ec88d2d694e648a23710990cf9c81'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:04.034045 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4ec88d2d694e648a23710990cf9c81'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:04.042851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4ec88d2d694e648a23710990cf9c81'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:04.057732 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1215/2430] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:29:03 2022] DELETE /identity/v3/users/7a4ec88d2d694e648a23710990cf9c81 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:29:04.243860 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:04.245472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:04.260247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d0f6d-21de-4eb4-a85d-4ab57100e118 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:04.320345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:04.321208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:04.321493 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:04.321776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] PATH_INFO: `/v3/projects/cfc064c859914edda3db692ebf54f2a7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:04.323089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc064c859914edda3db692ebf54f2a7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:04.325070 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:04.373594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc064c859914edda3db692ebf54f2a7', 'request_id': 'req-28fd33c3-3de9-47d8-912a-bb4896941682'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:04.379881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc064c859914edda3db692ebf54f2a7', 'request_id': 'req-28fd33c3-3de9-47d8-912a-bb4896941682'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:04.385584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc064c859914edda3db692ebf54f2a7', 'request_id': 'req-28fd33c3-3de9-47d8-912a-bb4896941682'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:04.401095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] The token cache is being invalidate because project cfc064c859914edda3db692ebf54f2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:29:04.401436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:04.402086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-28fd33c3-3de9-47d8-912a-bb4896941682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:04.403958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1216/2431] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:29:04 2022] DELETE /identity/v3/projects/cfc064c859914edda3db692ebf54f2a7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:29:04.860522 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:04.862566 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:04.874854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:04.953532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe2a36-5754-44fc-b975-82e7be696386 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:05.016280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1c6c7-8236-4758-9a74-87c4ec15d2b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:05.017463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c6c7-8236-4758-9a74-87c4ec15d2b4 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:05.017753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c6c7-8236-4758-9a74-87c4ec15d2b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:05.018036 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c6c7-8236-4758-9a74-87c4ec15d2b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:05.019881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5da1c6c7-8236-4758-9a74-87c4ec15d2b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:05.032035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1c6c7-8236-4758-9a74-87c4ec15d2b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:05.033687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1c6c7-8236-4758-9a74-87c4ec15d2b4 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:05.043999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1216/2432] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:13.471533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba528d58-dd6c-4083-8799-3dc48fc105c5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:13.472013 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba528d58-dd6c-4083-8799-3dc48fc105c5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:13.472287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba528d58-dd6c-4083-8799-3dc48fc105c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:13.491992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ba528d58-dd6c-4083-8799-3dc48fc105c5 None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:13.493325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ba528d58-dd6c-4083-8799-3dc48fc105c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:13.497744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:13.550033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1217/2433] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:13.562083 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1c6c7-8236-4758-9a74-87c4ec15d2b4 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:13.563532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5da1c6c7-8236-4758-9a74-87c4ec15d2b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:13.632522 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1c6c7-8236-4758-9a74-87c4ec15d2b4 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:13.637358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e19aea-c1cd-4f8b-9bbd-aa1f195c5918 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:13.637993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e19aea-c1cd-4f8b-9bbd-aa1f195c5918 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:13.638276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e19aea-c1cd-4f8b-9bbd-aa1f195c5918 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:13.638552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e19aea-c1cd-4f8b-9bbd-aa1f195c5918 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:13.646785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e19aea-c1cd-4f8b-9bbd-aa1f195c5918 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:13.648406 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e19aea-c1cd-4f8b-9bbd-aa1f195c5918 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:13.656267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1217/2434] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:29:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:29:23.542803 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=21 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:23.653051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:28.615134 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba528d58-dd6c-4083-8799-3dc48fc105c5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:28.616780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ba528d58-dd6c-4083-8799-3dc48fc105c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:28.677511 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba528d58-dd6c-4083-8799-3dc48fc105c5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:28.681153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8f762-77ad-401e-94b7-292a67527750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:28.681803 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8f762-77ad-401e-94b7-292a67527750 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:28.682090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8f762-77ad-401e-94b7-292a67527750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:28.682370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8f762-77ad-401e-94b7-292a67527750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:28.684198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-90f8f762-77ad-401e-94b7-292a67527750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:28.756314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8f762-77ad-401e-94b7-292a67527750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:28.757764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8f762-77ad-401e-94b7-292a67527750 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:28.771156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1218/2435] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:29.590101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1530-86ef-4cc2-8e13-bd22a8690b18 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:29.590629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1530-86ef-4cc2-8e13-bd22a8690b18 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:29.590763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1530-86ef-4cc2-8e13-bd22a8690b18 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:29.592046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1218/2436] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:29:29.598787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa486b-2ddb-49b6-b519-183f57383708 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:29.599114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa486b-2ddb-49b6-b519-183f57383708 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:29.599405 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa486b-2ddb-49b6-b519-183f57383708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:29.639218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-dcfa486b-2ddb-49b6-b519-183f57383708 None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:29.641927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dcfa486b-2ddb-49b6-b519-183f57383708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:29.659697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1219/2437] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:29:29.671872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a1530-86ef-4cc2-8e13-bd22a8690b18 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:29.673635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bc0a1530-86ef-4cc2-8e13-bd22a8690b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:29.767149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a1530-86ef-4cc2-8e13-bd22a8690b18 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:29.770890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e410abd-74a7-4355-95df-d692b6af30e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd82125a47ce044b389684b97c7097ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:29.771533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410abd-74a7-4355-95df-d692b6af30e6 service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:29.771824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410abd-74a7-4355-95df-d692b6af30e6 service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:29.772140 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410abd-74a7-4355-95df-d692b6af30e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:29.782314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e410abd-74a7-4355-95df-d692b6af30e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:29.783752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e410abd-74a7-4355-95df-d692b6af30e6 service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:29.794762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1219/2438] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:29.868006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda6b2d-093b-45ce-8fe7-e4ae7220cbe8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:29.868338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda6b2d-093b-45ce-8fe7-e4ae7220cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:29.868958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda6b2d-093b-45ce-8fe7-e4ae7220cbe8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:29.870016 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1220/2439] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:29:29.875739 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00e50-3e63-4e0f-a08b-8b739d96f58c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:29.876136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00e50-3e63-4e0f-a08b-8b739d96f58c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:29.876418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00e50-3e63-4e0f-a08b-8b739d96f58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:29.895775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a0f00e50-3e63-4e0f-a08b-8b739d96f58c None None] MFA Rules not processed for user `b37002ecc6384dc08fca3ddf6ca2f9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:29.906018 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a0f00e50-3e63-4e0f-a08b-8b739d96f58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:29.914132 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1220/2440] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:29.927483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda6b2d-093b-45ce-8fe7-e4ae7220cbe8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:29.929216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6bda6b2d-093b-45ce-8fe7-e4ae7220cbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:29.944130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda6b2d-093b-45ce-8fe7-e4ae7220cbe8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:29.948336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb593619-712a-42d9-9567-c71ea59f7daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:29.948992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb593619-712a-42d9-9567-c71ea59f7daa service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:29.949278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb593619-712a-42d9-9567-c71ea59f7daa service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:29.949558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb593619-712a-42d9-9567-c71ea59f7daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:29.958104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb593619-712a-42d9-9567-c71ea59f7daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:29.959903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb593619-712a-42d9-9567-c71ea59f7daa service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:29.973030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1221/2441] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:30.065171 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81403d61-cad2-4535-b65e-14d523be79df None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:30.065506 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81403d61-cad2-4535-b65e-14d523be79df None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:30.065887 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81403d61-cad2-4535-b65e-14d523be79df None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:30.067867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1221/2442] 10.222.0.66 () {54 vars in 921 bytes} [Wed Jun 22 12:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 12:29:30.073704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a153de-f60b-4e22-acbd-53e58bebd8ed None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:30.073997 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a153de-f60b-4e22-acbd-53e58bebd8ed None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:30.074281 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a153de-f60b-4e22-acbd-53e58bebd8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:30.096369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-13a153de-f60b-4e22-acbd-53e58bebd8ed None None] MFA Rules not processed for user `1df703568a334eea9550ac643d87b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:30.097770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-13a153de-f60b-4e22-acbd-53e58bebd8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:30.108309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1222/2443] 10.222.0.66 () {58 vars in 1018 bytes} [Wed Jun 22 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:30.119114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81403d61-cad2-4535-b65e-14d523be79df None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:30.130610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81403d61-cad2-4535-b65e-14d523be79df None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:30.134204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055d73-aaa2-4605-b061-d169b68b5c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:30.134872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055d73-aaa2-4605-b061-d169b68b5c52 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:30.135161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055d73-aaa2-4605-b061-d169b68b5c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:30.135443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055d73-aaa2-4605-b061-d169b68b5c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:30.146193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055d73-aaa2-4605-b061-d169b68b5c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:30.147685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055d73-aaa2-4605-b061-d169b68b5c52 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:30.159214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1222/2444] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:31.992543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898dfa-93e8-4d5b-a647-cd4dc09e52c7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:31.993109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898dfa-93e8-4d5b-a647-cd4dc09e52c7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:31.993340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898dfa-93e8-4d5b-a647-cd4dc09e52c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:32.019167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-23898dfa-93e8-4d5b-a647-cd4dc09e52c7 None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:32.020724 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-23898dfa-93e8-4d5b-a647-cd4dc09e52c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:32.039790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1223/2445] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:29:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:32.046828 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055d73-aaa2-4605-b061-d169b68b5c52 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:32.060351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055d73-aaa2-4605-b061-d169b68b5c52 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:32.068070 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b066084-5054-4e32-8bcc-92e84def3c99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:32.069058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b066084-5054-4e32-8bcc-92e84def3c99 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:32.069559 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b066084-5054-4e32-8bcc-92e84def3c99 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:32.070050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b066084-5054-4e32-8bcc-92e84def3c99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:32.090898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b066084-5054-4e32-8bcc-92e84def3c99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:32.093874 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b066084-5054-4e32-8bcc-92e84def3c99 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:32.108642 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1223/2446] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:29:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:29:32.556953 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898dfa-93e8-4d5b-a647-cd4dc09e52c7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:32.560871 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-23898dfa-93e8-4d5b-a647-cd4dc09e52c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:32.600703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898dfa-93e8-4d5b-a647-cd4dc09e52c7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:32.608105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729023b0-d960-42e5-bf74-07f0aec4fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:32.611072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729023b0-d960-42e5-bf74-07f0aec4fcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:32.611663 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729023b0-d960-42e5-bf74-07f0aec4fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:32.612371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729023b0-d960-42e5-bf74-07f0aec4fcdd admin admin] PATH_INFO: `/v3/users/7f78f3daa4744f41a914c0563982b79a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:32.614948 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729023b0-d960-42e5-bf74-07f0aec4fcdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f78f3daa4744f41a914c0563982b79a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:32.617748 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729023b0-d960-42e5-bf74-07f0aec4fcdd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:32.716577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-729023b0-d960-42e5-bf74-07f0aec4fcdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f78f3daa4744f41a914c0563982b79a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:32.726603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:32.731931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-729023b0-d960-42e5-bf74-07f0aec4fcdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f78f3daa4744f41a914c0563982b79a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:32.742689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-729023b0-d960-42e5-bf74-07f0aec4fcdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f78f3daa4744f41a914c0563982b79a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:32.747548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-729023b0-d960-42e5-bf74-07f0aec4fcdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f78f3daa4744f41a914c0563982b79a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:32.756106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-729023b0-d960-42e5-bf74-07f0aec4fcdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f78f3daa4744f41a914c0563982b79a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:32.763725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1224/2447] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:29:32 2022] DELETE /identity/v3/users/7f78f3daa4744f41a914c0563982b79a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:29:32.974704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b066084-5054-4e32-8bcc-92e84def3c99 service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:32.993857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b066084-5054-4e32-8bcc-92e84def3c99 service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:33.075836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:33.076758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:33.077044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:33.077320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] PATH_INFO: `/v3/projects/e5058d932d2245daa0e0da4bf69d0434` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:33.079532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5058d932d2245daa0e0da4bf69d0434)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:33.082388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:33.135332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5058d932d2245daa0e0da4bf69d0434', 'request_id': 'req-7dce093c-a579-4f9c-9b42-ce360cbfd606'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:33.138248 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:33.144254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5058d932d2245daa0e0da4bf69d0434', 'request_id': 'req-7dce093c-a579-4f9c-9b42-ce360cbfd606'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:33.151677 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5058d932d2245daa0e0da4bf69d0434', 'request_id': 'req-7dce093c-a579-4f9c-9b42-ce360cbfd606'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:33.165931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] The token cache is being invalidate because project e5058d932d2245daa0e0da4bf69d0434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:29:33.166237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:33.166856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7dce093c-a579-4f9c-9b42-ce360cbfd606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:33.168596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1224/2448] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:29:32 2022] DELETE /identity/v3/projects/e5058d932d2245daa0e0da4bf69d0434 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:29:33.174093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af555-0ed4-4295-bf15-e8e048a9f2cb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:33.174582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af555-0ed4-4295-bf15-e8e048a9f2cb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:33.174734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af555-0ed4-4295-bf15-e8e048a9f2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:33.193573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-926af555-0ed4-4295-bf15-e8e048a9f2cb None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:33.194780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-926af555-0ed4-4295-bf15-e8e048a9f2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:33.256683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1225/2449] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:29:33.266537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e308147-6ce3-4157-812f-d2f66d7a2eb2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:33.266868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e308147-6ce3-4157-812f-d2f66d7a2eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:33.267259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e308147-6ce3-4157-812f-d2f66d7a2eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:33.294358 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1e308147-6ce3-4157-812f-d2f66d7a2eb2 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:33.295585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1e308147-6ce3-4157-812f-d2f66d7a2eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:33.303981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1225/2450] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:33.308067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af555-0ed4-4295-bf15-e8e048a9f2cb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:33.318979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af555-0ed4-4295-bf15-e8e048a9f2cb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:33.323671 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5efec3-9aed-4f76-8697-e3146dd66e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:33.324506 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5efec3-9aed-4f76-8697-e3146dd66e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:33.324799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5efec3-9aed-4f76-8697-e3146dd66e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:33.325085 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5efec3-9aed-4f76-8697-e3146dd66e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:33.325824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5efec3-9aed-4f76-8697-e3146dd66e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:29:33.326140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5efec3-9aed-4f76-8697-e3146dd66e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:33.327756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5efec3-9aed-4f76-8697-e3146dd66e56 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:33.344483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1226/2451] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:29:33.345633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e308147-6ce3-4157-812f-d2f66d7a2eb2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:33.355634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e308147-6ce3-4157-812f-d2f66d7a2eb2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:33.360456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ad4a2-3d12-4e40-9ae0-f2bf74dc137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:33.361129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ad4a2-3d12-4e40-9ae0-f2bf74dc137d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:33.361417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ad4a2-3d12-4e40-9ae0-f2bf74dc137d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:33.361698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ad4a2-3d12-4e40-9ae0-f2bf74dc137d admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:33.362537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ad4a2-3d12-4e40-9ae0-f2bf74dc137d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:33.365073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ad4a2-3d12-4e40-9ae0-f2bf74dc137d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:33.397205 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1226/2452] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:29:33 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:29:33.401040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5efec3-9aed-4f76-8697-e3146dd66e56 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:33.413672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5efec3-9aed-4f76-8697-e3146dd66e56 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:33.511445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f97b7a-837f-4025-928c-fcadce8ba14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:33.512169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97b7a-837f-4025-928c-fcadce8ba14c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:33.512456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97b7a-837f-4025-928c-fcadce8ba14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:33.512876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97b7a-837f-4025-928c-fcadce8ba14c admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:33.513601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f97b7a-837f-4025-928c-fcadce8ba14c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:33.516193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f97b7a-837f-4025-928c-fcadce8ba14c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:33.574373 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1227/2453] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:29:33 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:29:33.575461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ad4a2-3d12-4e40-9ae0-f2bf74dc137d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:33.589043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ad4a2-3d12-4e40-9ae0-f2bf74dc137d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:33.595561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44347b1-6124-4823-b899-c7ee369bd8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:33.601901 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44347b1-6124-4823-b899-c7ee369bd8cd admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:33.602267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44347b1-6124-4823-b899-c7ee369bd8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:33.602563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44347b1-6124-4823-b899-c7ee369bd8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:33.603408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44347b1-6124-4823-b899-c7ee369bd8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:33.605346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44347b1-6124-4823-b899-c7ee369bd8cd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:33.620776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1227/2454] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:29:33.624436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f97b7a-837f-4025-928c-fcadce8ba14c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:33.640002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f97b7a-837f-4025-928c-fcadce8ba14c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:33.655940 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf30f-e674-44cb-b0f5-fbf8abcebd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:33.656793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf30f-e674-44cb-b0f5-fbf8abcebd7f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:33.657177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf30f-e674-44cb-b0f5-fbf8abcebd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:33.657526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf30f-e674-44cb-b0f5-fbf8abcebd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:33.658414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf30f-e674-44cb-b0f5-fbf8abcebd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:33.660274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf30f-e674-44cb-b0f5-fbf8abcebd7f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:33.683205 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1228/2455] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:29:33.687128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44347b1-6124-4823-b899-c7ee369bd8cd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:33.702527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44347b1-6124-4823-b899-c7ee369bd8cd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:33.707533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee9eb6-5659-4cc3-88e4-f55acfbeb218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:33.708591 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9eb6-5659-4cc3-88e4-f55acfbeb218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:33.708859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9eb6-5659-4cc3-88e4-f55acfbeb218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:33.709138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9eb6-5659-4cc3-88e4-f55acfbeb218 admin admin] PATH_INFO: `/v3/projects/f15dca0429914a298b7dba0d9f83636d/users/853789bdb5634371b0ba50f17b6b6eef/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:33.726972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee9eb6-5659-4cc3-88e4-f55acfbeb218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15dca0429914a298b7dba0d9f83636d, user_id=853789bdb5634371b0ba50f17b6b6eef, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:33.730074 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee9eb6-5659-4cc3-88e4-f55acfbeb218 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:33.770549 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1228/2456] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:29:33 2022] PUT /identity/v3/projects/f15dca0429914a298b7dba0d9f83636d/users/853789bdb5634371b0ba50f17b6b6eef/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:29:33.781512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76792c6b-eda5-48ac-b585-16f9e45da68d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:33.781815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76792c6b-eda5-48ac-b585-16f9e45da68d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:33.782084 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76792c6b-eda5-48ac-b585-16f9e45da68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:33.819237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-76792c6b-eda5-48ac-b585-16f9e45da68d None None] MFA Rules not processed for user `853789bdb5634371b0ba50f17b6b6eef`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:33.820539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-76792c6b-eda5-48ac-b585-16f9e45da68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:33.869879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:33.912072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1229/2457] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:33.925172 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee9eb6-5659-4cc3-88e4-f55acfbeb218 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:33.927029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-97ee9eb6-5659-4cc3-88e4-f55acfbeb218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:34.011332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee9eb6-5659-4cc3-88e4-f55acfbeb218 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:34.017136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b96cb-1254-44ca-9a01-b41914fa9b10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:34.017795 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b96cb-1254-44ca-9a01-b41914fa9b10 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:34.018080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b96cb-1254-44ca-9a01-b41914fa9b10 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:34.018357 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b96cb-1254-44ca-9a01-b41914fa9b10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:34.027003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b96cb-1254-44ca-9a01-b41914fa9b10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:34.028743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b96cb-1254-44ca-9a01-b41914fa9b10 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:34.039240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1229/2458] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:36.764131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76792c6b-eda5-48ac-b585-16f9e45da68d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:36.835858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76792c6b-eda5-48ac-b585-16f9e45da68d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:36.840382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:36.841262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:36.841543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:36.841835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] PATH_INFO: `/v3/users/853789bdb5634371b0ba50f17b6b6eef` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:36.843005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=853789bdb5634371b0ba50f17b6b6eef)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:36.844994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:36.895891 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853789bdb5634371b0ba50f17b6b6eef'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:36.908997 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853789bdb5634371b0ba50f17b6b6eef'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:36.917851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853789bdb5634371b0ba50f17b6b6eef'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:36.918722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853789bdb5634371b0ba50f17b6b6eef'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:36.929071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853789bdb5634371b0ba50f17b6b6eef'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:36.935967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1230/2459] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:29:36 2022] DELETE /identity/v3/users/853789bdb5634371b0ba50f17b6b6eef => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:29:36.940538 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d78b6-06fb-4bf7-acba-8d9bb7ac8a6a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:36.941023 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d78b6-06fb-4bf7-acba-8d9bb7ac8a6a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:36.941123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d78b6-06fb-4bf7-acba-8d9bb7ac8a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:36.960388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-be7d78b6-06fb-4bf7-acba-8d9bb7ac8a6a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:36.961693 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-be7d78b6-06fb-4bf7-acba-8d9bb7ac8a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:37.036145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1230/2460] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:37.045158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:37.046582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:37.107524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b742c-69db-45ac-975e-0306fda6d303 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:37.111217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e242d-5329-4bfd-837b-b37495005bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:37.111866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e242d-5329-4bfd-837b-b37495005bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:37.112184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e242d-5329-4bfd-837b-b37495005bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:37.112461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e242d-5329-4bfd-837b-b37495005bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:37.118587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:37.122644 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e242d-5329-4bfd-837b-b37495005bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:37.125250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e242d-5329-4bfd-837b-b37495005bd4 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:37.140218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1231/2461] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:37.538740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d78b6-06fb-4bf7-acba-8d9bb7ac8a6a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:37.540943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-be7d78b6-06fb-4bf7-acba-8d9bb7ac8a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:37.549439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:37.556905 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d78b6-06fb-4bf7-acba-8d9bb7ac8a6a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:37.563527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:37.564581 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:37.564979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:37.565708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] PATH_INFO: `/v3/projects/f15dca0429914a298b7dba0d9f83636d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:37.567348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15dca0429914a298b7dba0d9f83636d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:37.569875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:37.627362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15dca0429914a298b7dba0d9f83636d', 'request_id': 'req-71596b6f-38fd-4947-b735-4b0e917a3145'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:37.634743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15dca0429914a298b7dba0d9f83636d', 'request_id': 'req-71596b6f-38fd-4947-b735-4b0e917a3145'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:37.641664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15dca0429914a298b7dba0d9f83636d', 'request_id': 'req-71596b6f-38fd-4947-b735-4b0e917a3145'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:37.660523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] The token cache is being invalidate because project f15dca0429914a298b7dba0d9f83636d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:29:37.660816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:37.661430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71596b6f-38fd-4947-b735-4b0e917a3145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:29:37.663240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1231/2462] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:29:37 2022] DELETE /identity/v3/projects/f15dca0429914a298b7dba0d9f83636d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:29:37.668457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b49d82-2575-451b-b98c-27811fce1388 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:37.668633 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b49d82-2575-451b-b98c-27811fce1388 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:37.670969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b49d82-2575-451b-b98c-27811fce1388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:37.700847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-64b49d82-2575-451b-b98c-27811fce1388 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:37.702063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-64b49d82-2575-451b-b98c-27811fce1388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:37.776062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1232/2463] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:37.779341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447964c-9935-4212-b9cb-1b2d356959f7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:37.779636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447964c-9935-4212-b9cb-1b2d356959f7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:37.779920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447964c-9935-4212-b9cb-1b2d356959f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:37.800096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5447964c-9935-4212-b9cb-1b2d356959f7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:37.801757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5447964c-9935-4212-b9cb-1b2d356959f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:37.810908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1232/2464] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:37.815370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b49d82-2575-451b-b98c-27811fce1388 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:37.826096 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b49d82-2575-451b-b98c-27811fce1388 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:37.831089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253e655-6ec9-4a7d-b399-1a84a8858589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:37.832042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e655-6ec9-4a7d-b399-1a84a8858589 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:37.832168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e655-6ec9-4a7d-b399-1a84a8858589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:37.832441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e655-6ec9-4a7d-b399-1a84a8858589 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:37.833192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253e655-6ec9-4a7d-b399-1a84a8858589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:29:37.833507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253e655-6ec9-4a7d-b399-1a84a8858589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:37.835152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253e655-6ec9-4a7d-b399-1a84a8858589 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:37.849208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1233/2465] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:29:37.853461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447964c-9935-4212-b9cb-1b2d356959f7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:37.863715 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447964c-9935-4212-b9cb-1b2d356959f7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:37.869801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f795547-ed57-4f31-b231-f144bd1dea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:37.870805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f795547-ed57-4f31-b231-f144bd1dea13 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:37.871348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f795547-ed57-4f31-b231-f144bd1dea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:37.871796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f795547-ed57-4f31-b231-f144bd1dea13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:37.872939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f795547-ed57-4f31-b231-f144bd1dea13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:37.875122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f795547-ed57-4f31-b231-f144bd1dea13 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:37.914288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1233/2466] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:29:37 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:29:37.918152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253e655-6ec9-4a7d-b399-1a84a8858589 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:37.930016 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253e655-6ec9-4a7d-b399-1a84a8858589 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:37.991121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ea9b9-0468-4f13-a0f0-515b9629f707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:37.991798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ea9b9-0468-4f13-a0f0-515b9629f707 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:37.992121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ea9b9-0468-4f13-a0f0-515b9629f707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:37.992411 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ea9b9-0468-4f13-a0f0-515b9629f707 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:37.993126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ea9b9-0468-4f13-a0f0-515b9629f707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:37.995053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ea9b9-0468-4f13-a0f0-515b9629f707 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:38.017995 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1234/2467] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:29:37 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:29:38.022206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f795547-ed57-4f31-b231-f144bd1dea13 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:38.034491 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f795547-ed57-4f31-b231-f144bd1dea13 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:38.039533 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398dac5-382a-448b-9aec-66aed3c65e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:38.040405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398dac5-382a-448b-9aec-66aed3c65e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:38.040942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398dac5-382a-448b-9aec-66aed3c65e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:38.041324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398dac5-382a-448b-9aec-66aed3c65e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:38.042197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398dac5-382a-448b-9aec-66aed3c65e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:38.043963 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398dac5-382a-448b-9aec-66aed3c65e38 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:38.054905 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1234/2468] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:29:38.059386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ea9b9-0468-4f13-a0f0-515b9629f707 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:38.069678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ea9b9-0468-4f13-a0f0-515b9629f707 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:38.074481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335434a-2bce-488b-b134-682335e71da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:38.075148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335434a-2bce-488b-b134-682335e71da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:38.075439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335434a-2bce-488b-b134-682335e71da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:38.075725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335434a-2bce-488b-b134-682335e71da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:38.076509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335434a-2bce-488b-b134-682335e71da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:38.078673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335434a-2bce-488b-b134-682335e71da6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:38.092049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1235/2469] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:29:38.094192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398dac5-382a-448b-9aec-66aed3c65e38 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:38.104854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398dac5-382a-448b-9aec-66aed3c65e38 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:38.109541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2cc55-e747-42b8-87c1-a00af16e60b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:38.110433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2cc55-e747-42b8-87c1-a00af16e60b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:38.110719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2cc55-e747-42b8-87c1-a00af16e60b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:38.111001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2cc55-e747-42b8-87c1-a00af16e60b7 admin admin] PATH_INFO: `/v3/projects/ead3492463b84840826f61b3f0fa8bcb/users/d4b0adf548804d5981ff64ae6b0bb56c/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:38.128152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2cc55-e747-42b8-87c1-a00af16e60b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead3492463b84840826f61b3f0fa8bcb, user_id=d4b0adf548804d5981ff64ae6b0bb56c, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:38.130742 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2cc55-e747-42b8-87c1-a00af16e60b7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:38.145877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1235/2470] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:29:38 2022] PUT /identity/v3/projects/ead3492463b84840826f61b3f0fa8bcb/users/d4b0adf548804d5981ff64ae6b0bb56c/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:29:38.157007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5cf83-da53-4e5d-96da-0a6e1e745bdd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:38.157400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5cf83-da53-4e5d-96da-0a6e1e745bdd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:38.157764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5cf83-da53-4e5d-96da-0a6e1e745bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:38.188472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c4f5cf83-da53-4e5d-96da-0a6e1e745bdd None None] MFA Rules not processed for user `d4b0adf548804d5981ff64ae6b0bb56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:38.189822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c4f5cf83-da53-4e5d-96da-0a6e1e745bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:38.239197 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:38.259239 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1236/2471] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:29:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:38.264340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2cc55-e747-42b8-87c1-a00af16e60b7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:38.337069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2cc55-e747-42b8-87c1-a00af16e60b7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:38.341915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22665d-664a-4a79-94d4-73ed2af572a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:38.342584 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22665d-664a-4a79-94d4-73ed2af572a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:38.342875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22665d-664a-4a79-94d4-73ed2af572a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:38.343143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22665d-664a-4a79-94d4-73ed2af572a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:38.344502 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22665d-664a-4a79-94d4-73ed2af572a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:38.346506 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22665d-664a-4a79-94d4-73ed2af572a2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:38.365665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:38.375462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1236/2472] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:29:38 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:29:38.379568 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5cf83-da53-4e5d-96da-0a6e1e745bdd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:38.397806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5cf83-da53-4e5d-96da-0a6e1e745bdd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:38.460935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4d69c-31cd-483d-8d58-80070c2e11f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:38.461602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d69c-31cd-483d-8d58-80070c2e11f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:38.461884 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d69c-31cd-483d-8d58-80070c2e11f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:38.462159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d69c-31cd-483d-8d58-80070c2e11f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:38.462862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4d69c-31cd-483d-8d58-80070c2e11f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:38.464829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4d69c-31cd-483d-8d58-80070c2e11f3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:38.492735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1237/2473] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:29:38 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:29:38.497089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22665d-664a-4a79-94d4-73ed2af572a2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:38.510369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22665d-664a-4a79-94d4-73ed2af572a2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:38.516618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ae45a-2c25-47dc-acd2-db9fba443f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:38.517318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ae45a-2c25-47dc-acd2-db9fba443f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:38.517667 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ae45a-2c25-47dc-acd2-db9fba443f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:38.518030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ae45a-2c25-47dc-acd2-db9fba443f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:38.518845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ae45a-2c25-47dc-acd2-db9fba443f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:38.520709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ae45a-2c25-47dc-acd2-db9fba443f46 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:38.545931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1237/2474] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:29:38.549641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4d69c-31cd-483d-8d58-80070c2e11f3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:38.563436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4d69c-31cd-483d-8d58-80070c2e11f3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:38.569888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207feb6-0316-44f5-9618-fe3ed26d6c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:38.570833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207feb6-0316-44f5-9618-fe3ed26d6c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:38.571079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207feb6-0316-44f5-9618-fe3ed26d6c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:38.571371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207feb6-0316-44f5-9618-fe3ed26d6c04 admin admin] PATH_INFO: `/v3/projects/30e289083a5045d3929b763ca8a2648d/users/f25271d27c6645f68a466559c4a675fa/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:38.595900 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207feb6-0316-44f5-9618-fe3ed26d6c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e289083a5045d3929b763ca8a2648d, user_id=f25271d27c6645f68a466559c4a675fa, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:38.600288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207feb6-0316-44f5-9618-fe3ed26d6c04 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:38.644112 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1238/2475] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:29:38 2022] PUT /identity/v3/projects/30e289083a5045d3929b763ca8a2648d/users/f25271d27c6645f68a466559c4a675fa/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:29:38.645706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ae45a-2c25-47dc-acd2-db9fba443f46 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:38.656765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ae45a-2c25-47dc-acd2-db9fba443f46 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:38.752510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f32be-9f91-45fd-bb2f-874f1cda7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:38.756831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f32be-9f91-45fd-bb2f-874f1cda7ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:38.757122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f32be-9f91-45fd-bb2f-874f1cda7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:38.757421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f32be-9f91-45fd-bb2f-874f1cda7ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:38.758171 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f32be-9f91-45fd-bb2f-874f1cda7ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:38.759854 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f32be-9f91-45fd-bb2f-874f1cda7ae1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:38.783082 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1238/2476] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:29:38.783908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207feb6-0316-44f5-9618-fe3ed26d6c04 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:38.796446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207feb6-0316-44f5-9618-fe3ed26d6c04 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:38.805726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0550b-0aad-47e0-80cf-c3f535a941ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:38.808161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0550b-0aad-47e0-80cf-c3f535a941ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:38.808161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0550b-0aad-47e0-80cf-c3f535a941ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:38.808161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0550b-0aad-47e0-80cf-c3f535a941ca admin admin] PATH_INFO: `/v3/projects/30e289083a5045d3929b763ca8a2648d/users/f25271d27c6645f68a466559c4a675fa/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:38.809947 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0550b-0aad-47e0-80cf-c3f535a941ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e289083a5045d3929b763ca8a2648d, user_id=f25271d27c6645f68a466559c4a675fa, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:38.818108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0550b-0aad-47e0-80cf-c3f535a941ca admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:38.830522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1239/2477] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:29:38 2022] PUT /identity/v3/projects/30e289083a5045d3929b763ca8a2648d/users/f25271d27c6645f68a466559c4a675fa/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:29:38.846057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9153fd-64a1-4add-ac48-8cceb964886d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:38.846366 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9153fd-64a1-4add-ac48-8cceb964886d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:38.846753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9153fd-64a1-4add-ac48-8cceb964886d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:38.877605 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0c9153fd-64a1-4add-ac48-8cceb964886d None None] MFA Rules not processed for user `f25271d27c6645f68a466559c4a675fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:38.882886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0c9153fd-64a1-4add-ac48-8cceb964886d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:38.972262 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1239/2478] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:29:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:38.985127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0550b-0aad-47e0-80cf-c3f535a941ca admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:38.987321 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-88d0550b-0aad-47e0-80cf-c3f535a941ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:39.081076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0550b-0aad-47e0-80cf-c3f535a941ca admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:39.085220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2cbe2-14bb-463f-a710-89ab2b071012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:39.086068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cbe2-14bb-463f-a710-89ab2b071012 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:39.086429 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cbe2-14bb-463f-a710-89ab2b071012 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:39.086783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cbe2-14bb-463f-a710-89ab2b071012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:39.102638 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2cbe2-14bb-463f-a710-89ab2b071012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:39.104040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2cbe2-14bb-463f-a710-89ab2b071012 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:39.114572 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1240/2479] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:39.187635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9153fd-64a1-4add-ac48-8cceb964886d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:39.197637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9153fd-64a1-4add-ac48-8cceb964886d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:39.201311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a4b6c-a0dc-431b-91c0-59694c308c3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:39.202025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a4b6c-a0dc-431b-91c0-59694c308c3a service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:39.202376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a4b6c-a0dc-431b-91c0-59694c308c3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:39.202718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a4b6c-a0dc-431b-91c0-59694c308c3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:39.261212 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a4b6c-a0dc-431b-91c0-59694c308c3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:39.262654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a4b6c-a0dc-431b-91c0-59694c308c3a service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:39.271947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1240/2480] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:49.110050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=75,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:49.267776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:29:49.467883 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0abcb-9709-428f-8f9b-225b6a0fbbf1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:49.468267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0abcb-9709-428f-8f9b-225b6a0fbbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:49.469242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0abcb-9709-428f-8f9b-225b6a0fbbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:49.487651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-12b0abcb-9709-428f-8f9b-225b6a0fbbf1 None None] MFA Rules not processed for user `ce4e586b71bf48d98c0974edfa7ce644`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:49.488905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-12b0abcb-9709-428f-8f9b-225b6a0fbbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:49.548729 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1241/2481] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:29:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:49.873051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a4b6c-a0dc-431b-91c0-59694c308c3a service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:49.874459 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d52a4b6c-a0dc-431b-91c0-59694c308c3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:49.932600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a4b6c-a0dc-431b-91c0-59694c308c3a service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:49.936353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ffaf7-ee0e-452c-97b2-6ad5e7c2943c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:49.937703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ffaf7-ee0e-452c-97b2-6ad5e7c2943c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:49.937847 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ffaf7-ee0e-452c-97b2-6ad5e7c2943c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:49.938050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ffaf7-ee0e-452c-97b2-6ad5e7c2943c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:49.939811 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-398ffaf7-ee0e-452c-97b2-6ad5e7c2943c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:49.949352 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ffaf7-ee0e-452c-97b2-6ad5e7c2943c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:49.950852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ffaf7-ee0e-452c-97b2-6ad5e7c2943c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:49.959470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1241/2482] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:29:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:29:50.671050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e6dfa-eb01-4b13-af64-1fa6bdbe1315 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:50.671522 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e6dfa-eb01-4b13-af64-1fa6bdbe1315 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:50.671616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e6dfa-eb01-4b13-af64-1fa6bdbe1315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:50.689445 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-937e6dfa-eb01-4b13-af64-1fa6bdbe1315 None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:29:50.690618 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-937e6dfa-eb01-4b13-af64-1fa6bdbe1315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:50.746933 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1242/2483] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 12:29:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:29:50.756904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ffaf7-ee0e-452c-97b2-6ad5e7c2943c service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:29:50.758365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-398ffaf7-ee0e-452c-97b2-6ad5e7c2943c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:29:50.842581 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ffaf7-ee0e-452c-97b2-6ad5e7c2943c service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:29:50.848496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd05cae-4276-4b67-96e6-63ae7f59bc8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:29:50.848999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd05cae-4276-4b67-96e6-63ae7f59bc8b service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:29:50.849357 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd05cae-4276-4b67-96e6-63ae7f59bc8b service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:29:50.849708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd05cae-4276-4b67-96e6-63ae7f59bc8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:29:50.858641 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd05cae-4276-4b67-96e6-63ae7f59bc8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:29:50.860327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd05cae-4276-4b67-96e6-63ae7f59bc8b service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:29:50.868771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1242/2484] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:29:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:30:00.738373 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=50 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:00.865283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=58 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:19.264132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e6dfa-eb01-4b13-af64-1fa6bdbe1315 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:19.341425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e6dfa-eb01-4b13-af64-1fa6bdbe1315 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:19.347850 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:19.348814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:19.349097 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:19.349372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] PATH_INFO: `/v3/users/d4b0adf548804d5981ff64ae6b0bb56c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:19.350575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b0adf548804d5981ff64ae6b0bb56c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:19.352728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:19.407226 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b0adf548804d5981ff64ae6b0bb56c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:19.424325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b0adf548804d5981ff64ae6b0bb56c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:19.433582 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b0adf548804d5981ff64ae6b0bb56c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:19.434950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b0adf548804d5981ff64ae6b0bb56c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:19.442942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b0adf548804d5981ff64ae6b0bb56c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:19.454683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24326f4-173b-436f-8348-1716a230d0aa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:19.455643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24326f4-173b-436f-8348-1716a230d0aa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:19.456119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24326f4-173b-436f-8348-1716a230d0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:19.458341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1243/2485] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:30:19 2022] DELETE /identity/v3/users/d4b0adf548804d5981ff64ae6b0bb56c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:30:19.476041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f24326f4-173b-436f-8348-1716a230d0aa None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:19.477340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f24326f4-173b-436f-8348-1716a230d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:19.548202 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1243/2486] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:19.559985 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:19.561456 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:19.621795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b265e6-02d3-4a64-a975-3e74bc721529 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:19.626012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f45327-ee67-45f9-9019-34ba314b8679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:19.626666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45327-ee67-45f9-9019-34ba314b8679 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:19.626951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45327-ee67-45f9-9019-34ba314b8679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:19.627235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45327-ee67-45f9-9019-34ba314b8679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:19.646558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f45327-ee67-45f9-9019-34ba314b8679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:19.648246 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f45327-ee67-45f9-9019-34ba314b8679 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:19.658639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1244/2487] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:19.969525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24326f4-173b-436f-8348-1716a230d0aa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:19.970959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f24326f4-173b-436f-8348-1716a230d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:19.983031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24326f4-173b-436f-8348-1716a230d0aa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:19.987711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:19.988703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:19.989055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:19.989339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] PATH_INFO: `/v3/projects/ead3492463b84840826f61b3f0fa8bcb` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:19.990593 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead3492463b84840826f61b3f0fa8bcb)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:19.992934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:20.040590 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead3492463b84840826f61b3f0fa8bcb', 'request_id': 'req-891cd6ef-c521-4b80-b577-74d40ff67fe0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.046604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead3492463b84840826f61b3f0fa8bcb', 'request_id': 'req-891cd6ef-c521-4b80-b577-74d40ff67fe0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.053027 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead3492463b84840826f61b3f0fa8bcb', 'request_id': 'req-891cd6ef-c521-4b80-b577-74d40ff67fe0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.064712 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] The token cache is being invalidate because project ead3492463b84840826f61b3f0fa8bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:30:20.064999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.065673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.067218 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1244/2488] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:30:19 2022] DELETE /identity/v3/projects/ead3492463b84840826f61b3f0fa8bcb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:20.071452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f45327-ee67-45f9-9019-34ba314b8679 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:20.082083 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f45327-ee67-45f9-9019-34ba314b8679 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:20.100432 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:20.144133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66423ce0-1381-421f-a28d-3f45d689fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:20.144998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66423ce0-1381-421f-a28d-3f45d689fe4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:20.145288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66423ce0-1381-421f-a28d-3f45d689fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:20.145547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66423ce0-1381-421f-a28d-3f45d689fe4c admin admin] PATH_INFO: `/v3/users/f25271d27c6645f68a466559c4a675fa` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:20.146715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66423ce0-1381-421f-a28d-3f45d689fe4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25271d27c6645f68a466559c4a675fa)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:20.148669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66423ce0-1381-421f-a28d-3f45d689fe4c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:20.194609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-66423ce0-1381-421f-a28d-3f45d689fe4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25271d27c6645f68a466559c4a675fa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.206401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-66423ce0-1381-421f-a28d-3f45d689fe4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25271d27c6645f68a466559c4a675fa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.213596 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-66423ce0-1381-421f-a28d-3f45d689fe4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25271d27c6645f68a466559c4a675fa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.214201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-66423ce0-1381-421f-a28d-3f45d689fe4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25271d27c6645f68a466559c4a675fa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.220974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-66423ce0-1381-421f-a28d-3f45d689fe4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25271d27c6645f68a466559c4a675fa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.227404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1245/2489] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:30:20 2022] DELETE /identity/v3/users/f25271d27c6645f68a466559c4a675fa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:20.501136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:20.504117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:20.526955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cd6ef-c521-4b80-b577-74d40ff67fe0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:20.589365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:20.590250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:20.590611 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:20.590952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] PATH_INFO: `/v3/projects/30e289083a5045d3929b763ca8a2648d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:20.592257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e289083a5045d3929b763ca8a2648d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:20.594169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:20.627723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:20.648513 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e289083a5045d3929b763ca8a2648d', 'request_id': 'req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.655782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e289083a5045d3929b763ca8a2648d', 'request_id': 'req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.663257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e289083a5045d3929b763ca8a2648d', 'request_id': 'req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.678437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] The token cache is being invalidate because project 30e289083a5045d3929b763ca8a2648d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:30:20.678821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.679543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5ccb49b3-92d8-4390-b6de-40ddef8dd7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:20.681264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1245/2490] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:30:20 2022] DELETE /identity/v3/projects/30e289083a5045d3929b763ca8a2648d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:20.686390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ef8c-d614-4056-9b45-b09b932d57a1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:20.686865 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ef8c-d614-4056-9b45-b09b932d57a1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:20.687059 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ef8c-d614-4056-9b45-b09b932d57a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:20.707475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ee89ef8c-d614-4056-9b45-b09b932d57a1 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:20.708824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ee89ef8c-d614-4056-9b45-b09b932d57a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:20.768603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1246/2491] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:30:20.777348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554d0e4-a2fb-44db-982d-c5aa08d42ffb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:20.777669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554d0e4-a2fb-44db-982d-c5aa08d42ffb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:20.777956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554d0e4-a2fb-44db-982d-c5aa08d42ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:20.796111 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7554d0e4-a2fb-44db-982d-c5aa08d42ffb None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:20.797319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7554d0e4-a2fb-44db-982d-c5aa08d42ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:20.805345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1246/2492] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:20.809543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89ef8c-d614-4056-9b45-b09b932d57a1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:20.819994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89ef8c-d614-4056-9b45-b09b932d57a1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:20.824606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa977317-abce-426a-931a-715ef5f93aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:20.825258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa977317-abce-426a-931a-715ef5f93aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:20.825551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa977317-abce-426a-931a-715ef5f93aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:20.825834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa977317-abce-426a-931a-715ef5f93aa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:20.826569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa977317-abce-426a-931a-715ef5f93aa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:30:20.826881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa977317-abce-426a-931a-715ef5f93aa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:20.828521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa977317-abce-426a-931a-715ef5f93aa5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:20.840966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1247/2493] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:30:20.845324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554d0e4-a2fb-44db-982d-c5aa08d42ffb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:20.854744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554d0e4-a2fb-44db-982d-c5aa08d42ffb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:20.859363 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4750b-5c43-46fa-852d-8865fe670cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:20.860036 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4750b-5c43-46fa-852d-8865fe670cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:20.860328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4750b-5c43-46fa-852d-8865fe670cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:20.860607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4750b-5c43-46fa-852d-8865fe670cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:20.861292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4750b-5c43-46fa-852d-8865fe670cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:20.863336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4750b-5c43-46fa-852d-8865fe670cc0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:20.895254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1247/2494] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:30:20 2022] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:20.896380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa977317-abce-426a-931a-715ef5f93aa5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:20.909744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa977317-abce-426a-931a-715ef5f93aa5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:20.946244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:20.981050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de312c0-2479-4320-8650-003809388d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:20.981764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de312c0-2479-4320-8650-003809388d66 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:20.982082 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de312c0-2479-4320-8650-003809388d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:20.982365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de312c0-2479-4320-8650-003809388d66 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:20.983063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de312c0-2479-4320-8650-003809388d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:20.985053 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de312c0-2479-4320-8650-003809388d66 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:21.004825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1248/2495] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:30:20 2022] POST /identity/v3/users => generated 278 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:21.008662 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4750b-5c43-46fa-852d-8865fe670cc0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:21.020693 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4750b-5c43-46fa-852d-8865fe670cc0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:21.025614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80b610-ddb7-44b7-97f4-eb1f013e5b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:21.026310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80b610-ddb7-44b7-97f4-eb1f013e5b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.026627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80b610-ddb7-44b7-97f4-eb1f013e5b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.026908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80b610-ddb7-44b7-97f4-eb1f013e5b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.027633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80b610-ddb7-44b7-97f4-eb1f013e5b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:21.029279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80b610-ddb7-44b7-97f4-eb1f013e5b74 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:21.039511 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1248/2496] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:30:21.043532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de312c0-2479-4320-8650-003809388d66 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:21.053974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de312c0-2479-4320-8650-003809388d66 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:21.058587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e17215-f41f-429b-9c59-e9d49207438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:21.059235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e17215-f41f-429b-9c59-e9d49207438a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.059524 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e17215-f41f-429b-9c59-e9d49207438a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.059805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e17215-f41f-429b-9c59-e9d49207438a admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.060697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e17215-f41f-429b-9c59-e9d49207438a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:21.062287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e17215-f41f-429b-9c59-e9d49207438a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:21.073685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1249/2497] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:21.077488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80b610-ddb7-44b7-97f4-eb1f013e5b74 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:21.087481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80b610-ddb7-44b7-97f4-eb1f013e5b74 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:21.092194 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa21a8-f174-4d75-a893-602b05db402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:21.093010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa21a8-f174-4d75-a893-602b05db402b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.093291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa21a8-f174-4d75-a893-602b05db402b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.093579 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa21a8-f174-4d75-a893-602b05db402b admin admin] PATH_INFO: `/v3/projects/beb6c98916dc43af9346906ce855950b/users/5ddc3b0bfd0749948acca6bad40858d2/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.107955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa21a8-f174-4d75-a893-602b05db402b admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb6c98916dc43af9346906ce855950b, user_id=5ddc3b0bfd0749948acca6bad40858d2, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:21.110643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa21a8-f174-4d75-a893-602b05db402b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:21.125082 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1249/2498] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:21 2022] PUT /identity/v3/projects/beb6c98916dc43af9346906ce855950b/users/5ddc3b0bfd0749948acca6bad40858d2/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:21.135659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fd7af-da20-4fc2-be36-173ccfdc5b39 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.135957 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fd7af-da20-4fc2-be36-173ccfdc5b39 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.136277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fd7af-da20-4fc2-be36-173ccfdc5b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.165310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-574fd7af-da20-4fc2-be36-173ccfdc5b39 None None] MFA Rules not processed for user `5ddc3b0bfd0749948acca6bad40858d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:21.166587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-574fd7af-da20-4fc2-be36-173ccfdc5b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:21.232104 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1250/2499] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:21 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:21.236548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa21a8-f174-4d75-a893-602b05db402b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:21.306315 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa21a8-f174-4d75-a893-602b05db402b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:21.311035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582966aa-7ac5-4550-bf51-0407272247ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:21.311696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582966aa-7ac5-4550-bf51-0407272247ea admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.311977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582966aa-7ac5-4550-bf51-0407272247ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.312290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582966aa-7ac5-4550-bf51-0407272247ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.312979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582966aa-7ac5-4550-bf51-0407272247ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:21.314870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582966aa-7ac5-4550-bf51-0407272247ea admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:21.340618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1250/2500] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:30:21 2022] POST /identity/v3/projects => generated 355 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:21.344833 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fd7af-da20-4fc2-be36-173ccfdc5b39 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:21.355364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fd7af-da20-4fc2-be36-173ccfdc5b39 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:21.412149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b0a76-d537-433f-b0d6-821e4000bb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:21.412823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b0a76-d537-433f-b0d6-821e4000bb78 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.413107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b0a76-d537-433f-b0d6-821e4000bb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.413401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b0a76-d537-433f-b0d6-821e4000bb78 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.414090 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b0a76-d537-433f-b0d6-821e4000bb78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:21.416041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b0a76-d537-433f-b0d6-821e4000bb78 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:21.434856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1251/2501] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:30:21 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:21.439303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582966aa-7ac5-4550-bf51-0407272247ea admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:21.450291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582966aa-7ac5-4550-bf51-0407272247ea admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:21.455270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee3143-6f35-4d4c-8842-b89266d4b9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:21.455952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee3143-6f35-4d4c-8842-b89266d4b9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.456885 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee3143-6f35-4d4c-8842-b89266d4b9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.457178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee3143-6f35-4d4c-8842-b89266d4b9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.457918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee3143-6f35-4d4c-8842-b89266d4b9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:21.459515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee3143-6f35-4d4c-8842-b89266d4b9d1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:21.470392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1251/2502] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:21.474973 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b0a76-d537-433f-b0d6-821e4000bb78 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:21.484930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b0a76-d537-433f-b0d6-821e4000bb78 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:21.490190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e529f-5276-4682-9a9f-e8073de31c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:21.491061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e529f-5276-4682-9a9f-e8073de31c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.491348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e529f-5276-4682-9a9f-e8073de31c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.491627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e529f-5276-4682-9a9f-e8073de31c0a admin admin] PATH_INFO: `/v3/projects/02d42676cbce45d0bc495b8f2e9bdf85/users/75d13a7b288543a3ada413e1afa87049/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.506271 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e529f-5276-4682-9a9f-e8073de31c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d42676cbce45d0bc495b8f2e9bdf85, user_id=75d13a7b288543a3ada413e1afa87049, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:21.508986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e529f-5276-4682-9a9f-e8073de31c0a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:21.521845 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1252/2503] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:21 2022] PUT /identity/v3/projects/02d42676cbce45d0bc495b8f2e9bdf85/users/75d13a7b288543a3ada413e1afa87049/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:21.525746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee3143-6f35-4d4c-8842-b89266d4b9d1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:21.536424 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee3143-6f35-4d4c-8842-b89266d4b9d1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:21.558300 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:21.597938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169bad8-dc79-4271-ac7b-fc99e5ac869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:21.598527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169bad8-dc79-4271-ac7b-fc99e5ac869b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.598812 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169bad8-dc79-4271-ac7b-fc99e5ac869b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.599091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169bad8-dc79-4271-ac7b-fc99e5ac869b admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.599808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169bad8-dc79-4271-ac7b-fc99e5ac869b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:21.601455 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169bad8-dc79-4271-ac7b-fc99e5ac869b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:21.611398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1252/2504] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:21.616088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e529f-5276-4682-9a9f-e8073de31c0a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:21.621538 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:21.627725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e529f-5276-4682-9a9f-e8073de31c0a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:21.632703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55212b8d-7103-45d8-86ea-15921528a287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:21.633574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55212b8d-7103-45d8-86ea-15921528a287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.633857 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55212b8d-7103-45d8-86ea-15921528a287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.634138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55212b8d-7103-45d8-86ea-15921528a287 admin admin] PATH_INFO: `/v3/projects/02d42676cbce45d0bc495b8f2e9bdf85/users/75d13a7b288543a3ada413e1afa87049/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.636138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55212b8d-7103-45d8-86ea-15921528a287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d42676cbce45d0bc495b8f2e9bdf85, user_id=75d13a7b288543a3ada413e1afa87049, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:21.639046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55212b8d-7103-45d8-86ea-15921528a287 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:21.649609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1253/2505] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:21 2022] PUT /identity/v3/projects/02d42676cbce45d0bc495b8f2e9bdf85/users/75d13a7b288543a3ada413e1afa87049/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:21.660919 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c94efc-952b-4a14-a7ed-8258e0a5badf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.661210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c94efc-952b-4a14-a7ed-8258e0a5badf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.661494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c94efc-952b-4a14-a7ed-8258e0a5badf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.687664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-14c94efc-952b-4a14-a7ed-8258e0a5badf None None] MFA Rules not processed for user `75d13a7b288543a3ada413e1afa87049`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:21.688896 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-14c94efc-952b-4a14-a7ed-8258e0a5badf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:21.754966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1253/2506] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:21 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:21.767088 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55212b8d-7103-45d8-86ea-15921528a287 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:21.769801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-55212b8d-7103-45d8-86ea-15921528a287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:21.824951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55212b8d-7103-45d8-86ea-15921528a287 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:21.828616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be0830-1ae1-4797-9059-8c265faceee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:21.829251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be0830-1ae1-4797-9059-8c265faceee5 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.829533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be0830-1ae1-4797-9059-8c265faceee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.829808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be0830-1ae1-4797-9059-8c265faceee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.839460 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be0830-1ae1-4797-9059-8c265faceee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:21.840935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be0830-1ae1-4797-9059-8c265faceee5 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:21.850935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1254/2507] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:21 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:21.925687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c94efc-952b-4a14-a7ed-8258e0a5badf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:21.935319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c94efc-952b-4a14-a7ed-8258e0a5badf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:21.938916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc24fc-8297-413c-983d-4e3dabf2a767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:21.939545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc24fc-8297-413c-983d-4e3dabf2a767 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:21.939825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc24fc-8297-413c-983d-4e3dabf2a767 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:21.940127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc24fc-8297-413c-983d-4e3dabf2a767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:21.996482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc24fc-8297-413c-983d-4e3dabf2a767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:21.997938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc24fc-8297-413c-983d-4e3dabf2a767 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:22.007247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1254/2508] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:21 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:23.323660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be0830-1ae1-4797-9059-8c265faceee5 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:23.325797 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f1be0830-1ae1-4797-9059-8c265faceee5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:23.386267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be0830-1ae1-4797-9059-8c265faceee5 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:23.390270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e38ca-2b5e-4097-9eeb-5245e669a318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:23.390917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e38ca-2b5e-4097-9eeb-5245e669a318 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:23.391205 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e38ca-2b5e-4097-9eeb-5245e669a318 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:23.391486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e38ca-2b5e-4097-9eeb-5245e669a318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:23.393320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-432e38ca-2b5e-4097-9eeb-5245e669a318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:23.456276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e38ca-2b5e-4097-9eeb-5245e669a318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:23.457735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e38ca-2b5e-4097-9eeb-5245e669a318 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:23.467486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1255/2509] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:30:26.598517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc24fc-8297-413c-983d-4e3dabf2a767 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:26.600432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-44bc24fc-8297-413c-983d-4e3dabf2a767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:26.624304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc24fc-8297-413c-983d-4e3dabf2a767 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:26.630290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aae159-4558-4f96-a809-f39b99253dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:26.631514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aae159-4558-4f96-a809-f39b99253dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:26.631904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aae159-4558-4f96-a809-f39b99253dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:26.632384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aae159-4558-4f96-a809-f39b99253dd2 admin admin] PATH_INFO: `/v3/users/05ab28ce7db949cb9f322aedc4d5163f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:26.634271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aae159-4558-4f96-a809-f39b99253dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ab28ce7db949cb9f322aedc4d5163f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:26.636517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aae159-4558-4f96-a809-f39b99253dd2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:26.682497 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:26.690647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71aae159-4558-4f96-a809-f39b99253dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ab28ce7db949cb9f322aedc4d5163f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:26.708256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71aae159-4558-4f96-a809-f39b99253dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ab28ce7db949cb9f322aedc4d5163f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:26.715733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71aae159-4558-4f96-a809-f39b99253dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ab28ce7db949cb9f322aedc4d5163f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:26.716383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71aae159-4558-4f96-a809-f39b99253dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ab28ce7db949cb9f322aedc4d5163f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:26.723852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71aae159-4558-4f96-a809-f39b99253dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ab28ce7db949cb9f322aedc4d5163f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:26.729888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1255/2510] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:30:26 2022] DELETE /identity/v3/users/05ab28ce7db949cb9f322aedc4d5163f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:26.908381 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e38ca-2b5e-4097-9eeb-5245e669a318 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:26.921260 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e38ca-2b5e-4097-9eeb-5245e669a318 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:26.965438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:26.982971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:26.983827 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:26.984154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:26.984433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] PATH_INFO: `/v3/projects/2696e8302ee246eb850d7d471cbcd9b1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:26.985656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] RBAC: Authorizing `identity:delete_project(project_id=2696e8302ee246eb850d7d471cbcd9b1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:26.988156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:27.034926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2696e8302ee246eb850d7d471cbcd9b1', 'request_id': 'req-ec36d928-d643-440e-be7c-49a543a622de'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:27.040999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2696e8302ee246eb850d7d471cbcd9b1', 'request_id': 'req-ec36d928-d643-440e-be7c-49a543a622de'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:27.046527 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2696e8302ee246eb850d7d471cbcd9b1', 'request_id': 'req-ec36d928-d643-440e-be7c-49a543a622de'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:27.057965 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] The token cache is being invalidate because project 2696e8302ee246eb850d7d471cbcd9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:30:27.058249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:27.058866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec36d928-d643-440e-be7c-49a543a622de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:27.060696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1256/2511] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:30:26 2022] DELETE /identity/v3/projects/2696e8302ee246eb850d7d471cbcd9b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:27.065375 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34c1e9-43a0-49ae-87e4-6ab0392e0ab8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:27.065673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34c1e9-43a0-49ae-87e4-6ab0392e0ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:27.065994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34c1e9-43a0-49ae-87e4-6ab0392e0ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:27.084452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9f34c1e9-43a0-49ae-87e4-6ab0392e0ab8 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:27.085652 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9f34c1e9-43a0-49ae-87e4-6ab0392e0ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:27.148029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1256/2512] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:27.156399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778e148-d6a6-4b31-8884-33c11501001d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:27.156819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778e148-d6a6-4b31-8884-33c11501001d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:27.157101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778e148-d6a6-4b31-8884-33c11501001d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:27.176176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b778e148-d6a6-4b31-8884-33c11501001d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:27.177362 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b778e148-d6a6-4b31-8884-33c11501001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:27.185505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1257/2513] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:27.189683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34c1e9-43a0-49ae-87e4-6ab0392e0ab8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:27.199333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34c1e9-43a0-49ae-87e4-6ab0392e0ab8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:27.203860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc21f-d381-4f26-a4df-95c62f89d725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:27.204537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc21f-d381-4f26-a4df-95c62f89d725 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:27.204826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc21f-d381-4f26-a4df-95c62f89d725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:27.205108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc21f-d381-4f26-a4df-95c62f89d725 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:27.205830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adc21f-d381-4f26-a4df-95c62f89d725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:30:27.206706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adc21f-d381-4f26-a4df-95c62f89d725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:27.208330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adc21f-d381-4f26-a4df-95c62f89d725 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:27.220582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1257/2514] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:30:27.225730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778e148-d6a6-4b31-8884-33c11501001d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:27.236552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778e148-d6a6-4b31-8884-33c11501001d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:27.242701 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53ffe6-6af0-42ee-aaa9-48f0b43777a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:27.243504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ffe6-6af0-42ee-aaa9-48f0b43777a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:27.243912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ffe6-6af0-42ee-aaa9-48f0b43777a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:27.244244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ffe6-6af0-42ee-aaa9-48f0b43777a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:27.244950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53ffe6-6af0-42ee-aaa9-48f0b43777a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:27.247004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53ffe6-6af0-42ee-aaa9-48f0b43777a8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:27.274413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1258/2515] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:30:27 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:27.278646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc21f-d381-4f26-a4df-95c62f89d725 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:27.293024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc21f-d381-4f26-a4df-95c62f89d725 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:27.350262 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9454d4-d5e9-491f-8bc4-a91557163bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:27.350935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9454d4-d5e9-491f-8bc4-a91557163bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:27.351226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9454d4-d5e9-491f-8bc4-a91557163bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:27.351508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9454d4-d5e9-491f-8bc4-a91557163bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:27.352265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9454d4-d5e9-491f-8bc4-a91557163bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:27.354277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9454d4-d5e9-491f-8bc4-a91557163bc4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:27.374296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1258/2516] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:30:27 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:27.378587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53ffe6-6af0-42ee-aaa9-48f0b43777a8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:27.390057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53ffe6-6af0-42ee-aaa9-48f0b43777a8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:27.395501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8608e0-e399-4882-a12c-e0dcfbc54e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:27.396366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8608e0-e399-4882-a12c-e0dcfbc54e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:27.396767 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8608e0-e399-4882-a12c-e0dcfbc54e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:27.396957 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8608e0-e399-4882-a12c-e0dcfbc54e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:27.397665 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8608e0-e399-4882-a12c-e0dcfbc54e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:27.399243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8608e0-e399-4882-a12c-e0dcfbc54e7f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:27.414015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1259/2517] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:27.415235 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9454d4-d5e9-491f-8bc4-a91557163bc4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:27.425612 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9454d4-d5e9-491f-8bc4-a91557163bc4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:27.430472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e1ba5-2198-49f6-a692-a8109eb67564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:27.431138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e1ba5-2198-49f6-a692-a8109eb67564 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:27.431421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e1ba5-2198-49f6-a692-a8109eb67564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:27.431757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e1ba5-2198-49f6-a692-a8109eb67564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:27.432526 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e1ba5-2198-49f6-a692-a8109eb67564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:27.434117 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e1ba5-2198-49f6-a692-a8109eb67564 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:27.448504 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1259/2518] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:30:27.449700 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8608e0-e399-4882-a12c-e0dcfbc54e7f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:27.462595 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8608e0-e399-4882-a12c-e0dcfbc54e7f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:27.467771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bac63-a59c-40f5-a17f-ff8f1c9473f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:27.468839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bac63-a59c-40f5-a17f-ff8f1c9473f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:27.469309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bac63-a59c-40f5-a17f-ff8f1c9473f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:27.469862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bac63-a59c-40f5-a17f-ff8f1c9473f1 admin admin] PATH_INFO: `/v3/projects/7fae8f05846442a89f9a465b9aff359e/users/50f000ff43d842898f66808cae6a0f53/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:27.492648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bac63-a59c-40f5-a17f-ff8f1c9473f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fae8f05846442a89f9a465b9aff359e, user_id=50f000ff43d842898f66808cae6a0f53, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:27.495418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bac63-a59c-40f5-a17f-ff8f1c9473f1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:27.514215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1260/2519] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:27 2022] PUT /identity/v3/projects/7fae8f05846442a89f9a465b9aff359e/users/50f000ff43d842898f66808cae6a0f53/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:27.527436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb349a9b-df5f-4b70-a080-cae17bf0bdba None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:27.527734 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb349a9b-df5f-4b70-a080-cae17bf0bdba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:27.528049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb349a9b-df5f-4b70-a080-cae17bf0bdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:27.563380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fb349a9b-df5f-4b70-a080-cae17bf0bdba None None] MFA Rules not processed for user `50f000ff43d842898f66808cae6a0f53`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:27.564635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fb349a9b-df5f-4b70-a080-cae17bf0bdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:27.575373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:27.636531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1260/2520] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:27.648224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bac63-a59c-40f5-a17f-ff8f1c9473f1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:27.650058 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b00bac63-a59c-40f5-a17f-ff8f1c9473f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:27.707289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bac63-a59c-40f5-a17f-ff8f1c9473f1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:27.711145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0985-3792-449e-8f0e-80eb21ac93c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:27.711798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0985-3792-449e-8f0e-80eb21ac93c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:27.712117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0985-3792-449e-8f0e-80eb21ac93c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:27.712408 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0985-3792-449e-8f0e-80eb21ac93c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:27.721224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc0985-3792-449e-8f0e-80eb21ac93c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:27.722697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc0985-3792-449e-8f0e-80eb21ac93c9 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:27.731722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1261/2521] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:36.190822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb349a9b-df5f-4b70-a080-cae17bf0bdba None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:36.260731 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb349a9b-df5f-4b70-a080-cae17bf0bdba None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:36.265744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:36.266618 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:36.267010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:36.267190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] PATH_INFO: `/v3/users/50f000ff43d842898f66808cae6a0f53` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:36.269180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f000ff43d842898f66808cae6a0f53)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:36.271125 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:36.322158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f000ff43d842898f66808cae6a0f53'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:36.336220 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f000ff43d842898f66808cae6a0f53'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:36.344658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f000ff43d842898f66808cae6a0f53'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:36.345339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f000ff43d842898f66808cae6a0f53'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:36.353290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f000ff43d842898f66808cae6a0f53'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:36.360210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1261/2522] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:30:36 2022] DELETE /identity/v3/users/50f000ff43d842898f66808cae6a0f53 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:36.365042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5a84-4d8f-4c76-b4d3-f79746a6c75b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:36.365565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5a84-4d8f-4c76-b4d3-f79746a6c75b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:36.365671 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5a84-4d8f-4c76-b4d3-f79746a6c75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:36.383757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-14bc5a84-4d8f-4c76-b4d3-f79746a6c75b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:36.385331 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-14bc5a84-4d8f-4c76-b4d3-f79746a6c75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:36.390980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:36.454558 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1262/2523] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:36.465419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:36.467378 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:36.506573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:36.535330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6137fe2-e48c-4cff-9dee-328e91051749 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:36.541680 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b51153-b016-4912-a38c-13a3940186ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:36.542440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51153-b016-4912-a38c-13a3940186ad service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:36.542622 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51153-b016-4912-a38c-13a3940186ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:36.542904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b51153-b016-4912-a38c-13a3940186ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:36.554648 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b51153-b016-4912-a38c-13a3940186ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:36.556138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b51153-b016-4912-a38c-13a3940186ad service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:36.566799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1262/2524] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:36.866171 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc5a84-4d8f-4c76-b4d3-f79746a6c75b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:36.869816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-14bc5a84-4d8f-4c76-b4d3-f79746a6c75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:36.899413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc5a84-4d8f-4c76-b4d3-f79746a6c75b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:36.905598 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:36.907908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:36.907908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:36.907908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] PATH_INFO: `/v3/projects/7fae8f05846442a89f9a465b9aff359e` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:36.910839 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fae8f05846442a89f9a465b9aff359e)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:36.912360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:36.984209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fae8f05846442a89f9a465b9aff359e', 'request_id': 'req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:36.994006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fae8f05846442a89f9a465b9aff359e', 'request_id': 'req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:37.008679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fae8f05846442a89f9a465b9aff359e', 'request_id': 'req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:37.026518 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] The token cache is being invalidate because project 7fae8f05846442a89f9a465b9aff359e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:30:37.026814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:37.031189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-605b19cc-8ee0-4abb-8f2c-55cecb2a39e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:37.035311 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1263/2525] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:30:36 2022] DELETE /identity/v3/projects/7fae8f05846442a89f9a465b9aff359e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:37.038409 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd163a01-2c93-4947-bcbc-c4846def7dbd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.038710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd163a01-2c93-4947-bcbc-c4846def7dbd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.039025 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd163a01-2c93-4947-bcbc-c4846def7dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.066180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-dd163a01-2c93-4947-bcbc-c4846def7dbd None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:37.067470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dd163a01-2c93-4947-bcbc-c4846def7dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:37.138650 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1263/2526] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:37.146074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc5c35-97a8-4ae6-b608-2a304722871a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.146374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc5c35-97a8-4ae6-b608-2a304722871a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.146733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc5c35-97a8-4ae6-b608-2a304722871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.171549 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c3dc5c35-97a8-4ae6-b608-2a304722871a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:37.173198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c3dc5c35-97a8-4ae6-b608-2a304722871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:37.183478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1264/2527] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:37.188108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd163a01-2c93-4947-bcbc-c4846def7dbd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:37.198952 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd163a01-2c93-4947-bcbc-c4846def7dbd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:37.208392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cba733-b49a-40fd-a64f-04eb2b079d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:37.208621 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba733-b49a-40fd-a64f-04eb2b079d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.208918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba733-b49a-40fd-a64f-04eb2b079d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.209203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba733-b49a-40fd-a64f-04eb2b079d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.211638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cba733-b49a-40fd-a64f-04eb2b079d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:30:37.211996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cba733-b49a-40fd-a64f-04eb2b079d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:37.213731 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cba733-b49a-40fd-a64f-04eb2b079d1c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:37.227274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1264/2528] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:30:37.231776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc5c35-97a8-4ae6-b608-2a304722871a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:37.231923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cba733-b49a-40fd-a64f-04eb2b079d1c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:37.233749 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d2cba733-b49a-40fd-a64f-04eb2b079d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:37.242185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc5c35-97a8-4ae6-b608-2a304722871a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:37.248362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cba733-b49a-40fd-a64f-04eb2b079d1c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:37.248793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9a5be-b5e5-42bd-a4f5-3ba738ccd8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:37.249467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9a5be-b5e5-42bd-a4f5-3ba738ccd8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.249881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9a5be-b5e5-42bd-a4f5-3ba738ccd8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.250187 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9a5be-b5e5-42bd-a4f5-3ba738ccd8f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.250945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9a5be-b5e5-42bd-a4f5-3ba738ccd8f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:37.253170 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9a5be-b5e5-42bd-a4f5-3ba738ccd8f9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:37.254518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd03e7a-b184-4900-a7a6-4b2570f1c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:37.255399 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd03e7a-b184-4900-a7a6-4b2570f1c99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.255690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd03e7a-b184-4900-a7a6-4b2570f1c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.256101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd03e7a-b184-4900-a7a6-4b2570f1c99e admin admin] PATH_INFO: `/v3/users/5ddc3b0bfd0749948acca6bad40858d2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.257298 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd03e7a-b184-4900-a7a6-4b2570f1c99e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ddc3b0bfd0749948acca6bad40858d2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:37.259432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd03e7a-b184-4900-a7a6-4b2570f1c99e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:37.286118 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1265/2529] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:30:37 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:37.287215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9a5be-b5e5-42bd-a4f5-3ba738ccd8f9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:37.321701 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7dd03e7a-b184-4900-a7a6-4b2570f1c99e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ddc3b0bfd0749948acca6bad40858d2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:37.336978 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7dd03e7a-b184-4900-a7a6-4b2570f1c99e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ddc3b0bfd0749948acca6bad40858d2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:37.348331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7dd03e7a-b184-4900-a7a6-4b2570f1c99e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ddc3b0bfd0749948acca6bad40858d2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:37.349092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7dd03e7a-b184-4900-a7a6-4b2570f1c99e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ddc3b0bfd0749948acca6bad40858d2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:37.360797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7dd03e7a-b184-4900-a7a6-4b2570f1c99e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ddc3b0bfd0749948acca6bad40858d2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:37.368478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9a5be-b5e5-42bd-a4f5-3ba738ccd8f9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:37.371775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1265/2530] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:30:37 2022] DELETE /identity/v3/users/5ddc3b0bfd0749948acca6bad40858d2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:37.373229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292e28e-2672-4a99-b3de-20faad53a358 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.373619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292e28e-2672-4a99-b3de-20faad53a358 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.373996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292e28e-2672-4a99-b3de-20faad53a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.379876 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:37.393574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a292e28e-2672-4a99-b3de-20faad53a358 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:37.394859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a292e28e-2672-4a99-b3de-20faad53a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:37.435634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:37.437610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c3e1e-6ad6-435d-9804-b9b8a26bbefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:37.438615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c3e1e-6ad6-435d-9804-b9b8a26bbefb admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.438615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c3e1e-6ad6-435d-9804-b9b8a26bbefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.438851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c3e1e-6ad6-435d-9804-b9b8a26bbefb admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.439552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c3e1e-6ad6-435d-9804-b9b8a26bbefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:37.441963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c3e1e-6ad6-435d-9804-b9b8a26bbefb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:37.466764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1266/2531] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:30:37 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:37.470853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c3e1e-6ad6-435d-9804-b9b8a26bbefb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:37.473787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b23c3e1e-6ad6-435d-9804-b9b8a26bbefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:37.484050 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1266/2532] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:37.491501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c3e1e-6ad6-435d-9804-b9b8a26bbefb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:37.494085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292e28e-2672-4a99-b3de-20faad53a358 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:37.495614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a292e28e-2672-4a99-b3de-20faad53a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:37.497127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafabd8f-b268-4be1-99ca-87ed8b79292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:37.497795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafabd8f-b268-4be1-99ca-87ed8b79292d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.498080 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafabd8f-b268-4be1-99ca-87ed8b79292d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.498365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafabd8f-b268-4be1-99ca-87ed8b79292d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.499103 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafabd8f-b268-4be1-99ca-87ed8b79292d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:37.500762 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafabd8f-b268-4be1-99ca-87ed8b79292d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:37.512272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1267/2533] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:37.516390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafabd8f-b268-4be1-99ca-87ed8b79292d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:37.529375 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafabd8f-b268-4be1-99ca-87ed8b79292d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:37.536067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2d5d-0449-416c-91a2-0915a878e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:37.537070 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2d5d-0449-416c-91a2-0915a878e0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.537417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2d5d-0449-416c-91a2-0915a878e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.537922 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2d5d-0449-416c-91a2-0915a878e0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.539547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d2d5d-0449-416c-91a2-0915a878e0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:37.541795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d2d5d-0449-416c-91a2-0915a878e0ee admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:37.553173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1268/2534] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:30:37.557269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2d5d-0449-416c-91a2-0915a878e0ee admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:37.566435 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292e28e-2672-4a99-b3de-20faad53a358 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:37.567905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2d5d-0449-416c-91a2-0915a878e0ee admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:37.571709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b343a43-f739-4c39-97b6-68a99ae80bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:37.572615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343a43-f739-4c39-97b6-68a99ae80bfb service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.572804 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0abf57-d5ab-42a3-9482-8cb1a0bc86cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:37.573311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343a43-f739-4c39-97b6-68a99ae80bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.573775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0abf57-d5ab-42a3-9482-8cb1a0bc86cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.574061 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0abf57-d5ab-42a3-9482-8cb1a0bc86cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.574344 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0abf57-d5ab-42a3-9482-8cb1a0bc86cb admin admin] PATH_INFO: `/v3/projects/f1abaef6bf37416bbd488d1efb46b13c/users/85cf22e14ff7427ca7e0e614321180c0/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.574862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343a43-f739-4c39-97b6-68a99ae80bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.585886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b343a43-f739-4c39-97b6-68a99ae80bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:37.587716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b343a43-f739-4c39-97b6-68a99ae80bfb service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:37.591767 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0abf57-d5ab-42a3-9482-8cb1a0bc86cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1abaef6bf37416bbd488d1efb46b13c, user_id=85cf22e14ff7427ca7e0e614321180c0, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:37.594715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0abf57-d5ab-42a3-9482-8cb1a0bc86cb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:37.599543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1267/2535] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:30:37.610609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1269/2536] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:37 2022] PUT /identity/v3/projects/f1abaef6bf37416bbd488d1efb46b13c/users/85cf22e14ff7427ca7e0e614321180c0/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:30:37.621613 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40013822-4b5e-43ea-a097-93f64fd1be32 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.622026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40013822-4b5e-43ea-a097-93f64fd1be32 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.622462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40013822-4b5e-43ea-a097-93f64fd1be32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.654005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-40013822-4b5e-43ea-a097-93f64fd1be32 None None] MFA Rules not processed for user `85cf22e14ff7427ca7e0e614321180c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:37.655234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-40013822-4b5e-43ea-a097-93f64fd1be32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:37.743072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1268/2537] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:37.747172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0abf57-d5ab-42a3-9482-8cb1a0bc86cb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:37.839694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0abf57-d5ab-42a3-9482-8cb1a0bc86cb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:37.846439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c21a7-ca4c-4a39-a693-274af5c64200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:37.847246 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c21a7-ca4c-4a39-a693-274af5c64200 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.847716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c21a7-ca4c-4a39-a693-274af5c64200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.848160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c21a7-ca4c-4a39-a693-274af5c64200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.848983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c21a7-ca4c-4a39-a693-274af5c64200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:37.851223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c21a7-ca4c-4a39-a693-274af5c64200 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:37.880932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1270/2538] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:30:37 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:30:37.885515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40013822-4b5e-43ea-a097-93f64fd1be32 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:37.905931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40013822-4b5e-43ea-a097-93f64fd1be32 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:37.911365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c21a7-ca4c-4a39-a693-274af5c64200 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:37.914823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-485c21a7-ca4c-4a39-a693-274af5c64200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:37.971915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b72f9-70ad-43d3-8cb8-940419d0442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:37.972691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b72f9-70ad-43d3-8cb8-940419d0442f admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:37.972945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b72f9-70ad-43d3-8cb8-940419d0442f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:37.973226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b72f9-70ad-43d3-8cb8-940419d0442f admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:37.973923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b72f9-70ad-43d3-8cb8-940419d0442f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:37.975006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:37.976061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b72f9-70ad-43d3-8cb8-940419d0442f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:37.986097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:37.998095 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c21a7-ca4c-4a39-a693-274af5c64200 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:37.998786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1269/2539] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:30:37 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:38.002700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b72f9-70ad-43d3-8cb8-940419d0442f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:38.008527 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:38.009760 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:38.010052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:38.010330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] PATH_INFO: `/v3/projects/beb6c98916dc43af9346906ce855950b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:38.011636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb6c98916dc43af9346906ce855950b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:38.013889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:38.015716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b72f9-70ad-43d3-8cb8-940419d0442f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:38.020945 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca29f5-dad9-4c4b-aabe-07d71754149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:38.021693 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca29f5-dad9-4c4b-aabe-07d71754149f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:38.022053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca29f5-dad9-4c4b-aabe-07d71754149f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:38.022421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca29f5-dad9-4c4b-aabe-07d71754149f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:38.023620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca29f5-dad9-4c4b-aabe-07d71754149f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:38.025443 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca29f5-dad9-4c4b-aabe-07d71754149f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:38.039753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1270/2540] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:30:38.040786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca29f5-dad9-4c4b-aabe-07d71754149f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:38.052555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca29f5-dad9-4c4b-aabe-07d71754149f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:38.058771 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f64da-ba72-43f5-87ad-20ee8f47c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:38.059728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f64da-ba72-43f5-87ad-20ee8f47c910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:38.060131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f64da-ba72-43f5-87ad-20ee8f47c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:38.060560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f64da-ba72-43f5-87ad-20ee8f47c910 admin admin] PATH_INFO: `/v3/projects/53d7a6ee1ea14c4080bd23fbc59e513d/users/9198ec9dedf7428582ccc5924089096a/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:38.070385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb6c98916dc43af9346906ce855950b', 'request_id': 'req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:38.076061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f64da-ba72-43f5-87ad-20ee8f47c910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d7a6ee1ea14c4080bd23fbc59e513d, user_id=9198ec9dedf7428582ccc5924089096a, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:38.078864 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f64da-ba72-43f5-87ad-20ee8f47c910 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:38.080130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb6c98916dc43af9346906ce855950b', 'request_id': 'req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:38.090396 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb6c98916dc43af9346906ce855950b', 'request_id': 'req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:38.095830 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1271/2541] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:38 2022] PUT /identity/v3/projects/53d7a6ee1ea14c4080bd23fbc59e513d/users/9198ec9dedf7428582ccc5924089096a/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:38.100373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f64da-ba72-43f5-87ad-20ee8f47c910 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:38.115872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] The token cache is being invalidate because project beb6c98916dc43af9346906ce855950b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:30:38.116611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:38.116871 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:38.118770 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1271/2542] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:30:37 2022] DELETE /identity/v3/projects/beb6c98916dc43af9346906ce855950b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:30:38.122782 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:38.125613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:38.185169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f64da-ba72-43f5-87ad-20ee8f47c910 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:38.189588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46000f4-467c-45d6-a964-907a60d62e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:38.190290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46000f4-467c-45d6-a964-907a60d62e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:38.190578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46000f4-467c-45d6-a964-907a60d62e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:38.190858 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46000f4-467c-45d6-a964-907a60d62e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:38.191592 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46000f4-467c-45d6-a964-907a60d62e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:38.196674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46000f4-467c-45d6-a964-907a60d62e1e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:38.208105 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1272/2543] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:38.212226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46000f4-467c-45d6-a964-907a60d62e1e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:38.213939 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c46000f4-467c-45d6-a964-907a60d62e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:38.229771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a569f1c-2ba0-4941-ac17-8fb8df0cc42e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:38.233938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46000f4-467c-45d6-a964-907a60d62e1e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:38.240456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaee92-bca7-4be4-b925-83081338bb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:38.244281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaee92-bca7-4be4-b925-83081338bb2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:38.244281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaee92-bca7-4be4-b925-83081338bb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:38.244281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaee92-bca7-4be4-b925-83081338bb2c admin admin] PATH_INFO: `/v3/projects/53d7a6ee1ea14c4080bd23fbc59e513d/users/9198ec9dedf7428582ccc5924089096a/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:38.245815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaee92-bca7-4be4-b925-83081338bb2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d7a6ee1ea14c4080bd23fbc59e513d, user_id=9198ec9dedf7428582ccc5924089096a, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:38.247889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b1ac0-66d3-4ffd-b4a8-89eb51683bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:38.248823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b1ac0-66d3-4ffd-b4a8-89eb51683bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:38.249261 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b1ac0-66d3-4ffd-b4a8-89eb51683bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:38.249473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b1ac0-66d3-4ffd-b4a8-89eb51683bc5 admin admin] PATH_INFO: `/v3/users/75d13a7b288543a3ada413e1afa87049` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:38.250678 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b1ac0-66d3-4ffd-b4a8-89eb51683bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d13a7b288543a3ada413e1afa87049)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:38.253223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b1ac0-66d3-4ffd-b4a8-89eb51683bc5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:38.253703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaee92-bca7-4be4-b925-83081338bb2c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:38.266496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1273/2544] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:38 2022] PUT /identity/v3/projects/53d7a6ee1ea14c4080bd23fbc59e513d/users/9198ec9dedf7428582ccc5924089096a/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:30:38.267284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaee92-bca7-4be4-b925-83081338bb2c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:38.269631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-adaaee92-bca7-4be4-b925-83081338bb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:38.323142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-387b1ac0-66d3-4ffd-b4a8-89eb51683bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d13a7b288543a3ada413e1afa87049'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:38.338990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-387b1ac0-66d3-4ffd-b4a8-89eb51683bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d13a7b288543a3ada413e1afa87049'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:38.348218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-387b1ac0-66d3-4ffd-b4a8-89eb51683bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d13a7b288543a3ada413e1afa87049'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:38.348858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-387b1ac0-66d3-4ffd-b4a8-89eb51683bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d13a7b288543a3ada413e1afa87049'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:38.350303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaee92-bca7-4be4-b925-83081338bb2c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:38.351452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:38.355033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44d6f-13fe-4f0d-a76e-8ccc77e06e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:38.355862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44d6f-13fe-4f0d-a76e-8ccc77e06e16 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:38.356272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44d6f-13fe-4f0d-a76e-8ccc77e06e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:38.356552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e44d6f-13fe-4f0d-a76e-8ccc77e06e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:38.358916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b3e44d6f-13fe-4f0d-a76e-8ccc77e06e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:38.359994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-387b1ac0-66d3-4ffd-b4a8-89eb51683bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d13a7b288543a3ada413e1afa87049'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:38.366998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1272/2545] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:30:38 2022] DELETE /identity/v3/users/75d13a7b288543a3ada413e1afa87049 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:38.368497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18301057-415d-4bc7-a6ae-e71b9e475d28 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:38.369036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18301057-415d-4bc7-a6ae-e71b9e475d28 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:38.369036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18301057-415d-4bc7-a6ae-e71b9e475d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:38.401573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-18301057-415d-4bc7-a6ae-e71b9e475d28 None None] MFA Rules not processed for user `9198ec9dedf7428582ccc5924089096a`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:38.402989 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-18301057-415d-4bc7-a6ae-e71b9e475d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:38.480867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:38.487334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e44d6f-13fe-4f0d-a76e-8ccc77e06e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:38.489215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e44d6f-13fe-4f0d-a76e-8ccc77e06e16 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:38.508413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1273/2546] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:38.514237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1274/2547] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:38.520396 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18301057-415d-4bc7-a6ae-e71b9e475d28 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:38.522233 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-18301057-415d-4bc7-a6ae-e71b9e475d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:38.585923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18301057-415d-4bc7-a6ae-e71b9e475d28 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:38.590980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e574a7-d3b6-42c2-9ff8-682fee909e89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:38.591283 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e574a7-d3b6-42c2-9ff8-682fee909e89 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:38.591536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e574a7-d3b6-42c2-9ff8-682fee909e89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:38.591826 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e574a7-d3b6-42c2-9ff8-682fee909e89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:38.593690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-04e574a7-d3b6-42c2-9ff8-682fee909e89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:38.681533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e574a7-d3b6-42c2-9ff8-682fee909e89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:38.683301 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e574a7-d3b6-42c2-9ff8-682fee909e89 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:38.707950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1274/2548] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:38.776943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44d6f-13fe-4f0d-a76e-8ccc77e06e16 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:38.779665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b3e44d6f-13fe-4f0d-a76e-8ccc77e06e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:38.807186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e44d6f-13fe-4f0d-a76e-8ccc77e06e16 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:38.925193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:38.926351 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:38.926865 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:38.927616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] PATH_INFO: `/v3/projects/02d42676cbce45d0bc495b8f2e9bdf85` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:38.929147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d42676cbce45d0bc495b8f2e9bdf85)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:38.931649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:38.994506 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d42676cbce45d0bc495b8f2e9bdf85', 'request_id': 'req-eb802ef9-a19e-4d6c-a1af-252e9c502c72'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:39.004211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d42676cbce45d0bc495b8f2e9bdf85', 'request_id': 'req-eb802ef9-a19e-4d6c-a1af-252e9c502c72'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:39.019472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d42676cbce45d0bc495b8f2e9bdf85', 'request_id': 'req-eb802ef9-a19e-4d6c-a1af-252e9c502c72'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:39.048234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] The token cache is being invalidate because project 02d42676cbce45d0bc495b8f2e9bdf85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:30:39.048910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:39.049954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eb802ef9-a19e-4d6c-a1af-252e9c502c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:39.052984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1275/2549] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:30:38 2022] DELETE /identity/v3/projects/02d42676cbce45d0bc495b8f2e9bdf85 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:39.058171 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17587a1-800c-4714-81ec-844a6125a3a0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:39.058469 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17587a1-800c-4714-81ec-844a6125a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:39.058747 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17587a1-800c-4714-81ec-844a6125a3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:39.091838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b17587a1-800c-4714-81ec-844a6125a3a0 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:39.094295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b17587a1-800c-4714-81ec-844a6125a3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:39.137273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:39.177321 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1275/2550] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:39.184417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa5922-f886-4e45-a627-e9cfa8472465 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:39.184736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa5922-f886-4e45-a627-e9cfa8472465 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:39.185044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa5922-f886-4e45-a627-e9cfa8472465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:39.216114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6eaa5922-f886-4e45-a627-e9cfa8472465 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:39.217456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6eaa5922-f886-4e45-a627-e9cfa8472465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:39.231979 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1276/2551] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:39.236266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17587a1-800c-4714-81ec-844a6125a3a0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:39.247046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17587a1-800c-4714-81ec-844a6125a3a0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:39.252268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df564dff-daea-4466-adac-6cece7abfa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:39.253503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df564dff-daea-4466-adac-6cece7abfa36 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:39.253983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df564dff-daea-4466-adac-6cece7abfa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:39.254106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df564dff-daea-4466-adac-6cece7abfa36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:39.254808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df564dff-daea-4466-adac-6cece7abfa36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:30:39.255121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df564dff-daea-4466-adac-6cece7abfa36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:39.256765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df564dff-daea-4466-adac-6cece7abfa36 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:39.274794 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1276/2552] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:30:39.279728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa5922-f886-4e45-a627-e9cfa8472465 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:39.292365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa5922-f886-4e45-a627-e9cfa8472465 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:39.297272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b5616-e4db-4565-a82b-c7d40b58743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:39.297936 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b5616-e4db-4565-a82b-c7d40b58743a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:39.298249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b5616-e4db-4565-a82b-c7d40b58743a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:39.298524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b5616-e4db-4565-a82b-c7d40b58743a admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:39.299327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b5616-e4db-4565-a82b-c7d40b58743a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:39.301243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b5616-e4db-4565-a82b-c7d40b58743a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:39.334490 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1277/2553] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:30:39 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:39.335799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df564dff-daea-4466-adac-6cece7abfa36 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:39.347941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df564dff-daea-4466-adac-6cece7abfa36 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:39.410627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd035a2-752a-494b-b792-7fa008d3cc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:39.411392 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd035a2-752a-494b-b792-7fa008d3cc5f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:39.411660 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd035a2-752a-494b-b792-7fa008d3cc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:39.411937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd035a2-752a-494b-b792-7fa008d3cc5f admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:39.412652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd035a2-752a-494b-b792-7fa008d3cc5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:39.414616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd035a2-752a-494b-b792-7fa008d3cc5f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:39.436170 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1277/2554] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:30:39 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:30:39.440627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b5616-e4db-4565-a82b-c7d40b58743a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:39.451133 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b5616-e4db-4565-a82b-c7d40b58743a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:39.456932 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6c8d1-b230-483d-b518-87a9ee188c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:39.457597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c8d1-b230-483d-b518-87a9ee188c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:39.457886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c8d1-b230-483d-b518-87a9ee188c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:39.458190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c8d1-b230-483d-b518-87a9ee188c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:39.458927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6c8d1-b230-483d-b518-87a9ee188c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:39.460593 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6c8d1-b230-483d-b518-87a9ee188c11 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:39.475206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1278/2555] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:39.476653 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd035a2-752a-494b-b792-7fa008d3cc5f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:39.487355 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd035a2-752a-494b-b792-7fa008d3cc5f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:39.492235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63fa36-43a0-4b03-a8b8-b2dc7872fde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:39.492898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63fa36-43a0-4b03-a8b8-b2dc7872fde1 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:39.493182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63fa36-43a0-4b03-a8b8-b2dc7872fde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:39.493449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63fa36-43a0-4b03-a8b8-b2dc7872fde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:39.494178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63fa36-43a0-4b03-a8b8-b2dc7872fde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:39.495755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63fa36-43a0-4b03-a8b8-b2dc7872fde1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:39.508950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1278/2556] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:39.513651 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6c8d1-b230-483d-b518-87a9ee188c11 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:39.525343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6c8d1-b230-483d-b518-87a9ee188c11 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:39.530373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dbf2b-af26-4a54-8b57-7247716ee558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:39.531498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dbf2b-af26-4a54-8b57-7247716ee558 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:39.531784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dbf2b-af26-4a54-8b57-7247716ee558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:39.532230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dbf2b-af26-4a54-8b57-7247716ee558 admin admin] PATH_INFO: `/v3/projects/9b4574b2be174d2aa529cc6d99d148f2/users/10b53ff42c5942ea9fd1171bb676b339/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:39.554267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dbf2b-af26-4a54-8b57-7247716ee558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4574b2be174d2aa529cc6d99d148f2, user_id=10b53ff42c5942ea9fd1171bb676b339, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:39.557746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dbf2b-af26-4a54-8b57-7247716ee558 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:39.574654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1279/2557] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:39 2022] PUT /identity/v3/projects/9b4574b2be174d2aa529cc6d99d148f2/users/10b53ff42c5942ea9fd1171bb676b339/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:39.587231 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8cb5-b6e3-4120-a040-ba30c94378e3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:39.587721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8cb5-b6e3-4120-a040-ba30c94378e3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:39.588089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8cb5-b6e3-4120-a040-ba30c94378e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:39.645987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0e7b8cb5-b6e3-4120-a040-ba30c94378e3 None None] MFA Rules not processed for user `10b53ff42c5942ea9fd1171bb676b339`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:39.649100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0e7b8cb5-b6e3-4120-a040-ba30c94378e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:39.786588 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1279/2558] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:39.790989 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dbf2b-af26-4a54-8b57-7247716ee558 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:39.846581 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:39.900469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dbf2b-af26-4a54-8b57-7247716ee558 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:39.906489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007d210-b0ac-42ea-a056-f80d971fe763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:39.907282 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007d210-b0ac-42ea-a056-f80d971fe763 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:39.907608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007d210-b0ac-42ea-a056-f80d971fe763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:39.907871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007d210-b0ac-42ea-a056-f80d971fe763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:39.908631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007d210-b0ac-42ea-a056-f80d971fe763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:39.910911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007d210-b0ac-42ea-a056-f80d971fe763 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:39.950791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1280/2559] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:30:39 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:39.952416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b8cb5-b6e3-4120-a040-ba30c94378e3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:39.965877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b8cb5-b6e3-4120-a040-ba30c94378e3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:39.991730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:40.031892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0836369-8ef7-4564-91c5-46674f2bcf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:40.032604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836369-8ef7-4564-91c5-46674f2bcf9c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:40.032903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836369-8ef7-4564-91c5-46674f2bcf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:40.033150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0836369-8ef7-4564-91c5-46674f2bcf9c admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:40.034399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0836369-8ef7-4564-91c5-46674f2bcf9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:40.036402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0836369-8ef7-4564-91c5-46674f2bcf9c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:40.063325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1280/2560] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:30:39 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:40.067357 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007d210-b0ac-42ea-a056-f80d971fe763 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:40.077876 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007d210-b0ac-42ea-a056-f80d971fe763 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:40.083450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c783a6f-d713-4dbc-b05e-e613fde5284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:40.084245 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c783a6f-d713-4dbc-b05e-e613fde5284d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:40.084604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c783a6f-d713-4dbc-b05e-e613fde5284d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:40.084957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c783a6f-d713-4dbc-b05e-e613fde5284d admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:40.085774 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c783a6f-d713-4dbc-b05e-e613fde5284d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:40.087458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c783a6f-d713-4dbc-b05e-e613fde5284d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:40.099102 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1281/2561] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:40.103262 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0836369-8ef7-4564-91c5-46674f2bcf9c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:40.113364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0836369-8ef7-4564-91c5-46674f2bcf9c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:40.118086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f919a63-3248-4afd-9856-16b175f8caeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:40.118970 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919a63-3248-4afd-9856-16b175f8caeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:40.119259 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919a63-3248-4afd-9856-16b175f8caeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:40.119545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919a63-3248-4afd-9856-16b175f8caeb admin admin] PATH_INFO: `/v3/projects/f220235d4fc148f1a1b986986d27b140/users/8f3e57061e6c4e71b15768ef8338d8fe/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:40.137276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f919a63-3248-4afd-9856-16b175f8caeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f220235d4fc148f1a1b986986d27b140, user_id=8f3e57061e6c4e71b15768ef8338d8fe, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:40.140255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f919a63-3248-4afd-9856-16b175f8caeb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:40.163382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1281/2562] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:40 2022] PUT /identity/v3/projects/f220235d4fc148f1a1b986986d27b140/users/8f3e57061e6c4e71b15768ef8338d8fe/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:40.164348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c783a6f-d713-4dbc-b05e-e613fde5284d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:40.174793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c783a6f-d713-4dbc-b05e-e613fde5284d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:40.263552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41009f-c1d3-4273-93ee-6b5468b40ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:40.264873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41009f-c1d3-4273-93ee-6b5468b40ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:40.265464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41009f-c1d3-4273-93ee-6b5468b40ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:40.266032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41009f-c1d3-4273-93ee-6b5468b40ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:40.266923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41009f-c1d3-4273-93ee-6b5468b40ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:40.269479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41009f-c1d3-4273-93ee-6b5468b40ba4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:40.283326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1282/2563] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:40.287449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f919a63-3248-4afd-9856-16b175f8caeb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:40.300400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f919a63-3248-4afd-9856-16b175f8caeb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:40.305666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cae18-71c8-426b-b72d-20e07c2635d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:40.306791 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cae18-71c8-426b-b72d-20e07c2635d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:40.307086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cae18-71c8-426b-b72d-20e07c2635d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:40.307415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cae18-71c8-426b-b72d-20e07c2635d9 admin admin] PATH_INFO: `/v3/projects/f220235d4fc148f1a1b986986d27b140/users/8f3e57061e6c4e71b15768ef8338d8fe/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:40.309630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cae18-71c8-426b-b72d-20e07c2635d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f220235d4fc148f1a1b986986d27b140, user_id=8f3e57061e6c4e71b15768ef8338d8fe, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:40.312428 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cae18-71c8-426b-b72d-20e07c2635d9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:40.340361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1282/2564] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:40 2022] PUT /identity/v3/projects/f220235d4fc148f1a1b986986d27b140/users/8f3e57061e6c4e71b15768ef8338d8fe/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:40.341779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bdf70-8fc5-4eb2-b2a9-97c97077c321 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:40.342069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bdf70-8fc5-4eb2-b2a9-97c97077c321 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:40.342344 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bdf70-8fc5-4eb2-b2a9-97c97077c321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:40.372479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bc3bdf70-8fc5-4eb2-b2a9-97c97077c321 None None] MFA Rules not processed for user `8f3e57061e6c4e71b15768ef8338d8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:40.373745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bc3bdf70-8fc5-4eb2-b2a9-97c97077c321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:40.483434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1283/2565] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:40.496121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cae18-71c8-426b-b72d-20e07c2635d9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:40.497978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-107cae18-71c8-426b-b72d-20e07c2635d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:40.566489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cae18-71c8-426b-b72d-20e07c2635d9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:40.570513 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4f60b-6e67-465c-876e-255d1c93ca03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:40.571230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4f60b-6e67-465c-876e-255d1c93ca03 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:40.571566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4f60b-6e67-465c-876e-255d1c93ca03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:40.571853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4f60b-6e67-465c-876e-255d1c93ca03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:40.584941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4f60b-6e67-465c-876e-255d1c93ca03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:40.586442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4f60b-6e67-465c-876e-255d1c93ca03 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:40.600045 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1283/2566] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:40 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:40.679324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bdf70-8fc5-4eb2-b2a9-97c97077c321 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:40.690562 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bdf70-8fc5-4eb2-b2a9-97c97077c321 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:40.693890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74603-e01d-4b3b-85fa-cf476aeca414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:40.694640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74603-e01d-4b3b-85fa-cf476aeca414 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:40.695033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74603-e01d-4b3b-85fa-cf476aeca414 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:40.695419 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74603-e01d-4b3b-85fa-cf476aeca414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:40.710407 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:40.770079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c74603-e01d-4b3b-85fa-cf476aeca414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:40.771582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c74603-e01d-4b3b-85fa-cf476aeca414 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:40.784330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1284/2567] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:41.735469 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4f60b-6e67-465c-876e-255d1c93ca03 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:41.737641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-61f4f60b-6e67-465c-876e-255d1c93ca03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:41.835217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4f60b-6e67-465c-876e-255d1c93ca03 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:41.841070 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8832df-119d-49a3-aed3-7abb2399f11e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:41.841847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8832df-119d-49a3-aed3-7abb2399f11e service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:41.842210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8832df-119d-49a3-aed3-7abb2399f11e service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:41.842566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8832df-119d-49a3-aed3-7abb2399f11e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:41.844671 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2f8832df-119d-49a3-aed3-7abb2399f11e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:41.858863 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8832df-119d-49a3-aed3-7abb2399f11e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:41.860521 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8832df-119d-49a3-aed3-7abb2399f11e service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:41.873474 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1284/2568] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:42.020521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74603-e01d-4b3b-85fa-cf476aeca414 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:42.022003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-80c74603-e01d-4b3b-85fa-cf476aeca414 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:42.090574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74603-e01d-4b3b-85fa-cf476aeca414 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:42.095081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d58227-e08e-47b0-90be-f0731bbb1663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:42.096606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d58227-e08e-47b0-90be-f0731bbb1663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:42.096898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d58227-e08e-47b0-90be-f0731bbb1663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:42.097177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d58227-e08e-47b0-90be-f0731bbb1663 admin admin] PATH_INFO: `/v3/users/76011af8b8b94434bb461d81cff5ae8e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:42.098363 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d58227-e08e-47b0-90be-f0731bbb1663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76011af8b8b94434bb461d81cff5ae8e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:42.100590 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d58227-e08e-47b0-90be-f0731bbb1663 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:42.147234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97d58227-e08e-47b0-90be-f0731bbb1663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76011af8b8b94434bb461d81cff5ae8e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:42.159869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97d58227-e08e-47b0-90be-f0731bbb1663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76011af8b8b94434bb461d81cff5ae8e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:42.166850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97d58227-e08e-47b0-90be-f0731bbb1663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76011af8b8b94434bb461d81cff5ae8e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:42.167447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97d58227-e08e-47b0-90be-f0731bbb1663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76011af8b8b94434bb461d81cff5ae8e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:42.174787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97d58227-e08e-47b0-90be-f0731bbb1663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76011af8b8b94434bb461d81cff5ae8e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:42.180977 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1285/2569] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:30:42 2022] DELETE /identity/v3/users/76011af8b8b94434bb461d81cff5ae8e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:42.355073 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8832df-119d-49a3-aed3-7abb2399f11e service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:42.366158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8832df-119d-49a3-aed3-7abb2399f11e service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:42.374170 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:42.443151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:42.444079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:42.444374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:42.444759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] PATH_INFO: `/v3/projects/c66ab1e364a54ec58229f8189e70a896` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:42.445945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66ab1e364a54ec58229f8189e70a896)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:42.447953 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:42.497734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66ab1e364a54ec58229f8189e70a896', 'request_id': 'req-bfc951bb-b544-4fea-bcce-6091d63e2e87'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:42.504525 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66ab1e364a54ec58229f8189e70a896', 'request_id': 'req-bfc951bb-b544-4fea-bcce-6091d63e2e87'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:42.509998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66ab1e364a54ec58229f8189e70a896', 'request_id': 'req-bfc951bb-b544-4fea-bcce-6091d63e2e87'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:42.525319 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] The token cache is being invalidate because project c66ab1e364a54ec58229f8189e70a896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:30:42.525679 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:42.526424 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bfc951bb-b544-4fea-bcce-6091d63e2e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:42.528186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1285/2570] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:30:42 2022] DELETE /identity/v3/projects/c66ab1e364a54ec58229f8189e70a896 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:30:42.533310 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1fb2c-94cb-44e7-9414-2912acb75a87 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:42.533628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1fb2c-94cb-44e7-9414-2912acb75a87 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:42.533911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1fb2c-94cb-44e7-9414-2912acb75a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:42.552484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2bb1fb2c-94cb-44e7-9414-2912acb75a87 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:42.553752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2bb1fb2c-94cb-44e7-9414-2912acb75a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:42.583687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:42.615734 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1286/2571] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:30:42.623687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adad61-0e7a-4df7-a360-4d78b8d5079a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:42.623982 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adad61-0e7a-4df7-a360-4d78b8d5079a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:42.624296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adad61-0e7a-4df7-a360-4d78b8d5079a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:42.644658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b8adad61-0e7a-4df7-a360-4d78b8d5079a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:42.645942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b8adad61-0e7a-4df7-a360-4d78b8d5079a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:42.653810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1286/2572] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:42.658059 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1fb2c-94cb-44e7-9414-2912acb75a87 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:42.668201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1fb2c-94cb-44e7-9414-2912acb75a87 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:42.672992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f68ec-3732-4a03-a114-57bc7fb8494c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:42.673656 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f68ec-3732-4a03-a114-57bc7fb8494c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:42.673992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f68ec-3732-4a03-a114-57bc7fb8494c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:42.674275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f68ec-3732-4a03-a114-57bc7fb8494c admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:42.675012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f68ec-3732-4a03-a114-57bc7fb8494c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:30:42.675322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f68ec-3732-4a03-a114-57bc7fb8494c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:42.677008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f68ec-3732-4a03-a114-57bc7fb8494c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:42.688886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1287/2573] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:30:42.693941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adad61-0e7a-4df7-a360-4d78b8d5079a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:42.703278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adad61-0e7a-4df7-a360-4d78b8d5079a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:42.708574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6791873-98a8-4bba-9df4-3c984f376a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:42.709220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6791873-98a8-4bba-9df4-3c984f376a59 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:42.709504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6791873-98a8-4bba-9df4-3c984f376a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:42.709812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6791873-98a8-4bba-9df4-3c984f376a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:42.710510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6791873-98a8-4bba-9df4-3c984f376a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:42.712462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6791873-98a8-4bba-9df4-3c984f376a59 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:42.739191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1287/2574] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:30:42 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:30:42.742987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f68ec-3732-4a03-a114-57bc7fb8494c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:42.753718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f68ec-3732-4a03-a114-57bc7fb8494c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:42.809790 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe2e67-7e1b-41f8-9083-fc05b2e2f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:42.810460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe2e67-7e1b-41f8-9083-fc05b2e2f5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:42.810751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe2e67-7e1b-41f8-9083-fc05b2e2f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:42.811033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe2e67-7e1b-41f8-9083-fc05b2e2f5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:42.811737 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe2e67-7e1b-41f8-9083-fc05b2e2f5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:42.813739 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe2e67-7e1b-41f8-9083-fc05b2e2f5d4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:42.834661 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1288/2575] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:30:42 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:42.838577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6791873-98a8-4bba-9df4-3c984f376a59 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:42.849147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6791873-98a8-4bba-9df4-3c984f376a59 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:42.853945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fa89d-eb0c-4faf-be4e-523c73a32e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:42.854607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fa89d-eb0c-4faf-be4e-523c73a32e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:42.854896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fa89d-eb0c-4faf-be4e-523c73a32e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:42.855177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fa89d-eb0c-4faf-be4e-523c73a32e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:42.855912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fa89d-eb0c-4faf-be4e-523c73a32e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:42.857668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fa89d-eb0c-4faf-be4e-523c73a32e16 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:42.868561 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1288/2576] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:42.872436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe2e67-7e1b-41f8-9083-fc05b2e2f5d4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:42.882900 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe2e67-7e1b-41f8-9083-fc05b2e2f5d4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:42.887540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138d327-58db-4120-98cb-0f1c4efd3203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:42.888229 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d327-58db-4120-98cb-0f1c4efd3203 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:42.888770 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d327-58db-4120-98cb-0f1c4efd3203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:42.889048 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d327-58db-4120-98cb-0f1c4efd3203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:42.889970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138d327-58db-4120-98cb-0f1c4efd3203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:42.891571 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138d327-58db-4120-98cb-0f1c4efd3203 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:42.903239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1289/2577] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:42.907330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fa89d-eb0c-4faf-be4e-523c73a32e16 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:42.917619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fa89d-eb0c-4faf-be4e-523c73a32e16 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:42.922295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9549f-0730-4529-baeb-044180d17681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:42.923166 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9549f-0730-4529-baeb-044180d17681 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:42.923455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9549f-0730-4529-baeb-044180d17681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:42.923738 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9549f-0730-4529-baeb-044180d17681 admin admin] PATH_INFO: `/v3/projects/e679e233fe7040bcad87c6bc63cd796b/users/234e88b4b0134a09898d0ed3c02eda63/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:42.938465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9549f-0730-4529-baeb-044180d17681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e679e233fe7040bcad87c6bc63cd796b, user_id=234e88b4b0134a09898d0ed3c02eda63, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:42.941742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9549f-0730-4529-baeb-044180d17681 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:42.954645 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1289/2578] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:42 2022] PUT /identity/v3/projects/e679e233fe7040bcad87c6bc63cd796b/users/234e88b4b0134a09898d0ed3c02eda63/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:42.959635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa588d8-e741-49cc-8fbf-45b611d2531e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:42.959933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa588d8-e741-49cc-8fbf-45b611d2531e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:42.960250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa588d8-e741-49cc-8fbf-45b611d2531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:42.978284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9fa588d8-e741-49cc-8fbf-45b611d2531e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:42.979498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9fa588d8-e741-49cc-8fbf-45b611d2531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:43.040462 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1290/2579] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:43.050434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9549f-0730-4529-baeb-044180d17681 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:43.052391 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a1b9549f-0730-4529-baeb-044180d17681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:43.096814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:43.118449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9549f-0730-4529-baeb-044180d17681 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:43.122124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526821b-de94-450b-8b2d-0843bd8e6033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:43.122772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526821b-de94-450b-8b2d-0843bd8e6033 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:43.123073 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526821b-de94-450b-8b2d-0843bd8e6033 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:43.123352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526821b-de94-450b-8b2d-0843bd8e6033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:43.134125 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526821b-de94-450b-8b2d-0843bd8e6033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:43.135555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526821b-de94-450b-8b2d-0843bd8e6033 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:43.145272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1290/2580] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:43.528724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa588d8-e741-49cc-8fbf-45b611d2531e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:43.530399 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9fa588d8-e741-49cc-8fbf-45b611d2531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:43.581189 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:43.596639 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa588d8-e741-49cc-8fbf-45b611d2531e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:43.600268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457be8d-8771-4cbf-9fe9-459e77d8f466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:43.600916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457be8d-8771-4cbf-9fe9-459e77d8f466 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:43.601199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457be8d-8771-4cbf-9fe9-459e77d8f466 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:43.601473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457be8d-8771-4cbf-9fe9-459e77d8f466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:43.603401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f457be8d-8771-4cbf-9fe9-459e77d8f466 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:43.668868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457be8d-8771-4cbf-9fe9-459e77d8f466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:43.670314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457be8d-8771-4cbf-9fe9-459e77d8f466 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:43.680595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1291/2581] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:44.609722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526821b-de94-450b-8b2d-0843bd8e6033 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:44.612565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6526821b-de94-450b-8b2d-0843bd8e6033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:44.644798 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526821b-de94-450b-8b2d-0843bd8e6033 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:44.658185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:44.659622 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:44.659905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:44.660216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] PATH_INFO: `/v3/users/10b53ff42c5942ea9fd1171bb676b339` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:44.661413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b53ff42c5942ea9fd1171bb676b339)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:44.663320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:44.733915 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b53ff42c5942ea9fd1171bb676b339'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:44.748597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b53ff42c5942ea9fd1171bb676b339'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:44.757277 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b53ff42c5942ea9fd1171bb676b339'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:44.758267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b53ff42c5942ea9fd1171bb676b339'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:44.768559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b53ff42c5942ea9fd1171bb676b339'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:44.775325 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1291/2582] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:30:44 2022] DELETE /identity/v3/users/10b53ff42c5942ea9fd1171bb676b339 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:44.780131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80eed1-42bd-47ee-b270-fe72bf9a8498 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:44.780667 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80eed1-42bd-47ee-b270-fe72bf9a8498 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:44.780667 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80eed1-42bd-47ee-b270-fe72bf9a8498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:44.802181 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cc80eed1-42bd-47ee-b270-fe72bf9a8498 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:44.803415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cc80eed1-42bd-47ee-b270-fe72bf9a8498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:44.868416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1292/2583] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:44.878133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:44.879496 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:44.939702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b99ce-082c-4ed1-90eb-639404221f58 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:44.945042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa69fd-2c63-4972-a643-7ebe3b91ad50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:44.945917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa69fd-2c63-4972-a643-7ebe3b91ad50 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:44.946374 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa69fd-2c63-4972-a643-7ebe3b91ad50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:44.946658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa69fd-2c63-4972-a643-7ebe3b91ad50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:44.957258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa69fd-2c63-4972-a643-7ebe3b91ad50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:44.958739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa69fd-2c63-4972-a643-7ebe3b91ad50 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:44.968666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1292/2584] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:45.639394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80eed1-42bd-47ee-b270-fe72bf9a8498 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:45.641317 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cc80eed1-42bd-47ee-b270-fe72bf9a8498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:45.654834 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80eed1-42bd-47ee-b270-fe72bf9a8498 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:45.671753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:45.673056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:45.673727 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:45.674364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] PATH_INFO: `/v3/projects/9b4574b2be174d2aa529cc6d99d148f2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:45.676245 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4574b2be174d2aa529cc6d99d148f2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:45.680757 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:45.746337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4574b2be174d2aa529cc6d99d148f2', 'request_id': 'req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:45.757181 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4574b2be174d2aa529cc6d99d148f2', 'request_id': 'req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:45.773149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4574b2be174d2aa529cc6d99d148f2', 'request_id': 'req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:45.790436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] The token cache is being invalidate because project 9b4574b2be174d2aa529cc6d99d148f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:30:45.791468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:45.792762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:45.794625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1293/2585] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:30:45 2022] DELETE /identity/v3/projects/9b4574b2be174d2aa529cc6d99d148f2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:45.799969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa69fd-2c63-4972-a643-7ebe3b91ad50 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:45.814578 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa69fd-2c63-4972-a643-7ebe3b91ad50 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:45.890201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:45.900669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89c4f1-f110-457f-8f97-63e9be850716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:45.901717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89c4f1-f110-457f-8f97-63e9be850716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:45.902351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89c4f1-f110-457f-8f97-63e9be850716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:45.902949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89c4f1-f110-457f-8f97-63e9be850716 admin admin] PATH_INFO: `/v3/users/8f3e57061e6c4e71b15768ef8338d8fe` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:45.904563 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89c4f1-f110-457f-8f97-63e9be850716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3e57061e6c4e71b15768ef8338d8fe)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:45.906584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89c4f1-f110-457f-8f97-63e9be850716 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:45.966591 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fb89c4f1-f110-457f-8f97-63e9be850716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3e57061e6c4e71b15768ef8338d8fe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:45.984948 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fb89c4f1-f110-457f-8f97-63e9be850716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3e57061e6c4e71b15768ef8338d8fe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:45.996382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fb89c4f1-f110-457f-8f97-63e9be850716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3e57061e6c4e71b15768ef8338d8fe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:45.997746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fb89c4f1-f110-457f-8f97-63e9be850716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3e57061e6c4e71b15768ef8338d8fe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:46.006958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fb89c4f1-f110-457f-8f97-63e9be850716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3e57061e6c4e71b15768ef8338d8fe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:46.013896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1293/2586] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:30:45 2022] DELETE /identity/v3/users/8f3e57061e6c4e71b15768ef8338d8fe => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:46.337319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:46.340507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:46.357808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bbe43-a370-41f1-8fd6-19f3c1a92f50 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:46.370210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:46.431569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:46.432478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:46.432760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:46.433036 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] PATH_INFO: `/v3/projects/f220235d4fc148f1a1b986986d27b140` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:46.434282 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f220235d4fc148f1a1b986986d27b140)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:46.436746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:46.493256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f220235d4fc148f1a1b986986d27b140', 'request_id': 'req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:46.501167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f220235d4fc148f1a1b986986d27b140', 'request_id': 'req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:46.507791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f220235d4fc148f1a1b986986d27b140', 'request_id': 'req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:46.523073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] The token cache is being invalidate because project f220235d4fc148f1a1b986986d27b140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:30:46.523447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:46.524309 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-04eb3a18-21da-40ab-ba9e-ee67f91b82ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:30:46.526054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1294/2587] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:30:46 2022] DELETE /identity/v3/projects/f220235d4fc148f1a1b986986d27b140 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:46.530647 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f59ae-6a45-42f6-b366-df9350f70bfe None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:46.531005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f59ae-6a45-42f6-b366-df9350f70bfe None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:46.531360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f59ae-6a45-42f6-b366-df9350f70bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:46.552267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b45f59ae-6a45-42f6-b366-df9350f70bfe None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:46.553561 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b45f59ae-6a45-42f6-b366-df9350f70bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:46.643416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1294/2588] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:46.651792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ff476-9ea5-411e-8bde-ca5072ef37bd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:46.651792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ff476-9ea5-411e-8bde-ca5072ef37bd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:46.652379 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ff476-9ea5-411e-8bde-ca5072ef37bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:46.672813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1a8ff476-9ea5-411e-8bde-ca5072ef37bd None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:46.674750 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1a8ff476-9ea5-411e-8bde-ca5072ef37bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:46.688071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1295/2589] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:46.689293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f59ae-6a45-42f6-b366-df9350f70bfe None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:46.703869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f59ae-6a45-42f6-b366-df9350f70bfe None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:46.712142 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed350ed-156e-4165-94f0-b1b6796e8bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:46.713165 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed350ed-156e-4165-94f0-b1b6796e8bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:46.713662 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed350ed-156e-4165-94f0-b1b6796e8bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:46.714086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed350ed-156e-4165-94f0-b1b6796e8bc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:46.714901 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed350ed-156e-4165-94f0-b1b6796e8bc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:30:46.715195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed350ed-156e-4165-94f0-b1b6796e8bc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:46.716918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed350ed-156e-4165-94f0-b1b6796e8bc7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:46.735204 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ff476-9ea5-411e-8bde-ca5072ef37bd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:46.737310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1295/2590] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:30:46.748309 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ff476-9ea5-411e-8bde-ca5072ef37bd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:46.755868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eb489-b1f4-4128-8e77-d932c0a9b70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:46.756912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eb489-b1f4-4128-8e77-d932c0a9b70c admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:46.757392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eb489-b1f4-4128-8e77-d932c0a9b70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:46.757972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eb489-b1f4-4128-8e77-d932c0a9b70c admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:46.758946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2eb489-b1f4-4128-8e77-d932c0a9b70c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:46.762033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2eb489-b1f4-4128-8e77-d932c0a9b70c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:46.797847 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1296/2591] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:30:46 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:30:46.802913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed350ed-156e-4165-94f0-b1b6796e8bc7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:46.823461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed350ed-156e-4165-94f0-b1b6796e8bc7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:46.900002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b930da-65b8-4b0a-8802-dcb658e76f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:46.900699 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b930da-65b8-4b0a-8802-dcb658e76f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:46.901055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b930da-65b8-4b0a-8802-dcb658e76f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:46.901599 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b930da-65b8-4b0a-8802-dcb658e76f6d admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:46.902236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b930da-65b8-4b0a-8802-dcb658e76f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:46.904300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b930da-65b8-4b0a-8802-dcb658e76f6d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:46.913107 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:46.931520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1296/2592] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:30:46 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:46.935223 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eb489-b1f4-4128-8e77-d932c0a9b70c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:46.947891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eb489-b1f4-4128-8e77-d932c0a9b70c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:46.955346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55863d8f-5900-4c00-9bba-8b110f769bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:46.956286 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863d8f-5900-4c00-9bba-8b110f769bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:46.956765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863d8f-5900-4c00-9bba-8b110f769bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:46.957051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863d8f-5900-4c00-9bba-8b110f769bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:46.957926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55863d8f-5900-4c00-9bba-8b110f769bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:46.959797 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55863d8f-5900-4c00-9bba-8b110f769bf9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:46.975700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1297/2593] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:46.976930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b930da-65b8-4b0a-8802-dcb658e76f6d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:46.996639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b930da-65b8-4b0a-8802-dcb658e76f6d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:47.005018 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b413ac-0b60-47b8-8ea2-ae6b34894eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:47.005805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b413ac-0b60-47b8-8ea2-ae6b34894eab admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.006229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b413ac-0b60-47b8-8ea2-ae6b34894eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.006556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b413ac-0b60-47b8-8ea2-ae6b34894eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.007523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b413ac-0b60-47b8-8ea2-ae6b34894eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:47.009802 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b413ac-0b60-47b8-8ea2-ae6b34894eab admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:47.023868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1297/2594] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:47.027399 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55863d8f-5900-4c00-9bba-8b110f769bf9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:47.041391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55863d8f-5900-4c00-9bba-8b110f769bf9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:47.046270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530252b8-958a-4ab7-8e54-8e141271d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:47.047161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530252b8-958a-4ab7-8e54-8e141271d300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.047448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530252b8-958a-4ab7-8e54-8e141271d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.048175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530252b8-958a-4ab7-8e54-8e141271d300 admin admin] PATH_INFO: `/v3/projects/9bee5ad0cdfa4642a1648883a3168b18/users/767a4cac75aa4a2fb656473f97fef7c7/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.066162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530252b8-958a-4ab7-8e54-8e141271d300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bee5ad0cdfa4642a1648883a3168b18, user_id=767a4cac75aa4a2fb656473f97fef7c7, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:47.069118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530252b8-958a-4ab7-8e54-8e141271d300 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:47.084675 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1298/2595] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:47 2022] PUT /identity/v3/projects/9bee5ad0cdfa4642a1648883a3168b18/users/767a4cac75aa4a2fb656473f97fef7c7/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:47.097487 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bda701-9579-458a-b764-a9a1b88316e1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.098284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bda701-9579-458a-b764-a9a1b88316e1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.098578 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bda701-9579-458a-b764-a9a1b88316e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.133390 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d9bda701-9579-458a-b764-a9a1b88316e1 None None] MFA Rules not processed for user `767a4cac75aa4a2fb656473f97fef7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:47.134631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d9bda701-9579-458a-b764-a9a1b88316e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:47.241869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1298/2596] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:47.249556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530252b8-958a-4ab7-8e54-8e141271d300 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:47.326820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:47.376753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530252b8-958a-4ab7-8e54-8e141271d300 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:47.385450 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e212738-6779-4d99-b558-bb52582c4e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:47.386778 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e212738-6779-4d99-b558-bb52582c4e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.388532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e212738-6779-4d99-b558-bb52582c4e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.388985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e212738-6779-4d99-b558-bb52582c4e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.389910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e212738-6779-4d99-b558-bb52582c4e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:47.393509 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e212738-6779-4d99-b558-bb52582c4e59 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:47.438724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1299/2597] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:30:47 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:30:47.439171 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bda701-9579-458a-b764-a9a1b88316e1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:47.452566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bda701-9579-458a-b764-a9a1b88316e1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:47.538869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921059a-715f-4dd4-8504-e8f3abc66112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:47.539916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921059a-715f-4dd4-8504-e8f3abc66112 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.540657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921059a-715f-4dd4-8504-e8f3abc66112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.540945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921059a-715f-4dd4-8504-e8f3abc66112 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.547199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921059a-715f-4dd4-8504-e8f3abc66112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:47.547199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921059a-715f-4dd4-8504-e8f3abc66112 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:47.576006 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1299/2598] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:30:47 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:30:47.576279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e212738-6779-4d99-b558-bb52582c4e59 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:47.578176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f8851-aa40-4057-a3b6-52888e9922db None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.578490 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f8851-aa40-4057-a3b6-52888e9922db None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.578848 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f8851-aa40-4057-a3b6-52888e9922db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.594974 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e212738-6779-4d99-b558-bb52582c4e59 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:47.602458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2156ef-f49d-47c4-b3b0-d78e36d5a872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:47.603421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2156ef-f49d-47c4-b3b0-d78e36d5a872 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.603958 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2156ef-f49d-47c4-b3b0-d78e36d5a872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.604736 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2156ef-f49d-47c4-b3b0-d78e36d5a872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.605137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2156ef-f49d-47c4-b3b0-d78e36d5a872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:47.607158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2156ef-f49d-47c4-b3b0-d78e36d5a872 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:47.613850 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-651f8851-aa40-4057-a3b6-52888e9922db None None] MFA Rules not processed for user `234e88b4b0134a09898d0ed3c02eda63`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:47.615066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-651f8851-aa40-4057-a3b6-52888e9922db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:47.624467 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1300/2599] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:47.629497 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2156ef-f49d-47c4-b3b0-d78e36d5a872 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:47.645699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2156ef-f49d-47c4-b3b0-d78e36d5a872 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:47.650500 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39f9dd-9f6c-4ae7-9e1e-e78c7ccd9643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:47.651678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f9dd-9f6c-4ae7-9e1e-e78c7ccd9643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.651975 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f9dd-9f6c-4ae7-9e1e-e78c7ccd9643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.652291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f9dd-9f6c-4ae7-9e1e-e78c7ccd9643 admin admin] PATH_INFO: `/v3/projects/27f94be699d94de9b6d2b7fdd1d89713/users/5e0bcf2107484f8883b9f101310e4b70/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.675825 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39f9dd-9f6c-4ae7-9e1e-e78c7ccd9643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f94be699d94de9b6d2b7fdd1d89713, user_id=5e0bcf2107484f8883b9f101310e4b70, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:47.679042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39f9dd-9f6c-4ae7-9e1e-e78c7ccd9643 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:47.681114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:47.701831 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1301/2600] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:47 2022] PUT /identity/v3/projects/27f94be699d94de9b6d2b7fdd1d89713/users/5e0bcf2107484f8883b9f101310e4b70/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:30:47.710203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39f9dd-9f6c-4ae7-9e1e-e78c7ccd9643 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:47.718462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1300/2601] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:30:47.736725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f8851-aa40-4057-a3b6-52888e9922db None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:47.745987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-651f8851-aa40-4057-a3b6-52888e9922db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:47.811095 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39f9dd-9f6c-4ae7-9e1e-e78c7ccd9643 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:47.818453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89115970-e0b5-4e0f-b3bb-b8542cfe9b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:47.819141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89115970-e0b5-4e0f-b3bb-b8542cfe9b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.819415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89115970-e0b5-4e0f-b3bb-b8542cfe9b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.819691 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89115970-e0b5-4e0f-b3bb-b8542cfe9b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.820568 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89115970-e0b5-4e0f-b3bb-b8542cfe9b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:47.822195 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89115970-e0b5-4e0f-b3bb-b8542cfe9b64 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:47.838318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1302/2602] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:30:47.843906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89115970-e0b5-4e0f-b3bb-b8542cfe9b64 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:47.848815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f8851-aa40-4057-a3b6-52888e9922db None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:47.855703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89115970-e0b5-4e0f-b3bb-b8542cfe9b64 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:47.860698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222efa1-511e-4ad8-a88a-ab066cab07d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:47.861722 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222efa1-511e-4ad8-a88a-ab066cab07d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.862187 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222efa1-511e-4ad8-a88a-ab066cab07d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.862484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222efa1-511e-4ad8-a88a-ab066cab07d1 admin admin] PATH_INFO: `/v3/projects/27f94be699d94de9b6d2b7fdd1d89713/users/5e0bcf2107484f8883b9f101310e4b70/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.864679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222efa1-511e-4ad8-a88a-ab066cab07d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f94be699d94de9b6d2b7fdd1d89713, user_id=5e0bcf2107484f8883b9f101310e4b70, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:47.867335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222efa1-511e-4ad8-a88a-ab066cab07d1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:47.879260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1303/2603] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:30:47 2022] PUT /identity/v3/projects/27f94be699d94de9b6d2b7fdd1d89713/users/5e0bcf2107484f8883b9f101310e4b70/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:30:47.889810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cefc-8d7e-4ab8-b48d-2b00579478b2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.890108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cefc-8d7e-4ab8-b48d-2b00579478b2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.890394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cefc-8d7e-4ab8-b48d-2b00579478b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.919799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fab2cefc-8d7e-4ab8-b48d-2b00579478b2 None None] MFA Rules not processed for user `5e0bcf2107484f8883b9f101310e4b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:47.921115 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fab2cefc-8d7e-4ab8-b48d-2b00579478b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:47.924943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e9f0e-6ea3-417b-9ccb-f8f00917eba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:47.925688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e9f0e-6ea3-417b-9ccb-f8f00917eba2 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:47.926051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e9f0e-6ea3-417b-9ccb-f8f00917eba2 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:47.926406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e9f0e-6ea3-417b-9ccb-f8f00917eba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:47.987910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e9f0e-6ea3-417b-9ccb-f8f00917eba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:47.989628 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e9f0e-6ea3-417b-9ccb-f8f00917eba2 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:47.992463 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:48.000219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1301/2604] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:48.003743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1304/2605] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:48.015744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e9f0e-6ea3-417b-9ccb-f8f00917eba2 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:48.017335 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-735e9f0e-6ea3-417b-9ccb-f8f00917eba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:48.048224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:48.085882 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e9f0e-6ea3-417b-9ccb-f8f00917eba2 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:48.147170 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0d910-758f-4c40-b326-9f60f0e26b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:48.147844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0d910-758f-4c40-b326-9f60f0e26b24 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:48.148193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0d910-758f-4c40-b326-9f60f0e26b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:48.148483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0d910-758f-4c40-b326-9f60f0e26b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:48.230699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2cefc-8d7e-4ab8-b48d-2b00579478b2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:48.232793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fab2cefc-8d7e-4ab8-b48d-2b00579478b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:48.232923 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0d910-758f-4c40-b326-9f60f0e26b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:48.234264 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0d910-758f-4c40-b326-9f60f0e26b24 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:48.246625 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1302/2606] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:48.374883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2cefc-8d7e-4ab8-b48d-2b00579478b2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:48.382653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5fcb5-6f55-465e-b914-58baaa47b1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:48.383452 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5fcb5-6f55-465e-b914-58baaa47b1ee service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:48.383846 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5fcb5-6f55-465e-b914-58baaa47b1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:48.384271 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5fcb5-6f55-465e-b914-58baaa47b1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:48.386961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3fa5fcb5-6f55-465e-b914-58baaa47b1ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:48.520080 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5fcb5-6f55-465e-b914-58baaa47b1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:48.521985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5fcb5-6f55-465e-b914-58baaa47b1ee service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:48.543109 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1305/2607] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:49.608801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056afc4-0175-4e60-8a62-85f7b8fc16e1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:49.609339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056afc4-0175-4e60-8a62-85f7b8fc16e1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:49.609339 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056afc4-0175-4e60-8a62-85f7b8fc16e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:49.670690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8056afc4-0175-4e60-8a62-85f7b8fc16e1 None None] MFA Rules not processed for user `234e88b4b0134a09898d0ed3c02eda63`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:30:49.671975 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8056afc4-0175-4e60-8a62-85f7b8fc16e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:49.767007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1303/2608] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:30:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:30:54.980557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5fcb5-6f55-465e-b914-58baaa47b1ee service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:54.982113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3fa5fcb5-6f55-465e-b914-58baaa47b1ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:54.997035 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5fcb5-6f55-465e-b914-58baaa47b1ee service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:55.001810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1889ceb-2930-456c-9a89-f24e71fc763d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:55.002763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889ceb-2930-456c-9a89-f24e71fc763d service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:55.003056 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889ceb-2930-456c-9a89-f24e71fc763d service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:55.003334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889ceb-2930-456c-9a89-f24e71fc763d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:55.014509 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1889ceb-2930-456c-9a89-f24e71fc763d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:55.016173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1889ceb-2930-456c-9a89-f24e71fc763d service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:55.027685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1306/2609] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:30:59.665919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056afc4-0175-4e60-8a62-85f7b8fc16e1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:30:59.668936 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8056afc4-0175-4e60-8a62-85f7b8fc16e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:59.687017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056afc4-0175-4e60-8a62-85f7b8fc16e1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:30:59.693023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159da830-05b8-4099-8952-d8f7bb63da6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:30:59.694051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da830-05b8-4099-8952-d8f7bb63da6e service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:30:59.694567 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da830-05b8-4099-8952-d8f7bb63da6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:30:59.695055 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159da830-05b8-4099-8952-d8f7bb63da6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:30:59.697086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-159da830-05b8-4099-8952-d8f7bb63da6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:30:59.744611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:30:59.773838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159da830-05b8-4099-8952-d8f7bb63da6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:30:59.775352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159da830-05b8-4099-8952-d8f7bb63da6e service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:30:59.786666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1304/2610] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:04.313914 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1889ceb-2930-456c-9a89-f24e71fc763d service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:04.329580 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1889ceb-2930-456c-9a89-f24e71fc763d service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:04.337295 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:04.338288 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:04.338779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:04.339321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] PATH_INFO: `/v3/users/767a4cac75aa4a2fb656473f97fef7c7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:04.340685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767a4cac75aa4a2fb656473f97fef7c7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:04.342759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:04.406212 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767a4cac75aa4a2fb656473f97fef7c7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:04.425272 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767a4cac75aa4a2fb656473f97fef7c7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:04.434753 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767a4cac75aa4a2fb656473f97fef7c7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:04.435397 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767a4cac75aa4a2fb656473f97fef7c7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:04.448145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767a4cac75aa4a2fb656473f97fef7c7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:04.450853 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1307/2611] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:04 2022] DELETE /identity/v3/users/767a4cac75aa4a2fb656473f97fef7c7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:04.455367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd89b2-79bd-4ff6-895f-a1c5e1a9d900 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:04.455824 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd89b2-79bd-4ff6-895f-a1c5e1a9d900 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:04.455957 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd89b2-79bd-4ff6-895f-a1c5e1a9d900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:04.473974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b0dd89b2-79bd-4ff6-895f-a1c5e1a9d900 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:04.475192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b0dd89b2-79bd-4ff6-895f-a1c5e1a9d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:04.537694 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1305/2612] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:04.547574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:04.549538 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:04.564487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:04.615786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617da9c5-cb5f-4b8e-956a-c6a80936fe84 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:04.620034 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949260f-7063-4140-80f9-4f8b47137e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:04.620719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949260f-7063-4140-80f9-4f8b47137e66 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:04.620980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949260f-7063-4140-80f9-4f8b47137e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:04.621258 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949260f-7063-4140-80f9-4f8b47137e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:04.631916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949260f-7063-4140-80f9-4f8b47137e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:04.633324 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949260f-7063-4140-80f9-4f8b47137e66 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:04.643710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1308/2613] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:04.994252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd89b2-79bd-4ff6-895f-a1c5e1a9d900 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:04.995992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b0dd89b2-79bd-4ff6-895f-a1c5e1a9d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:05.008789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd89b2-79bd-4ff6-895f-a1c5e1a9d900 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:05.015449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:05.016376 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:05.016810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:05.017101 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] PATH_INFO: `/v3/projects/9bee5ad0cdfa4642a1648883a3168b18` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:05.018343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bee5ad0cdfa4642a1648883a3168b18)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:05.020370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:05.073825 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bee5ad0cdfa4642a1648883a3168b18', 'request_id': 'req-b8d9ea71-1686-4a16-9709-0161a901bd24'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:05.080774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bee5ad0cdfa4642a1648883a3168b18', 'request_id': 'req-b8d9ea71-1686-4a16-9709-0161a901bd24'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:05.088229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bee5ad0cdfa4642a1648883a3168b18', 'request_id': 'req-b8d9ea71-1686-4a16-9709-0161a901bd24'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:05.102728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] The token cache is being invalidate because project 9bee5ad0cdfa4642a1648883a3168b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:05.103195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:05.103940 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:05.105542 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1306/2614] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:04 2022] DELETE /identity/v3/projects/9bee5ad0cdfa4642a1648883a3168b18 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:05.109399 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949260f-7063-4140-80f9-4f8b47137e66 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:05.120076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949260f-7063-4140-80f9-4f8b47137e66 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:05.191383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1be81-dbf7-4ea8-8c63-aef8b4116c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:05.192872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1be81-dbf7-4ea8-8c63-aef8b4116c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:05.193162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1be81-dbf7-4ea8-8c63-aef8b4116c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:05.193442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1be81-dbf7-4ea8-8c63-aef8b4116c71 admin admin] PATH_INFO: `/v3/users/5e0bcf2107484f8883b9f101310e4b70` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:05.194649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1be81-dbf7-4ea8-8c63-aef8b4116c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0bcf2107484f8883b9f101310e4b70)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:05.196623 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1be81-dbf7-4ea8-8c63-aef8b4116c71 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:05.249420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a6a1be81-dbf7-4ea8-8c63-aef8b4116c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0bcf2107484f8883b9f101310e4b70'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:05.274798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a6a1be81-dbf7-4ea8-8c63-aef8b4116c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0bcf2107484f8883b9f101310e4b70'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:05.288988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a6a1be81-dbf7-4ea8-8c63-aef8b4116c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0bcf2107484f8883b9f101310e4b70'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:05.291489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a6a1be81-dbf7-4ea8-8c63-aef8b4116c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0bcf2107484f8883b9f101310e4b70'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:05.304699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a6a1be81-dbf7-4ea8-8c63-aef8b4116c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0bcf2107484f8883b9f101310e4b70'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:05.312391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1309/2615] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:05 2022] DELETE /identity/v3/users/5e0bcf2107484f8883b9f101310e4b70 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:05.909162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:05.911896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:05.937219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9ea71-1686-4a16-9709-0161a901bd24 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:06.020486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:06.032244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:06.033929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:06.034329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:06.034844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] PATH_INFO: `/v3/projects/27f94be699d94de9b6d2b7fdd1d89713` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:06.037545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f94be699d94de9b6d2b7fdd1d89713)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:06.046263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:06.117573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f94be699d94de9b6d2b7fdd1d89713', 'request_id': 'req-2238453a-afee-4c7c-835a-fd81138a5ecd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:06.125008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f94be699d94de9b6d2b7fdd1d89713', 'request_id': 'req-2238453a-afee-4c7c-835a-fd81138a5ecd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:06.131537 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f94be699d94de9b6d2b7fdd1d89713', 'request_id': 'req-2238453a-afee-4c7c-835a-fd81138a5ecd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:06.147110 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] The token cache is being invalidate because project 27f94be699d94de9b6d2b7fdd1d89713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:06.147528 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:06.148322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2238453a-afee-4c7c-835a-fd81138a5ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:06.150102 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1307/2616] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:05 2022] DELETE /identity/v3/projects/27f94be699d94de9b6d2b7fdd1d89713 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:06.156217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911173c-fd43-465d-87c1-58b041bd4f01 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:06.156746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911173c-fd43-465d-87c1-58b041bd4f01 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:06.156859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911173c-fd43-465d-87c1-58b041bd4f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:06.177602 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5911173c-fd43-465d-87c1-58b041bd4f01 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:06.181950 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5911173c-fd43-465d-87c1-58b041bd4f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:06.235514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:06.303247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1310/2617] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:06.312478 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347763e-fd00-4443-ae6b-5f3b1ffd7b7e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:06.312777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347763e-fd00-4443-ae6b-5f3b1ffd7b7e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:06.313085 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347763e-fd00-4443-ae6b-5f3b1ffd7b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:06.341190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3347763e-fd00-4443-ae6b-5f3b1ffd7b7e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:06.342434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3347763e-fd00-4443-ae6b-5f3b1ffd7b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:06.351896 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1308/2618] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:06.356165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911173c-fd43-465d-87c1-58b041bd4f01 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:06.367552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911173c-fd43-465d-87c1-58b041bd4f01 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:06.375057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddf192-3cea-496f-8094-2ecc6d6fe0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:06.375057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf192-3cea-496f-8094-2ecc6d6fe0de admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:06.375057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf192-3cea-496f-8094-2ecc6d6fe0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:06.375057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddf192-3cea-496f-8094-2ecc6d6fe0de admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:06.375465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddf192-3cea-496f-8094-2ecc6d6fe0de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:31:06.375465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddf192-3cea-496f-8094-2ecc6d6fe0de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:06.376237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddf192-3cea-496f-8094-2ecc6d6fe0de admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:06.391322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1311/2619] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:31:06.400309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347763e-fd00-4443-ae6b-5f3b1ffd7b7e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:06.413543 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347763e-fd00-4443-ae6b-5f3b1ffd7b7e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:06.421023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb32744-9108-4f5f-98c9-24d5ebe0002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:06.422056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb32744-9108-4f5f-98c9-24d5ebe0002f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:06.422056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb32744-9108-4f5f-98c9-24d5ebe0002f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:06.422459 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb32744-9108-4f5f-98c9-24d5ebe0002f admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:06.423329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb32744-9108-4f5f-98c9-24d5ebe0002f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:06.425649 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb32744-9108-4f5f-98c9-24d5ebe0002f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:06.483273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1309/2620] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:06 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:06.487608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddf192-3cea-496f-8094-2ecc6d6fe0de admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:06.501600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddf192-3cea-496f-8094-2ecc6d6fe0de admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:06.590372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d1634-8c44-410e-a0d7-8bcce031a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:06.590946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d1634-8c44-410e-a0d7-8bcce031a5cf admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:06.591237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d1634-8c44-410e-a0d7-8bcce031a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:06.591758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d1634-8c44-410e-a0d7-8bcce031a5cf admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:06.592524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d1634-8c44-410e-a0d7-8bcce031a5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:06.594479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d1634-8c44-410e-a0d7-8bcce031a5cf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:06.623260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1312/2621] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:06 2022] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:06.628043 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb32744-9108-4f5f-98c9-24d5ebe0002f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:06.639881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb32744-9108-4f5f-98c9-24d5ebe0002f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:06.645547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de307772-0943-460c-bcec-0f4e4d3fafba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:06.646237 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307772-0943-460c-bcec-0f4e4d3fafba admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:06.646523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307772-0943-460c-bcec-0f4e4d3fafba admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:06.646803 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307772-0943-460c-bcec-0f4e4d3fafba admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:06.647698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de307772-0943-460c-bcec-0f4e4d3fafba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:06.649386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de307772-0943-460c-bcec-0f4e4d3fafba admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:06.671414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1310/2622] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:31:06.673445 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d1634-8c44-410e-a0d7-8bcce031a5cf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:06.695372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d1634-8c44-410e-a0d7-8bcce031a5cf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:06.704431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862436f-e519-4c5d-a727-169b035b7450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:06.705590 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862436f-e519-4c5d-a727-169b035b7450 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:06.705912 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862436f-e519-4c5d-a727-169b035b7450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:06.706196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862436f-e519-4c5d-a727-169b035b7450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:06.706998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862436f-e519-4c5d-a727-169b035b7450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:06.709551 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862436f-e519-4c5d-a727-169b035b7450 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:06.733274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de307772-0943-460c-bcec-0f4e4d3fafba admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:06.733822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1313/2623] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:06.748721 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de307772-0943-460c-bcec-0f4e4d3fafba admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:06.764557 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136f39b-7912-4643-aec3-4d10f2736ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:06.766296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136f39b-7912-4643-aec3-4d10f2736ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:06.766781 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136f39b-7912-4643-aec3-4d10f2736ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:06.767879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136f39b-7912-4643-aec3-4d10f2736ebd admin admin] PATH_INFO: `/v3/projects/d23fe3aecd0b4bba9f559799646bd143/users/4937eaa419b748ba9d8c6ba186f22c44/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:06.789627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136f39b-7912-4643-aec3-4d10f2736ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23fe3aecd0b4bba9f559799646bd143, user_id=4937eaa419b748ba9d8c6ba186f22c44, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:06.793129 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136f39b-7912-4643-aec3-4d10f2736ebd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:06.818463 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1311/2624] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:06 2022] PUT /identity/v3/projects/d23fe3aecd0b4bba9f559799646bd143/users/4937eaa419b748ba9d8c6ba186f22c44/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:06.828993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862436f-e519-4c5d-a727-169b035b7450 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:06.830809 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5862436f-e519-4c5d-a727-169b035b7450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:06.835413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155f674-a9b6-458c-8bba-5f4e992e261a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:06.835700 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155f674-a9b6-458c-8bba-5f4e992e261a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:06.835972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155f674-a9b6-458c-8bba-5f4e992e261a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:06.850106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862436f-e519-4c5d-a727-169b035b7450 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:06.871677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7155f674-a9b6-458c-8bba-5f4e992e261a None None] MFA Rules not processed for user `4937eaa419b748ba9d8c6ba186f22c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:06.872971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7155f674-a9b6-458c-8bba-5f4e992e261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:06.921001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:06.921878 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:06.922170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:06.922444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] PATH_INFO: `/v3/users/2e95d22987c0471ba3007d00075850c4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:06.923660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e95d22987c0471ba3007d00075850c4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:06.926352 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:06.954307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1312/2625] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:06.968078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155f674-a9b6-458c-8bba-5f4e992e261a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:06.969742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7155f674-a9b6-458c-8bba-5f4e992e261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:06.980545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:06.988827 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:06.989799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e95d22987c0471ba3007d00075850c4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.007137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e95d22987c0471ba3007d00075850c4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.018420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e95d22987c0471ba3007d00075850c4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.020155 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e95d22987c0471ba3007d00075850c4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.028548 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e95d22987c0471ba3007d00075850c4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.035083 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1314/2626] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:06 2022] DELETE /identity/v3/users/2e95d22987c0471ba3007d00075850c4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:07.046349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155f674-a9b6-458c-8bba-5f4e992e261a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:07.102265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f1e95-0fc2-4c20-ae2c-29744f1745e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd82125a47ce044b389684b97c7097ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:07.102929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1e95-0fc2-4c20-ae2c-29744f1745e3 service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:07.103217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1e95-0fc2-4c20-ae2c-29744f1745e3 service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:07.103500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1e95-0fc2-4c20-ae2c-29744f1745e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:07.105315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8e4f1e95-0fc2-4c20-ae2c-29744f1745e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:07.172922 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f1e95-0fc2-4c20-ae2c-29744f1745e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:07.174545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f1e95-0fc2-4c20-ae2c-29744f1745e3 service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:07.186182 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1313/2627] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:31:07.262956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:07.264953 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:07.364360 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f9293-7861-4f04-84cb-d73e5b102452 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:07.371180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:07.371180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:07.371435 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:07.371646 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] PATH_INFO: `/v3/projects/85dc04b20ddc4d43b2fed3fd057ad351` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:07.372816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85dc04b20ddc4d43b2fed3fd057ad351)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:07.374913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:07.436157 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85dc04b20ddc4d43b2fed3fd057ad351', 'request_id': 'req-71f1913f-586d-47e7-82fa-8b01e7f37753'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.446145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85dc04b20ddc4d43b2fed3fd057ad351', 'request_id': 'req-71f1913f-586d-47e7-82fa-8b01e7f37753'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.452696 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85dc04b20ddc4d43b2fed3fd057ad351', 'request_id': 'req-71f1913f-586d-47e7-82fa-8b01e7f37753'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.468845 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] The token cache is being invalidate because project 85dc04b20ddc4d43b2fed3fd057ad351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:07.469400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.470265 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.475413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1315/2628] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:07 2022] DELETE /identity/v3/projects/85dc04b20ddc4d43b2fed3fd057ad351 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:07.477079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f1e95-0fc2-4c20-ae2c-29744f1745e3 service glance] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:07.491060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f1e95-0fc2-4c20-ae2c-29744f1745e3 service glance] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:07.607033 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:07.607639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:07.607924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:07.608241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] PATH_INFO: `/v3/users/bff805aa627b4ee3b2d9241b13e58780` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:07.610072 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff805aa627b4ee3b2d9241b13e58780)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:07.612062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:07.689980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:07.719959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff805aa627b4ee3b2d9241b13e58780'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.741018 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff805aa627b4ee3b2d9241b13e58780'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.756140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff805aa627b4ee3b2d9241b13e58780'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.757133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff805aa627b4ee3b2d9241b13e58780'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.769157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff805aa627b4ee3b2d9241b13e58780'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:07.782766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1314/2629] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:07 2022] DELETE /identity/v3/users/bff805aa627b4ee3b2d9241b13e58780 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:08.140911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:08.142390 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:08.156894 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1913f-586d-47e7-82fa-8b01e7f37753 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:08.230155 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:08.245201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:08.246524 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:08.246815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:08.247130 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] PATH_INFO: `/v3/projects/e9d1e8b7e5a34cebbf965768e7225ccd` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:08.248394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d1e8b7e5a34cebbf965768e7225ccd)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:08.250482 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:08.314435 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:08.317637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:08.329574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d1e8b7e5a34cebbf965768e7225ccd', 'request_id': 'req-1b43054b-8702-4574-8e04-fe1fbba89e8c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:08.336337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4ef2a-1011-4b26-bb81-ea68157b8aca admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:08.338747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d1e8b7e5a34cebbf965768e7225ccd', 'request_id': 'req-1b43054b-8702-4574-8e04-fe1fbba89e8c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:08.351522 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d1e8b7e5a34cebbf965768e7225ccd', 'request_id': 'req-1b43054b-8702-4574-8e04-fe1fbba89e8c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:08.367752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] The token cache is being invalidate because project e9d1e8b7e5a34cebbf965768e7225ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:08.368106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:08.368864 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1b43054b-8702-4574-8e04-fe1fbba89e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:08.370850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1316/2630] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:08 2022] DELETE /identity/v3/projects/e9d1e8b7e5a34cebbf965768e7225ccd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:08.423846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:08.425466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:08.426221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:08.426828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] PATH_INFO: `/v3/users/85cf22e14ff7427ca7e0e614321180c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:08.428977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cf22e14ff7427ca7e0e614321180c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:08.431406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:08.515735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cf22e14ff7427ca7e0e614321180c0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:08.530222 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cf22e14ff7427ca7e0e614321180c0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:08.542411 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cf22e14ff7427ca7e0e614321180c0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:08.543126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cf22e14ff7427ca7e0e614321180c0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:08.552474 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cf22e14ff7427ca7e0e614321180c0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:08.563840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1315/2631] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:08 2022] DELETE /identity/v3/users/85cf22e14ff7427ca7e0e614321180c0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:08.565793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8f899-a9da-4a2d-a196-34316f0303ed None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:08.566188 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8f899-a9da-4a2d-a196-34316f0303ed None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:08.567724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8f899-a9da-4a2d-a196-34316f0303ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:08.589039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-97f8f899-a9da-4a2d-a196-34316f0303ed None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:08.590550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-97f8f899-a9da-4a2d-a196-34316f0303ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:08.665209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1317/2632] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:08.675149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:08.677494 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:08.712687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:08.747158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fc8c6-d054-42f7-8e2c-38a8aa3e8490 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:08.750841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e543264-6678-4539-9deb-2a2c86d627b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:08.751497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543264-6678-4539-9deb-2a2c86d627b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:08.751785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543264-6678-4539-9deb-2a2c86d627b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:08.752149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543264-6678-4539-9deb-2a2c86d627b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:08.762377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e543264-6678-4539-9deb-2a2c86d627b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:08.764044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e543264-6678-4539-9deb-2a2c86d627b5 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:08.774440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1316/2633] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:09.094892 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8f899-a9da-4a2d-a196-34316f0303ed None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:09.096322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-97f8f899-a9da-4a2d-a196-34316f0303ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:09.110601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8f899-a9da-4a2d-a196-34316f0303ed None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:09.115860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:09.116755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:09.117719 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:09.118343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] PATH_INFO: `/v3/projects/f1abaef6bf37416bbd488d1efb46b13c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:09.119585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1abaef6bf37416bbd488d1efb46b13c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:09.121479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:09.170935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1abaef6bf37416bbd488d1efb46b13c', 'request_id': 'req-ca2e1941-4140-48f6-b91b-d34f056d96a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.177600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1abaef6bf37416bbd488d1efb46b13c', 'request_id': 'req-ca2e1941-4140-48f6-b91b-d34f056d96a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.183191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1abaef6bf37416bbd488d1efb46b13c', 'request_id': 'req-ca2e1941-4140-48f6-b91b-d34f056d96a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.195527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] The token cache is being invalidate because project f1abaef6bf37416bbd488d1efb46b13c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:09.195814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.196466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.198058 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1318/2634] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:09 2022] DELETE /identity/v3/projects/f1abaef6bf37416bbd488d1efb46b13c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:09.202001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e543264-6678-4539-9deb-2a2c86d627b5 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:09.211834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e543264-6678-4539-9deb-2a2c86d627b5 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:09.270908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81e51c-c23e-467a-96dd-85be1bc84fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:09.271780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81e51c-c23e-467a-96dd-85be1bc84fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:09.272227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81e51c-c23e-467a-96dd-85be1bc84fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:09.272417 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81e51c-c23e-467a-96dd-85be1bc84fed admin admin] PATH_INFO: `/v3/users/9198ec9dedf7428582ccc5924089096a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:09.273525 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81e51c-c23e-467a-96dd-85be1bc84fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9198ec9dedf7428582ccc5924089096a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:09.275438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81e51c-c23e-467a-96dd-85be1bc84fed admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:09.321049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fe81e51c-c23e-467a-96dd-85be1bc84fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9198ec9dedf7428582ccc5924089096a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.332650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fe81e51c-c23e-467a-96dd-85be1bc84fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9198ec9dedf7428582ccc5924089096a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.339639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fe81e51c-c23e-467a-96dd-85be1bc84fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9198ec9dedf7428582ccc5924089096a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.340284 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fe81e51c-c23e-467a-96dd-85be1bc84fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9198ec9dedf7428582ccc5924089096a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.347219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fe81e51c-c23e-467a-96dd-85be1bc84fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9198ec9dedf7428582ccc5924089096a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.353587 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1317/2635] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:09 2022] DELETE /identity/v3/users/9198ec9dedf7428582ccc5924089096a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:09.631057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:09.632588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:09.640968 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:09.650526 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e1941-4140-48f6-b91b-d34f056d96a5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:09.711436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:09.712333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:09.712623 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:09.712905 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] PATH_INFO: `/v3/projects/53d7a6ee1ea14c4080bd23fbc59e513d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:09.714087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d7a6ee1ea14c4080bd23fbc59e513d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:09.716010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:09.770005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d7a6ee1ea14c4080bd23fbc59e513d', 'request_id': 'req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.776179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d7a6ee1ea14c4080bd23fbc59e513d', 'request_id': 'req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.781591 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d7a6ee1ea14c4080bd23fbc59e513d', 'request_id': 'req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.793973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] The token cache is being invalidate because project 53d7a6ee1ea14c4080bd23fbc59e513d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:09.794256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.794860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2bf2dab6-77ed-498a-9201-a1a73bbd9ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:09.796416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1319/2636] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:09 2022] DELETE /identity/v3/projects/53d7a6ee1ea14c4080bd23fbc59e513d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:09.801616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd5edd-d2e3-4eaa-9f8d-df462919cc1a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:09.801905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd5edd-d2e3-4eaa-9f8d-df462919cc1a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:09.802181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd5edd-d2e3-4eaa-9f8d-df462919cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:09.820380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-09bd5edd-d2e3-4eaa-9f8d-df462919cc1a None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:09.821569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-09bd5edd-d2e3-4eaa-9f8d-df462919cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:09.864394 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:09.886730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1318/2637] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:09.895216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155275a3-1513-47a0-bac1-ff9e4f927979 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:09.895509 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155275a3-1513-47a0-bac1-ff9e4f927979 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:09.895789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155275a3-1513-47a0-bac1-ff9e4f927979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:09.914434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-155275a3-1513-47a0-bac1-ff9e4f927979 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:09.915654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-155275a3-1513-47a0-bac1-ff9e4f927979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:09.923599 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1320/2638] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:09.928536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd5edd-d2e3-4eaa-9f8d-df462919cc1a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:09.940753 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd5edd-d2e3-4eaa-9f8d-df462919cc1a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:09.945437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5e96c-928d-49fe-be88-1036046e6489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:09.946184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5e96c-928d-49fe-be88-1036046e6489 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:09.946471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5e96c-928d-49fe-be88-1036046e6489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:09.946755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5e96c-928d-49fe-be88-1036046e6489 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:09.947489 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5e96c-928d-49fe-be88-1036046e6489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:31:09.947799 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5e96c-928d-49fe-be88-1036046e6489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:09.949448 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5e96c-928d-49fe-be88-1036046e6489 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:09.961808 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1319/2639] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:31:09.966325 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155275a3-1513-47a0-bac1-ff9e4f927979 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:09.976037 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155275a3-1513-47a0-bac1-ff9e4f927979 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:09.980630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26834ca3-5234-4a3e-8d3b-0119d9f4891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:09.981277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26834ca3-5234-4a3e-8d3b-0119d9f4891c admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:09.981560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26834ca3-5234-4a3e-8d3b-0119d9f4891c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:09.981835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26834ca3-5234-4a3e-8d3b-0119d9f4891c admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:09.982525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26834ca3-5234-4a3e-8d3b-0119d9f4891c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:09.984444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26834ca3-5234-4a3e-8d3b-0119d9f4891c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.009444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1321/2640] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:09 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:10.013906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5e96c-928d-49fe-be88-1036046e6489 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.024399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5e96c-928d-49fe-be88-1036046e6489 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.081924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b3f49-c73b-4f23-acb7-a8d0abaf3cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.083062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b3f49-c73b-4f23-acb7-a8d0abaf3cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.083351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b3f49-c73b-4f23-acb7-a8d0abaf3cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.083634 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b3f49-c73b-4f23-acb7-a8d0abaf3cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.084399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b3f49-c73b-4f23-acb7-a8d0abaf3cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.086317 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b3f49-c73b-4f23-acb7-a8d0abaf3cc4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.105485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1320/2641] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:10 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:31:10.109789 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26834ca3-5234-4a3e-8d3b-0119d9f4891c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.120780 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26834ca3-5234-4a3e-8d3b-0119d9f4891c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.125340 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4894b1-b1d5-4775-ae0e-cb864a73ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.125997 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4894b1-b1d5-4775-ae0e-cb864a73ba13 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.126283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4894b1-b1d5-4775-ae0e-cb864a73ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.126558 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4894b1-b1d5-4775-ae0e-cb864a73ba13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.127280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4894b1-b1d5-4775-ae0e-cb864a73ba13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.129480 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4894b1-b1d5-4775-ae0e-cb864a73ba13 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.140343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1322/2642] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:10.144098 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b3f49-c73b-4f23-acb7-a8d0abaf3cc4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.155514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b3f49-c73b-4f23-acb7-a8d0abaf3cc4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.160951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7e24b-1f0e-4c77-ae50-ecabef876386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.161762 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7e24b-1f0e-4c77-ae50-ecabef876386 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.162051 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7e24b-1f0e-4c77-ae50-ecabef876386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.162335 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7e24b-1f0e-4c77-ae50-ecabef876386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.163307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7e24b-1f0e-4c77-ae50-ecabef876386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.164962 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7e24b-1f0e-4c77-ae50-ecabef876386 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.175526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1321/2643] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:31:10.179839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4894b1-b1d5-4775-ae0e-cb864a73ba13 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.189773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4894b1-b1d5-4775-ae0e-cb864a73ba13 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.194877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfea41c-ab11-48c4-8f84-aaba0acae9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.195745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfea41c-ab11-48c4-8f84-aaba0acae9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.196042 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfea41c-ab11-48c4-8f84-aaba0acae9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.196329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfea41c-ab11-48c4-8f84-aaba0acae9e5 admin admin] PATH_INFO: `/v3/projects/7ef7a3375a584bd882fd6b49da0df3e1/users/4a97ea23e63d441da589fdb3bb75466b/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.211102 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfea41c-ab11-48c4-8f84-aaba0acae9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef7a3375a584bd882fd6b49da0df3e1, user_id=4a97ea23e63d441da589fdb3bb75466b, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.213778 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfea41c-ab11-48c4-8f84-aaba0acae9e5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.226558 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1323/2644] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:10 2022] PUT /identity/v3/projects/7ef7a3375a584bd882fd6b49da0df3e1/users/4a97ea23e63d441da589fdb3bb75466b/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:10.237452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c528e-04fd-4c6d-942f-6e829d9cf69f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.237744 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c528e-04fd-4c6d-942f-6e829d9cf69f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.238025 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c528e-04fd-4c6d-942f-6e829d9cf69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.265376 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-918c528e-04fd-4c6d-942f-6e829d9cf69f None None] MFA Rules not processed for user `4a97ea23e63d441da589fdb3bb75466b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:10.266818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-918c528e-04fd-4c6d-942f-6e829d9cf69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:10.331422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1322/2645] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:10.336734 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfea41c-ab11-48c4-8f84-aaba0acae9e5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.366295 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:10.401365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfea41c-ab11-48c4-8f84-aaba0acae9e5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.405926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e582ef-ebdf-477c-b2d3-ee5f88d4815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.406582 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e582ef-ebdf-477c-b2d3-ee5f88d4815e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.406865 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e582ef-ebdf-477c-b2d3-ee5f88d4815e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.407143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e582ef-ebdf-477c-b2d3-ee5f88d4815e admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.407827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e582ef-ebdf-477c-b2d3-ee5f88d4815e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.409766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e582ef-ebdf-477c-b2d3-ee5f88d4815e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.434683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1324/2646] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:10 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:10.438711 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c528e-04fd-4c6d-942f-6e829d9cf69f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.449974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c528e-04fd-4c6d-942f-6e829d9cf69f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.487026 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:10.507102 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e2d0-72a0-4c54-863a-83db0e609991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.507948 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e2d0-72a0-4c54-863a-83db0e609991 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.508265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e2d0-72a0-4c54-863a-83db0e609991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.508606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e2d0-72a0-4c54-863a-83db0e609991 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.509389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362e2d0-72a0-4c54-863a-83db0e609991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.511337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362e2d0-72a0-4c54-863a-83db0e609991 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.531672 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1323/2647] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:10 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:31:10.535748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e582ef-ebdf-477c-b2d3-ee5f88d4815e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.546137 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e582ef-ebdf-477c-b2d3-ee5f88d4815e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.551399 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01645d61-ab4d-4f52-a6ac-4426980c2cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.552085 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645d61-ab4d-4f52-a6ac-4426980c2cdf admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.552377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645d61-ab4d-4f52-a6ac-4426980c2cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.552663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645d61-ab4d-4f52-a6ac-4426980c2cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.553387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01645d61-ab4d-4f52-a6ac-4426980c2cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.555019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01645d61-ab4d-4f52-a6ac-4426980c2cdf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.565441 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1325/2648] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:10.569846 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e2d0-72a0-4c54-863a-83db0e609991 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.579642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e2d0-72a0-4c54-863a-83db0e609991 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.584191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582111a-4ebe-4020-a9f0-44d3a9996305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.584827 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582111a-4ebe-4020-a9f0-44d3a9996305 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.585110 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582111a-4ebe-4020-a9f0-44d3a9996305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.585385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582111a-4ebe-4020-a9f0-44d3a9996305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.586100 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582111a-4ebe-4020-a9f0-44d3a9996305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.587743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582111a-4ebe-4020-a9f0-44d3a9996305 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.597439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1324/2649] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:10.601558 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01645d61-ab4d-4f52-a6ac-4426980c2cdf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.612003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01645d61-ab4d-4f52-a6ac-4426980c2cdf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.617193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e37f69-02d0-4d1b-850e-8fd33d8e2c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.618066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e37f69-02d0-4d1b-850e-8fd33d8e2c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.618398 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e37f69-02d0-4d1b-850e-8fd33d8e2c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.618723 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e37f69-02d0-4d1b-850e-8fd33d8e2c16 admin admin] PATH_INFO: `/v3/projects/263047542183488ea8133829e4dc34e5/users/726b283a06314544a663d23df7e11f9f/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.635531 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e37f69-02d0-4d1b-850e-8fd33d8e2c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=263047542183488ea8133829e4dc34e5, user_id=726b283a06314544a663d23df7e11f9f, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.638702 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e37f69-02d0-4d1b-850e-8fd33d8e2c16 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.652517 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1326/2650] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:10 2022] PUT /identity/v3/projects/263047542183488ea8133829e4dc34e5/users/726b283a06314544a663d23df7e11f9f/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:10.662664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693b994-2f55-481b-aa5a-89c823cdb33e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.662955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693b994-2f55-481b-aa5a-89c823cdb33e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.663236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693b994-2f55-481b-aa5a-89c823cdb33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.689334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8693b994-2f55-481b-aa5a-89c823cdb33e None None] MFA Rules not processed for user `726b283a06314544a663d23df7e11f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:10.690550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8693b994-2f55-481b-aa5a-89c823cdb33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:10.752881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1325/2651] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:10.757704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e37f69-02d0-4d1b-850e-8fd33d8e2c16 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.826580 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e37f69-02d0-4d1b-850e-8fd33d8e2c16 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.831632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef3588-c3ea-4276-b931-6943b3578304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.832873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3588-c3ea-4276-b931-6943b3578304 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.833162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3588-c3ea-4276-b931-6943b3578304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.833444 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3588-c3ea-4276-b931-6943b3578304 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.834202 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef3588-c3ea-4276-b931-6943b3578304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.836247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef3588-c3ea-4276-b931-6943b3578304 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.862107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1327/2652] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:10 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:10.866135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693b994-2f55-481b-aa5a-89c823cdb33e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.876949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693b994-2f55-481b-aa5a-89c823cdb33e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.939528 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5f38-3648-486e-84d7-96a252f8aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.940377 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5f38-3648-486e-84d7-96a252f8aa55 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.940665 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5f38-3648-486e-84d7-96a252f8aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.940999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5f38-3648-486e-84d7-96a252f8aa55 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.942241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d5f38-3648-486e-84d7-96a252f8aa55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.944213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d5f38-3648-486e-84d7-96a252f8aa55 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:10.969635 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1326/2653] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:10 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:10.971132 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef3588-c3ea-4276-b931-6943b3578304 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:10.981249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef3588-c3ea-4276-b931-6943b3578304 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:10.985918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1e1f8-9f41-4e7e-8dea-0f5bfffc8d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:10.986581 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1e1f8-9f41-4e7e-8dea-0f5bfffc8d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:10.986867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1e1f8-9f41-4e7e-8dea-0f5bfffc8d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:10.987148 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1e1f8-9f41-4e7e-8dea-0f5bfffc8d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:10.987874 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1e1f8-9f41-4e7e-8dea-0f5bfffc8d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:10.989543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1e1f8-9f41-4e7e-8dea-0f5bfffc8d0f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:11.002338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1328/2654] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:11.007128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5f38-3648-486e-84d7-96a252f8aa55 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:11.018332 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5f38-3648-486e-84d7-96a252f8aa55 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:11.024347 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc7290-7ba2-4f12-903e-7afcaa4644c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:11.025247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc7290-7ba2-4f12-903e-7afcaa4644c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:11.025535 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc7290-7ba2-4f12-903e-7afcaa4644c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:11.025814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc7290-7ba2-4f12-903e-7afcaa4644c2 admin admin] PATH_INFO: `/v3/projects/d350940bdbbe422f9346004af9268282/users/531f987afd0d4955ad2071d159d1f3c7/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:11.042368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc7290-7ba2-4f12-903e-7afcaa4644c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d350940bdbbe422f9346004af9268282, user_id=531f987afd0d4955ad2071d159d1f3c7, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:11.045141 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc7290-7ba2-4f12-903e-7afcaa4644c2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:11.057992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1327/2655] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:11 2022] PUT /identity/v3/projects/d350940bdbbe422f9346004af9268282/users/531f987afd0d4955ad2071d159d1f3c7/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:11.061775 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1e1f8-9f41-4e7e-8dea-0f5bfffc8d0f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:11.072284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1e1f8-9f41-4e7e-8dea-0f5bfffc8d0f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:11.120395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:11.133160 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c73f9b-eb40-421b-9ded-556c2c7c85b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:11.134766 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c73f9b-eb40-421b-9ded-556c2c7c85b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:11.135335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c73f9b-eb40-421b-9ded-556c2c7c85b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:11.135852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c73f9b-eb40-421b-9ded-556c2c7c85b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:11.136901 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c73f9b-eb40-421b-9ded-556c2c7c85b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:11.138844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c73f9b-eb40-421b-9ded-556c2c7c85b5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:11.150091 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1329/2656] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:11.154327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc7290-7ba2-4f12-903e-7afcaa4644c2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:11.164627 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc7290-7ba2-4f12-903e-7afcaa4644c2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:11.169106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52f395-9f94-4868-847b-6654a05e7b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:11.169979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f395-9f94-4868-847b-6654a05e7b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:11.170267 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f395-9f94-4868-847b-6654a05e7b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:11.170547 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f395-9f94-4868-847b-6654a05e7b2a admin admin] PATH_INFO: `/v3/projects/d350940bdbbe422f9346004af9268282/users/531f987afd0d4955ad2071d159d1f3c7/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:11.172523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52f395-9f94-4868-847b-6654a05e7b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d350940bdbbe422f9346004af9268282, user_id=531f987afd0d4955ad2071d159d1f3c7, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:11.175152 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52f395-9f94-4868-847b-6654a05e7b2a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:11.181244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:11.186476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1328/2657] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:11 2022] PUT /identity/v3/projects/d350940bdbbe422f9346004af9268282/users/531f987afd0d4955ad2071d159d1f3c7/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:11.197268 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a1113-8e3d-4cbd-9192-25a4a480b560 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:11.197641 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a1113-8e3d-4cbd-9192-25a4a480b560 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:11.197927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a1113-8e3d-4cbd-9192-25a4a480b560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:11.223983 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f62a1113-8e3d-4cbd-9192-25a4a480b560 None None] MFA Rules not processed for user `531f987afd0d4955ad2071d159d1f3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:11.225228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f62a1113-8e3d-4cbd-9192-25a4a480b560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:11.297683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1330/2658] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:11.310221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52f395-9f94-4868-847b-6654a05e7b2a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:11.311945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cc52f395-9f94-4868-847b-6654a05e7b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:11.367689 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52f395-9f94-4868-847b-6654a05e7b2a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:11.371613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da87d4e-6d72-4bad-a4a0-14f55a037596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:11.372235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da87d4e-6d72-4bad-a4a0-14f55a037596 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:11.372556 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da87d4e-6d72-4bad-a4a0-14f55a037596 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:11.372945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da87d4e-6d72-4bad-a4a0-14f55a037596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:11.384921 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da87d4e-6d72-4bad-a4a0-14f55a037596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:11.386529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da87d4e-6d72-4bad-a4a0-14f55a037596 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:11.397651 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1329/2659] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:11.897726 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a1113-8e3d-4cbd-9192-25a4a480b560 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:11.899135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f62a1113-8e3d-4cbd-9192-25a4a480b560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:11.911447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a1113-8e3d-4cbd-9192-25a4a480b560 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:11.914957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad0862-e4cb-4a6d-9741-da6122cb5271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:11.915588 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad0862-e4cb-4a6d-9741-da6122cb5271 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:11.915871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad0862-e4cb-4a6d-9741-da6122cb5271 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:11.916182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad0862-e4cb-4a6d-9741-da6122cb5271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:11.983747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad0862-e4cb-4a6d-9741-da6122cb5271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:11.985258 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad0862-e4cb-4a6d-9741-da6122cb5271 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:11.995841 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1331/2660] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:15.969002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da87d4e-6d72-4bad-a4a0-14f55a037596 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:15.978030 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da87d4e-6d72-4bad-a4a0-14f55a037596 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:15.982571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0d61c-4a53-459e-832d-9dc4ac1e8aab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:15.982571 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0d61c-4a53-459e-832d-9dc4ac1e8aab service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:15.982949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0d61c-4a53-459e-832d-9dc4ac1e8aab service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:15.983346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0d61c-4a53-459e-832d-9dc4ac1e8aab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:16.041879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0d61c-4a53-459e-832d-9dc4ac1e8aab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:16.043232 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0d61c-4a53-459e-832d-9dc4ac1e8aab service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:16.052680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1330/2661] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:18.118274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad0862-e4cb-4a6d-9741-da6122cb5271 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:18.180408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad0862-e4cb-4a6d-9741-da6122cb5271 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:18.184826 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:18.185679 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:18.185962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:18.186236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] PATH_INFO: `/v3/users/4a97ea23e63d441da589fdb3bb75466b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:18.187758 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a97ea23e63d441da589fdb3bb75466b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:18.189862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:18.204683 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:18.239498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a97ea23e63d441da589fdb3bb75466b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.251141 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a97ea23e63d441da589fdb3bb75466b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.257635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a97ea23e63d441da589fdb3bb75466b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.258447 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a97ea23e63d441da589fdb3bb75466b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.265765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a97ea23e63d441da589fdb3bb75466b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.273774 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1332/2662] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:18 2022] DELETE /identity/v3/users/4a97ea23e63d441da589fdb3bb75466b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:18.278189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675ffc8-955f-4849-902a-5cd25faf08a9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:18.278637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675ffc8-955f-4849-902a-5cd25faf08a9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:18.278742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675ffc8-955f-4849-902a-5cd25faf08a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:18.296194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d675ffc8-955f-4849-902a-5cd25faf08a9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:18.297388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d675ffc8-955f-4849-902a-5cd25faf08a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:18.366738 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1331/2663] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:31:18.376749 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:18.378191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:18.438862 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462c3ee-90cc-4c3c-ac89-42b08c487b3b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:18.443019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba64af-ec4f-49b3-a209-09f043fbc857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:18.443659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba64af-ec4f-49b3-a209-09f043fbc857 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:18.443941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba64af-ec4f-49b3-a209-09f043fbc857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:18.444278 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba64af-ec4f-49b3-a209-09f043fbc857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:18.453320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba64af-ec4f-49b3-a209-09f043fbc857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:18.454754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba64af-ec4f-49b3-a209-09f043fbc857 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:18.464745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1333/2664] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:18.729442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675ffc8-955f-4849-902a-5cd25faf08a9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:18.730909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d675ffc8-955f-4849-902a-5cd25faf08a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:18.745074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675ffc8-955f-4849-902a-5cd25faf08a9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:18.750671 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:18.751652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:18.751823 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:18.752216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] PATH_INFO: `/v3/projects/7ef7a3375a584bd882fd6b49da0df3e1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:18.754120 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef7a3375a584bd882fd6b49da0df3e1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:18.756176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:18.799801 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:18.811069 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef7a3375a584bd882fd6b49da0df3e1', 'request_id': 'req-131fc6c4-e6bc-46b5-b79f-791184472d69'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.817777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef7a3375a584bd882fd6b49da0df3e1', 'request_id': 'req-131fc6c4-e6bc-46b5-b79f-791184472d69'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.823566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef7a3375a584bd882fd6b49da0df3e1', 'request_id': 'req-131fc6c4-e6bc-46b5-b79f-791184472d69'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.837145 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] The token cache is being invalidate because project 7ef7a3375a584bd882fd6b49da0df3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:18.837418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.838029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.839563 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1332/2665] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:18 2022] DELETE /identity/v3/projects/7ef7a3375a584bd882fd6b49da0df3e1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:18.843760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba64af-ec4f-49b3-a209-09f043fbc857 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:18.853359 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba64af-ec4f-49b3-a209-09f043fbc857 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:18.908857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:18.909764 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:18.910051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:18.910328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] PATH_INFO: `/v3/users/726b283a06314544a663d23df7e11f9f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:18.911510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=726b283a06314544a663d23df7e11f9f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:18.913461 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:18.951510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:18.961393 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726b283a06314544a663d23df7e11f9f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.973039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726b283a06314544a663d23df7e11f9f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.979951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726b283a06314544a663d23df7e11f9f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.980609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726b283a06314544a663d23df7e11f9f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.987733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726b283a06314544a663d23df7e11f9f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:18.994717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1334/2666] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:18 2022] DELETE /identity/v3/users/726b283a06314544a663d23df7e11f9f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:19.274630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:19.276093 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:19.292000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fc6c4-e6bc-46b5-b79f-791184472d69 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:19.351631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:19.352553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:19.352835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:19.353115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] PATH_INFO: `/v3/projects/263047542183488ea8133829e4dc34e5` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:19.354442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263047542183488ea8133829e4dc34e5)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:19.356371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:19.402787 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263047542183488ea8133829e4dc34e5', 'request_id': 'req-0e9c954d-f508-43d2-ba73-9ed49b142d07'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:19.408954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263047542183488ea8133829e4dc34e5', 'request_id': 'req-0e9c954d-f508-43d2-ba73-9ed49b142d07'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:19.415076 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263047542183488ea8133829e4dc34e5', 'request_id': 'req-0e9c954d-f508-43d2-ba73-9ed49b142d07'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:19.427791 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] The token cache is being invalidate because project 263047542183488ea8133829e4dc34e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:19.428115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:19.428732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:19.430252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1333/2667] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:19 2022] DELETE /identity/v3/projects/263047542183488ea8133829e4dc34e5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:19.434372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:19.435857 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:19.448813 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dc8cb-7859-47e1-bf17-bd4daac623b9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:19.505213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1189d13-b2e8-4268-9f28-d19a392b7822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:19.506232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1189d13-b2e8-4268-9f28-d19a392b7822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:19.506586 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1189d13-b2e8-4268-9f28-d19a392b7822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:19.506913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1189d13-b2e8-4268-9f28-d19a392b7822 admin admin] PATH_INFO: `/v3/users/531f987afd0d4955ad2071d159d1f3c7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:19.508287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1189d13-b2e8-4268-9f28-d19a392b7822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=531f987afd0d4955ad2071d159d1f3c7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:19.510207 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1189d13-b2e8-4268-9f28-d19a392b7822 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:19.557131 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1189d13-b2e8-4268-9f28-d19a392b7822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531f987afd0d4955ad2071d159d1f3c7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:19.569280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1189d13-b2e8-4268-9f28-d19a392b7822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531f987afd0d4955ad2071d159d1f3c7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:19.576394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1189d13-b2e8-4268-9f28-d19a392b7822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531f987afd0d4955ad2071d159d1f3c7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:19.577010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1189d13-b2e8-4268-9f28-d19a392b7822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531f987afd0d4955ad2071d159d1f3c7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:19.584570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b1189d13-b2e8-4268-9f28-d19a392b7822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531f987afd0d4955ad2071d159d1f3c7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:19.590415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1335/2668] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:19 2022] DELETE /identity/v3/users/531f987afd0d4955ad2071d159d1f3c7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:31:19.863071 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:19.864778 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:19.885693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c954d-f508-43d2-ba73-9ed49b142d07 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:19.935270 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:19.943183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:19.944079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:19.944696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:19.945034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] PATH_INFO: `/v3/projects/d350940bdbbe422f9346004af9268282` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:19.946236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d350940bdbbe422f9346004af9268282)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:19.948748 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:19.993984 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd350940bdbbe422f9346004af9268282', 'request_id': 'req-83a91bb9-938a-4dda-9df2-fa30f2a671db'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:19.999944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd350940bdbbe422f9346004af9268282', 'request_id': 'req-83a91bb9-938a-4dda-9df2-fa30f2a671db'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:20.005869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd350940bdbbe422f9346004af9268282', 'request_id': 'req-83a91bb9-938a-4dda-9df2-fa30f2a671db'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:20.017759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] The token cache is being invalidate because project d350940bdbbe422f9346004af9268282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:20.018050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:20.018700 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-83a91bb9-938a-4dda-9df2-fa30f2a671db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:20.020438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1334/2669] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:19 2022] DELETE /identity/v3/projects/d350940bdbbe422f9346004af9268282 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:20.026844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c4adf-a473-4a30-a9c9-6dcfacaa5f05 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.027136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c4adf-a473-4a30-a9c9-6dcfacaa5f05 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.027418 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c4adf-a473-4a30-a9c9-6dcfacaa5f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.045671 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ef8c4adf-a473-4a30-a9c9-6dcfacaa5f05 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:20.046861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ef8c4adf-a473-4a30-a9c9-6dcfacaa5f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:20.075470 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:20.109608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1336/2670] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:31:20.118079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a0721-cb97-4bb3-ad34-34ee0646eed7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.118394 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a0721-cb97-4bb3-ad34-34ee0646eed7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.118677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a0721-cb97-4bb3-ad34-34ee0646eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.136918 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8c4a0721-cb97-4bb3-ad34-34ee0646eed7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:20.138366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8c4a0721-cb97-4bb3-ad34-34ee0646eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:20.146751 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1335/2671] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:20.150770 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c4adf-a473-4a30-a9c9-6dcfacaa5f05 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.160633 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c4adf-a473-4a30-a9c9-6dcfacaa5f05 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.165283 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee320a-4437-49a1-96ee-f7e720f4a44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.165938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee320a-4437-49a1-96ee-f7e720f4a44b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.166226 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee320a-4437-49a1-96ee-f7e720f4a44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.166510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee320a-4437-49a1-96ee-f7e720f4a44b admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.167269 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee320a-4437-49a1-96ee-f7e720f4a44b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:31:20.167637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee320a-4437-49a1-96ee-f7e720f4a44b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.169293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee320a-4437-49a1-96ee-f7e720f4a44b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.181234 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1337/2672] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:31:20.185175 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a0721-cb97-4bb3-ad34-34ee0646eed7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.194887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a0721-cb97-4bb3-ad34-34ee0646eed7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.199932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe953c9-5834-4fda-9996-31e5324dbb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.200610 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe953c9-5834-4fda-9996-31e5324dbb1c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.200900 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe953c9-5834-4fda-9996-31e5324dbb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.201181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe953c9-5834-4fda-9996-31e5324dbb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.201878 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe953c9-5834-4fda-9996-31e5324dbb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.203766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe953c9-5834-4fda-9996-31e5324dbb1c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.228774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1336/2673] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:20 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:20.232725 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee320a-4437-49a1-96ee-f7e720f4a44b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.243677 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee320a-4437-49a1-96ee-f7e720f4a44b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.297956 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307ad23-ccd5-4058-9dd1-4803054c64ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.298630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307ad23-ccd5-4058-9dd1-4803054c64ad admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.298923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307ad23-ccd5-4058-9dd1-4803054c64ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.299209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307ad23-ccd5-4058-9dd1-4803054c64ad admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.299911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307ad23-ccd5-4058-9dd1-4803054c64ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.302511 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307ad23-ccd5-4058-9dd1-4803054c64ad admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.322717 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1338/2674] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:20 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:31:20.326404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe953c9-5834-4fda-9996-31e5324dbb1c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.336788 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe953c9-5834-4fda-9996-31e5324dbb1c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.341502 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dfc00-bd87-4b35-b4e8-cfbf3e72837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.342156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dfc00-bd87-4b35-b4e8-cfbf3e72837d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.342441 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dfc00-bd87-4b35-b4e8-cfbf3e72837d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.342742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dfc00-bd87-4b35-b4e8-cfbf3e72837d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.343465 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dfc00-bd87-4b35-b4e8-cfbf3e72837d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.345092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dfc00-bd87-4b35-b4e8-cfbf3e72837d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.355470 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1337/2675] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:20.359122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307ad23-ccd5-4058-9dd1-4803054c64ad admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.369754 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307ad23-ccd5-4058-9dd1-4803054c64ad admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.374328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44e1eb-38ca-465a-b366-ecebc7a95e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.374978 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e1eb-38ca-465a-b366-ecebc7a95e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.375264 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e1eb-38ca-465a-b366-ecebc7a95e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.375545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44e1eb-38ca-465a-b366-ecebc7a95e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.376318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44e1eb-38ca-465a-b366-ecebc7a95e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.378000 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44e1eb-38ca-465a-b366-ecebc7a95e98 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.389837 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1339/2676] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:20.393854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dfc00-bd87-4b35-b4e8-cfbf3e72837d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.403877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dfc00-bd87-4b35-b4e8-cfbf3e72837d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.408683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca5d71-4d50-4d32-9435-3514176ddb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.409560 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca5d71-4d50-4d32-9435-3514176ddb40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.409848 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca5d71-4d50-4d32-9435-3514176ddb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.410126 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca5d71-4d50-4d32-9435-3514176ddb40 admin admin] PATH_INFO: `/v3/projects/21def26b5bd74f2ab68f3f49dfee4b8b/users/32d473e440bb4c5ea9ea8def5b21b7d9/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.424931 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca5d71-4d50-4d32-9435-3514176ddb40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21def26b5bd74f2ab68f3f49dfee4b8b, user_id=32d473e440bb4c5ea9ea8def5b21b7d9, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.428215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca5d71-4d50-4d32-9435-3514176ddb40 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.441540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1338/2677] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:20 2022] PUT /identity/v3/projects/21def26b5bd74f2ab68f3f49dfee4b8b/users/32d473e440bb4c5ea9ea8def5b21b7d9/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:20.453179 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88582b-89eb-4fd0-955d-45f4722fc971 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.453647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88582b-89eb-4fd0-955d-45f4722fc971 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.453783 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88582b-89eb-4fd0-955d-45f4722fc971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.480705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fe88582b-89eb-4fd0-955d-45f4722fc971 None None] MFA Rules not processed for user `32d473e440bb4c5ea9ea8def5b21b7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:20.481915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fe88582b-89eb-4fd0-955d-45f4722fc971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:20.544850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1340/2678] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:31:20.549415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca5d71-4d50-4d32-9435-3514176ddb40 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.611779 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca5d71-4d50-4d32-9435-3514176ddb40 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.617242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e31de-5d71-45ae-b4d3-0c65743b4dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.617892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e31de-5d71-45ae-b4d3-0c65743b4dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.618176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e31de-5d71-45ae-b4d3-0c65743b4dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.618452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e31de-5d71-45ae-b4d3-0c65743b4dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.619153 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e31de-5d71-45ae-b4d3-0c65743b4dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.621139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e31de-5d71-45ae-b4d3-0c65743b4dd0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.646031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1339/2679] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:20 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:20.650089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88582b-89eb-4fd0-955d-45f4722fc971 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.660556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88582b-89eb-4fd0-955d-45f4722fc971 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.686161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:20.717128 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6a2c-4f8d-4854-be46-1048e8f73e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.717790 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6a2c-4f8d-4854-be46-1048e8f73e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.718072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6a2c-4f8d-4854-be46-1048e8f73e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.718346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6a2c-4f8d-4854-be46-1048e8f73e06 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.719054 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb6a2c-4f8d-4854-be46-1048e8f73e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.720986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb6a2c-4f8d-4854-be46-1048e8f73e06 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.746026 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1341/2680] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:20 2022] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:20.747413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e31de-5d71-45ae-b4d3-0c65743b4dd0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.759080 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e31de-5d71-45ae-b4d3-0c65743b4dd0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.764384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b7cf3-6792-4a25-82c2-9118c08ca0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.765130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b7cf3-6792-4a25-82c2-9118c08ca0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.765484 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b7cf3-6792-4a25-82c2-9118c08ca0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.765862 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b7cf3-6792-4a25-82c2-9118c08ca0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.766663 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b7cf3-6792-4a25-82c2-9118c08ca0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.768483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b7cf3-6792-4a25-82c2-9118c08ca0e8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.769785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:20.782888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1340/2681] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:20.786364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6a2c-4f8d-4854-be46-1048e8f73e06 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.797366 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6a2c-4f8d-4854-be46-1048e8f73e06 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.802377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ed2e6-526d-4d7b-abba-d53115d3bc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.803540 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ed2e6-526d-4d7b-abba-d53115d3bc01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.804230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ed2e6-526d-4d7b-abba-d53115d3bc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.804729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ed2e6-526d-4d7b-abba-d53115d3bc01 admin admin] PATH_INFO: `/v3/projects/82cf7d05cbf2410e97ed550783d4f8cb/users/77556222eba844c1bb72323649b47126/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.823764 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ed2e6-526d-4d7b-abba-d53115d3bc01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cf7d05cbf2410e97ed550783d4f8cb, user_id=77556222eba844c1bb72323649b47126, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.826501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ed2e6-526d-4d7b-abba-d53115d3bc01 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.842159 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1342/2682] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:20 2022] PUT /identity/v3/projects/82cf7d05cbf2410e97ed550783d4f8cb/users/77556222eba844c1bb72323649b47126/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:31:20.846215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b7cf3-6792-4a25-82c2-9118c08ca0e8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.856937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b7cf3-6792-4a25-82c2-9118c08ca0e8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.915742 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c26c0-ca17-496f-badb-5a7f55767d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.916444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c26c0-ca17-496f-badb-5a7f55767d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.916730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c26c0-ca17-496f-badb-5a7f55767d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.917007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c26c0-ca17-496f-badb-5a7f55767d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.917739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c26c0-ca17-496f-badb-5a7f55767d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.919343 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c26c0-ca17-496f-badb-5a7f55767d64 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.930184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1341/2683] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:31:20.934127 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ed2e6-526d-4d7b-abba-d53115d3bc01 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:20.944665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ed2e6-526d-4d7b-abba-d53115d3bc01 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:20.949491 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fe763-f2e8-4d3c-86c0-d994f3005c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:20.950451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fe763-f2e8-4d3c-86c0-d994f3005c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.950805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fe763-f2e8-4d3c-86c0-d994f3005c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.951087 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fe763-f2e8-4d3c-86c0-d994f3005c46 admin admin] PATH_INFO: `/v3/projects/82cf7d05cbf2410e97ed550783d4f8cb/users/77556222eba844c1bb72323649b47126/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:20.953076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fe763-f2e8-4d3c-86c0-d994f3005c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cf7d05cbf2410e97ed550783d4f8cb, user_id=77556222eba844c1bb72323649b47126, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:20.955724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fe763-f2e8-4d3c-86c0-d994f3005c46 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:20.966990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1343/2684] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:20 2022] PUT /identity/v3/projects/82cf7d05cbf2410e97ed550783d4f8cb/users/77556222eba844c1bb72323649b47126/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:20.978415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381689-d0cb-4beb-9338-05414475fa0e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:20.978712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381689-d0cb-4beb-9338-05414475fa0e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:20.979004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381689-d0cb-4beb-9338-05414475fa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:21.005601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f9381689-d0cb-4beb-9338-05414475fa0e None None] MFA Rules not processed for user `77556222eba844c1bb72323649b47126`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:21.006810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f9381689-d0cb-4beb-9338-05414475fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:21.074380 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1342/2685] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:21.085746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fe763-f2e8-4d3c-86c0-d994f3005c46 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:21.087474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e44fe763-f2e8-4d3c-86c0-d994f3005c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:21.143423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fe763-f2e8-4d3c-86c0-d994f3005c46 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:21.147636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1ff0e-d25d-4ebc-9107-5877e5dcbe3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:21.148303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1ff0e-d25d-4ebc-9107-5877e5dcbe3d service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:21.148595 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1ff0e-d25d-4ebc-9107-5877e5dcbe3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:21.148875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1ff0e-d25d-4ebc-9107-5877e5dcbe3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:21.158003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1ff0e-d25d-4ebc-9107-5877e5dcbe3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:21.159439 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1ff0e-d25d-4ebc-9107-5877e5dcbe3d service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:21.169561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1344/2686] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:21.238637 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9381689-d0cb-4beb-9338-05414475fa0e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:21.248346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9381689-d0cb-4beb-9338-05414475fa0e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:21.251872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f77d3-59d6-4d59-80a4-74e53d101915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:21.252567 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f77d3-59d6-4d59-80a4-74e53d101915 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:21.252847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f77d3-59d6-4d59-80a4-74e53d101915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:21.253123 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f77d3-59d6-4d59-80a4-74e53d101915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:21.310121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f77d3-59d6-4d59-80a4-74e53d101915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:21.311551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f77d3-59d6-4d59-80a4-74e53d101915 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:21.320972 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1343/2687] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:28.468688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1ff0e-d25d-4ebc-9107-5877e5dcbe3d service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:28.529920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1ff0e-d25d-4ebc-9107-5877e5dcbe3d service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:28.534390 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:28.535251 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:28.535541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:28.535820 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] PATH_INFO: `/v3/users/32d473e440bb4c5ea9ea8def5b21b7d9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:28.537029 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d473e440bb4c5ea9ea8def5b21b7d9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:28.539518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:28.565631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:28.587366 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d473e440bb4c5ea9ea8def5b21b7d9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:28.599503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d473e440bb4c5ea9ea8def5b21b7d9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:28.607578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d473e440bb4c5ea9ea8def5b21b7d9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:28.608239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d473e440bb4c5ea9ea8def5b21b7d9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:28.615258 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d473e440bb4c5ea9ea8def5b21b7d9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:28.621135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1345/2688] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:28 2022] DELETE /identity/v3/users/32d473e440bb4c5ea9ea8def5b21b7d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:28.625601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6096d4-f439-4c7f-8f7e-8892275b99ff None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:28.626118 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6096d4-f439-4c7f-8f7e-8892275b99ff None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:28.626227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6096d4-f439-4c7f-8f7e-8892275b99ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:28.643113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-dd6096d4-f439-4c7f-8f7e-8892275b99ff None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:28.644338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dd6096d4-f439-4c7f-8f7e-8892275b99ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:28.653840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:28.702927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1344/2689] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:28.713129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:28.714520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:28.773666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d3797-794e-4e44-b7f5-4ef87e3fcd4f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:28.777744 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d930-374e-46f0-bcd1-b088fb8cd32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:28.778402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d930-374e-46f0-bcd1-b088fb8cd32e service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:28.778689 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d930-374e-46f0-bcd1-b088fb8cd32e service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:28.778970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d930-374e-46f0-bcd1-b088fb8cd32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:28.788387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d930-374e-46f0-bcd1-b088fb8cd32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:28.789782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d930-374e-46f0-bcd1-b088fb8cd32e service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:28.799216 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1346/2690] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:29.065388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6096d4-f439-4c7f-8f7e-8892275b99ff None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:29.066881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dd6096d4-f439-4c7f-8f7e-8892275b99ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:29.089781 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6096d4-f439-4c7f-8f7e-8892275b99ff None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:29.105092 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:29.105989 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:29.106275 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:29.106554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] PATH_INFO: `/v3/projects/21def26b5bd74f2ab68f3f49dfee4b8b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:29.107818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21def26b5bd74f2ab68f3f49dfee4b8b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:29.109715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:29.160713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21def26b5bd74f2ab68f3f49dfee4b8b', 'request_id': 'req-285cc1b2-84a8-416a-a64c-e41e84b90017'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.167309 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21def26b5bd74f2ab68f3f49dfee4b8b', 'request_id': 'req-285cc1b2-84a8-416a-a64c-e41e84b90017'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.172932 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21def26b5bd74f2ab68f3f49dfee4b8b', 'request_id': 'req-285cc1b2-84a8-416a-a64c-e41e84b90017'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.185553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] The token cache is being invalidate because project 21def26b5bd74f2ab68f3f49dfee4b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:29.185843 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.186469 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.188004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1345/2691] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:29 2022] DELETE /identity/v3/projects/21def26b5bd74f2ab68f3f49dfee4b8b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:29.191954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d930-374e-46f0-bcd1-b088fb8cd32e service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:29.202434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d930-374e-46f0-bcd1-b088fb8cd32e service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:29.259525 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4be9b1-3469-4993-9f4b-2311ecc1a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:29.260427 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4be9b1-3469-4993-9f4b-2311ecc1a242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:29.260710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4be9b1-3469-4993-9f4b-2311ecc1a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:29.260987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4be9b1-3469-4993-9f4b-2311ecc1a242 admin admin] PATH_INFO: `/v3/users/77556222eba844c1bb72323649b47126` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:29.262154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4be9b1-3469-4993-9f4b-2311ecc1a242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77556222eba844c1bb72323649b47126)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:29.264384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4be9b1-3469-4993-9f4b-2311ecc1a242 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:29.312440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e4be9b1-3469-4993-9f4b-2311ecc1a242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77556222eba844c1bb72323649b47126'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.313871 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:29.328654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e4be9b1-3469-4993-9f4b-2311ecc1a242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77556222eba844c1bb72323649b47126'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.336699 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e4be9b1-3469-4993-9f4b-2311ecc1a242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77556222eba844c1bb72323649b47126'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.337322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e4be9b1-3469-4993-9f4b-2311ecc1a242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77556222eba844c1bb72323649b47126'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.345217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e4be9b1-3469-4993-9f4b-2311ecc1a242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77556222eba844c1bb72323649b47126'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.351429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1347/2692] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:29 2022] DELETE /identity/v3/users/77556222eba844c1bb72323649b47126 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:29.637793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:29.639954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:29.673609 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cc1b2-84a8-416a-a64c-e41e84b90017 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:29.729752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:29.730611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:29.730897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:29.731178 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] PATH_INFO: `/v3/projects/82cf7d05cbf2410e97ed550783d4f8cb` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:29.732413 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] RBAC: Authorizing `identity:delete_project(project_id=82cf7d05cbf2410e97ed550783d4f8cb)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:29.734423 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:29.774690 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:29.782254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82cf7d05cbf2410e97ed550783d4f8cb', 'request_id': 'req-837c878e-3bd4-4abe-aea9-37219d06cbda'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.790094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82cf7d05cbf2410e97ed550783d4f8cb', 'request_id': 'req-837c878e-3bd4-4abe-aea9-37219d06cbda'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.795722 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82cf7d05cbf2410e97ed550783d4f8cb', 'request_id': 'req-837c878e-3bd4-4abe-aea9-37219d06cbda'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.808323 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] The token cache is being invalidate because project 82cf7d05cbf2410e97ed550783d4f8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:29.808613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.809260 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-837c878e-3bd4-4abe-aea9-37219d06cbda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:29.810820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1346/2693] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:29 2022] DELETE /identity/v3/projects/82cf7d05cbf2410e97ed550783d4f8cb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:29.816098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc151f9a-e189-4b11-a0b1-c6afb3892f2e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:29.816563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc151f9a-e189-4b11-a0b1-c6afb3892f2e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:29.816663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc151f9a-e189-4b11-a0b1-c6afb3892f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:29.834739 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cc151f9a-e189-4b11-a0b1-c6afb3892f2e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:29.835924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cc151f9a-e189-4b11-a0b1-c6afb3892f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:29.894451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1348/2694] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:29.902388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79542195-2a10-4dd3-b2d8-5ebea909a002 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:29.902675 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79542195-2a10-4dd3-b2d8-5ebea909a002 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:29.902951 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79542195-2a10-4dd3-b2d8-5ebea909a002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:29.921756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-79542195-2a10-4dd3-b2d8-5ebea909a002 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:29.923639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-79542195-2a10-4dd3-b2d8-5ebea909a002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:29.936555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1347/2695] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:29.940933 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc151f9a-e189-4b11-a0b1-c6afb3892f2e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:29.950569 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc151f9a-e189-4b11-a0b1-c6afb3892f2e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:29.955243 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b19e-0e0e-4fc9-8889-c12aa36acb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:29.955895 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b19e-0e0e-4fc9-8889-c12aa36acb73 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:29.956219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b19e-0e0e-4fc9-8889-c12aa36acb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:29.956499 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b19e-0e0e-4fc9-8889-c12aa36acb73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:29.957219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1b19e-0e0e-4fc9-8889-c12aa36acb73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:31:29.957529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1b19e-0e0e-4fc9-8889-c12aa36acb73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:29.959126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1b19e-0e0e-4fc9-8889-c12aa36acb73 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:29.971008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1349/2696] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 12:31:29.975116 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79542195-2a10-4dd3-b2d8-5ebea909a002 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:29.985066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79542195-2a10-4dd3-b2d8-5ebea909a002 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:29.989724 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59333a48-67a0-4720-9fd5-3d506b467196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:29.990367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59333a48-67a0-4720-9fd5-3d506b467196 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:29.990658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59333a48-67a0-4720-9fd5-3d506b467196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:29.990940 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59333a48-67a0-4720-9fd5-3d506b467196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:29.991633 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59333a48-67a0-4720-9fd5-3d506b467196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:29.993565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59333a48-67a0-4720-9fd5-3d506b467196 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.018593 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1348/2697] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:29 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:30.022335 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b19e-0e0e-4fc9-8889-c12aa36acb73 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:30.032883 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b19e-0e0e-4fc9-8889-c12aa36acb73 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:30.089318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e6643-53b8-41c0-b53a-aaa0a4b3d0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:30.089916 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e6643-53b8-41c0-b53a-aaa0a4b3d0aa admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.090203 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e6643-53b8-41c0-b53a-aaa0a4b3d0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.090485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e6643-53b8-41c0-b53a-aaa0a4b3d0aa admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.091178 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e6643-53b8-41c0-b53a-aaa0a4b3d0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:30.093277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e6643-53b8-41c0-b53a-aaa0a4b3d0aa admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.114101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1350/2698] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:30 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:30.118154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59333a48-67a0-4720-9fd5-3d506b467196 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:30.128326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59333a48-67a0-4720-9fd5-3d506b467196 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:30.132898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1abc1f-8593-46f8-973f-292aafbab7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:30.133546 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1abc1f-8593-46f8-973f-292aafbab7bf admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.133831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1abc1f-8593-46f8-973f-292aafbab7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.134108 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1abc1f-8593-46f8-973f-292aafbab7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.134856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1abc1f-8593-46f8-973f-292aafbab7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:30.136482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1abc1f-8593-46f8-973f-292aafbab7bf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.146980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1349/2699] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:30.151232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e6643-53b8-41c0-b53a-aaa0a4b3d0aa admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:30.160995 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e6643-53b8-41c0-b53a-aaa0a4b3d0aa admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:30.166233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382842ef-a595-4723-807d-2bd590cfe2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:30.166879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382842ef-a595-4723-807d-2bd590cfe2ff admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.167163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382842ef-a595-4723-807d-2bd590cfe2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.167442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382842ef-a595-4723-807d-2bd590cfe2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.168210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382842ef-a595-4723-807d-2bd590cfe2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:30.169804 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382842ef-a595-4723-807d-2bd590cfe2ff admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.179527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1351/2700] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:30.183523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1abc1f-8593-46f8-973f-292aafbab7bf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:30.193298 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1abc1f-8593-46f8-973f-292aafbab7bf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:30.197768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644304d-280e-4ee4-9cfa-6d42b074b18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:30.198623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644304d-280e-4ee4-9cfa-6d42b074b18e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.198905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644304d-280e-4ee4-9cfa-6d42b074b18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.199185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644304d-280e-4ee4-9cfa-6d42b074b18e admin admin] PATH_INFO: `/v3/projects/5e2c4a1a17bc46169f97cd876fc4afc8/users/b5e2b64899454c0fba05289834385e6e/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.213624 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644304d-280e-4ee4-9cfa-6d42b074b18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2c4a1a17bc46169f97cd876fc4afc8, user_id=b5e2b64899454c0fba05289834385e6e, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:30.216300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644304d-280e-4ee4-9cfa-6d42b074b18e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.229828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1350/2701] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:30 2022] PUT /identity/v3/projects/5e2c4a1a17bc46169f97cd876fc4afc8/users/b5e2b64899454c0fba05289834385e6e/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:30.239827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60581c-adb1-4559-960c-d722cac517f8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.240164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60581c-adb1-4559-960c-d722cac517f8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.240451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60581c-adb1-4559-960c-d722cac517f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.267749 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1a60581c-adb1-4559-960c-d722cac517f8 None None] MFA Rules not processed for user `b5e2b64899454c0fba05289834385e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:30.269030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1a60581c-adb1-4559-960c-d722cac517f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:30.287743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:30.334348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1352/2702] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:30.339288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644304d-280e-4ee4-9cfa-6d42b074b18e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:30.399778 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644304d-280e-4ee4-9cfa-6d42b074b18e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:30.404530 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809caa0f-578e-4cf5-a7c7-23769ba89578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:30.405173 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809caa0f-578e-4cf5-a7c7-23769ba89578 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.405457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809caa0f-578e-4cf5-a7c7-23769ba89578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.405764 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809caa0f-578e-4cf5-a7c7-23769ba89578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.406476 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809caa0f-578e-4cf5-a7c7-23769ba89578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:30.408433 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809caa0f-578e-4cf5-a7c7-23769ba89578 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.435594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1351/2703] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:30 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:30.439460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60581c-adb1-4559-960c-d722cac517f8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:30.451708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60581c-adb1-4559-960c-d722cac517f8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:30.510242 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc71580-9426-448f-b4c5-e1a97db06b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:30.510911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc71580-9426-448f-b4c5-e1a97db06b09 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.511196 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc71580-9426-448f-b4c5-e1a97db06b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.511472 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc71580-9426-448f-b4c5-e1a97db06b09 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.512197 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc71580-9426-448f-b4c5-e1a97db06b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:30.514353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc71580-9426-448f-b4c5-e1a97db06b09 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.537456 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1353/2704] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:30 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:30.538695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809caa0f-578e-4cf5-a7c7-23769ba89578 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:30.549437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809caa0f-578e-4cf5-a7c7-23769ba89578 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:30.554466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cf5c6-24b7-46af-95f1-c3f711dbd7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:30.555132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cf5c6-24b7-46af-95f1-c3f711dbd7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.555420 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cf5c6-24b7-46af-95f1-c3f711dbd7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.555704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cf5c6-24b7-46af-95f1-c3f711dbd7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.556466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cf5c6-24b7-46af-95f1-c3f711dbd7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:30.558115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cf5c6-24b7-46af-95f1-c3f711dbd7c5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.572855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1352/2705] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:30.574235 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc71580-9426-448f-b4c5-e1a97db06b09 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:30.584235 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc71580-9426-448f-b4c5-e1a97db06b09 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:30.589694 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3db24e-7f05-40d4-a32e-c284c11a7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:30.590600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3db24e-7f05-40d4-a32e-c284c11a7e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.590889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3db24e-7f05-40d4-a32e-c284c11a7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.591168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3db24e-7f05-40d4-a32e-c284c11a7e1b admin admin] PATH_INFO: `/v3/projects/926edaa6db9841fa907e98b056d3eeb8/users/401e9b19a5f04757b49c6fb77f050173/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.606748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3db24e-7f05-40d4-a32e-c284c11a7e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=926edaa6db9841fa907e98b056d3eeb8, user_id=401e9b19a5f04757b49c6fb77f050173, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:30.610241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3db24e-7f05-40d4-a32e-c284c11a7e1b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.624693 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1354/2706] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:30 2022] PUT /identity/v3/projects/926edaa6db9841fa907e98b056d3eeb8/users/401e9b19a5f04757b49c6fb77f050173/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:30.628449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cf5c6-24b7-46af-95f1-c3f711dbd7c5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:30.639301 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cf5c6-24b7-46af-95f1-c3f711dbd7c5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:30.679868 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:30.700485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92f5e0-5f69-4aa0-80b9-7b9948a7cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:30.701241 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f5e0-5f69-4aa0-80b9-7b9948a7cda9 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.701607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f5e0-5f69-4aa0-80b9-7b9948a7cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.701981 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f5e0-5f69-4aa0-80b9-7b9948a7cda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.702711 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92f5e0-5f69-4aa0-80b9-7b9948a7cda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:30.704342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92f5e0-5f69-4aa0-80b9-7b9948a7cda9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.718765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1353/2707] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:30.722057 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3db24e-7f05-40d4-a32e-c284c11a7e1b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:30.734154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3db24e-7f05-40d4-a32e-c284c11a7e1b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:30.738922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4bcf-8d72-48c2-b04c-da6abece3498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:30.739810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4bcf-8d72-48c2-b04c-da6abece3498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.740124 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4bcf-8d72-48c2-b04c-da6abece3498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.740408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4bcf-8d72-48c2-b04c-da6abece3498 admin admin] PATH_INFO: `/v3/projects/926edaa6db9841fa907e98b056d3eeb8/users/401e9b19a5f04757b49c6fb77f050173/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.742394 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd4bcf-8d72-48c2-b04c-da6abece3498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926edaa6db9841fa907e98b056d3eeb8, user_id=401e9b19a5f04757b49c6fb77f050173, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:30.745786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd4bcf-8d72-48c2-b04c-da6abece3498 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.757033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1355/2708] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:30 2022] PUT /identity/v3/projects/926edaa6db9841fa907e98b056d3eeb8/users/401e9b19a5f04757b49c6fb77f050173/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:30.772062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45ed6e-d1f5-4daa-87b5-50829c72eb4b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.772062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45ed6e-d1f5-4daa-87b5-50829c72eb4b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.772062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45ed6e-d1f5-4daa-87b5-50829c72eb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.801952 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2d45ed6e-d1f5-4daa-87b5-50829c72eb4b None None] MFA Rules not processed for user `401e9b19a5f04757b49c6fb77f050173`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:30.803180 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2d45ed6e-d1f5-4daa-87b5-50829c72eb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:30.882349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1354/2709] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:30.893865 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4bcf-8d72-48c2-b04c-da6abece3498 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:30.895627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-26fd4bcf-8d72-48c2-b04c-da6abece3498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:30.952628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4bcf-8d72-48c2-b04c-da6abece3498 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:30.956259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7d0e6-9d90-4ce5-a292-9334b3853204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:30.956903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7d0e6-9d90-4ce5-a292-9334b3853204 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:30.957190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7d0e6-9d90-4ce5-a292-9334b3853204 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:30.957468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7d0e6-9d90-4ce5-a292-9334b3853204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:30.967275 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7d0e6-9d90-4ce5-a292-9334b3853204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:30.968781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7d0e6-9d90-4ce5-a292-9334b3853204 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:30.978886 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1356/2710] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:31.331544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45ed6e-d1f5-4daa-87b5-50829c72eb4b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:31.393369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45ed6e-d1f5-4daa-87b5-50829c72eb4b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:31.398386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:31.399247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:31.399536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:31.399817 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] PATH_INFO: `/v3/users/b5e2b64899454c0fba05289834385e6e` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:31.401025 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e2b64899454c0fba05289834385e6e)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:31.402943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:31.448565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e2b64899454c0fba05289834385e6e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:31.459643 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:31.461293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e2b64899454c0fba05289834385e6e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:31.469497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e2b64899454c0fba05289834385e6e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:31.470198 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e2b64899454c0fba05289834385e6e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:31.477703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e2b64899454c0fba05289834385e6e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:31.483559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1355/2711] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:31 2022] DELETE /identity/v3/users/b5e2b64899454c0fba05289834385e6e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:31.488119 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf96a15-b0bd-4911-a678-3bbe1d8347ce None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:31.488420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf96a15-b0bd-4911-a678-3bbe1d8347ce None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:31.488710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf96a15-b0bd-4911-a678-3bbe1d8347ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:31.506101 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6bf96a15-b0bd-4911-a678-3bbe1d8347ce None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:31.507307 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6bf96a15-b0bd-4911-a678-3bbe1d8347ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:31.516711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:31.566996 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1357/2712] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:31.576565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:31.577946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:31.636352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6b40a-f4ab-491a-8935-de8e629bc3c1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:31.640296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe9fe-7f3f-4ba6-bad3-2671cd76e115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:31.640941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe9fe-7f3f-4ba6-bad3-2671cd76e115 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:31.641229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe9fe-7f3f-4ba6-bad3-2671cd76e115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:31.641512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe9fe-7f3f-4ba6-bad3-2671cd76e115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:31.651019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebe9fe-7f3f-4ba6-bad3-2671cd76e115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:31.652487 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebe9fe-7f3f-4ba6-bad3-2671cd76e115 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:31.662271 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1356/2713] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:31.932405 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf96a15-b0bd-4911-a678-3bbe1d8347ce None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:31.933873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6bf96a15-b0bd-4911-a678-3bbe1d8347ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:31.946645 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf96a15-b0bd-4911-a678-3bbe1d8347ce None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:31.952064 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:31.952951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:31.953239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:31.953520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] PATH_INFO: `/v3/projects/5e2c4a1a17bc46169f97cd876fc4afc8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:31.955263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2c4a1a17bc46169f97cd876fc4afc8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:31.957924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:32.004355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2c4a1a17bc46169f97cd876fc4afc8', 'request_id': 'req-405dac10-2aa7-48c5-beb3-ed8eeec20d60'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.010808 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2c4a1a17bc46169f97cd876fc4afc8', 'request_id': 'req-405dac10-2aa7-48c5-beb3-ed8eeec20d60'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.016557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2c4a1a17bc46169f97cd876fc4afc8', 'request_id': 'req-405dac10-2aa7-48c5-beb3-ed8eeec20d60'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.028832 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] The token cache is being invalidate because project 5e2c4a1a17bc46169f97cd876fc4afc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:32.029081 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.029705 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.031244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1358/2714] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:31 2022] DELETE /identity/v3/projects/5e2c4a1a17bc46169f97cd876fc4afc8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:31:32.035174 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe9fe-7f3f-4ba6-bad3-2671cd76e115 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:32.045296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe9fe-7f3f-4ba6-bad3-2671cd76e115 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:32.101448 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc1b2d-e3e5-4856-ad1d-c41f2fd13cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:32.102321 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc1b2d-e3e5-4856-ad1d-c41f2fd13cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:32.102708 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc1b2d-e3e5-4856-ad1d-c41f2fd13cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:32.102992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc1b2d-e3e5-4856-ad1d-c41f2fd13cc8 admin admin] PATH_INFO: `/v3/users/401e9b19a5f04757b49c6fb77f050173` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:32.104223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc1b2d-e3e5-4856-ad1d-c41f2fd13cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=401e9b19a5f04757b49c6fb77f050173)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:32.106146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc1b2d-e3e5-4856-ad1d-c41f2fd13cc8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:32.151404 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e2dc1b2d-e3e5-4856-ad1d-c41f2fd13cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '401e9b19a5f04757b49c6fb77f050173'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.164161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e2dc1b2d-e3e5-4856-ad1d-c41f2fd13cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '401e9b19a5f04757b49c6fb77f050173'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.171728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e2dc1b2d-e3e5-4856-ad1d-c41f2fd13cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '401e9b19a5f04757b49c6fb77f050173'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.172564 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e2dc1b2d-e3e5-4856-ad1d-c41f2fd13cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '401e9b19a5f04757b49c6fb77f050173'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.181577 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e2dc1b2d-e3e5-4856-ad1d-c41f2fd13cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '401e9b19a5f04757b49c6fb77f050173'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.187548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1357/2715] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:32 2022] DELETE /identity/v3/users/401e9b19a5f04757b49c6fb77f050173 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:32.455728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:32.457376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:32.477981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dac10-2aa7-48c5-beb3-ed8eeec20d60 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:32.535434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:32.536260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:32.536545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:32.536821 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] PATH_INFO: `/v3/projects/926edaa6db9841fa907e98b056d3eeb8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:32.537998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=926edaa6db9841fa907e98b056d3eeb8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:32.539924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:32.578867 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:32.586198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926edaa6db9841fa907e98b056d3eeb8', 'request_id': 'req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.592805 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926edaa6db9841fa907e98b056d3eeb8', 'request_id': 'req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.598339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926edaa6db9841fa907e98b056d3eeb8', 'request_id': 'req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.611564 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] The token cache is being invalidate because project 926edaa6db9841fa907e98b056d3eeb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:32.611910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.612637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-07061eb8-cb62-40f5-a98b-c4d8fe250fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:32.614198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1359/2716] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:32 2022] DELETE /identity/v3/projects/926edaa6db9841fa907e98b056d3eeb8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:32.619049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0f062-19b1-433b-86fb-51d5491f224b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:32.619336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0f062-19b1-433b-86fb-51d5491f224b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:32.619613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0f062-19b1-433b-86fb-51d5491f224b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:32.625840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:32.640291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9db0f062-19b1-433b-86fb-51d5491f224b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:32.641479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9db0f062-19b1-433b-86fb-51d5491f224b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:32.698757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1358/2717] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:32.706415 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50b057-8da3-4259-bdc6-c5db61734329 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:32.706713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50b057-8da3-4259-bdc6-c5db61734329 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:32.707001 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50b057-8da3-4259-bdc6-c5db61734329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:32.725567 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2e50b057-8da3-4259-bdc6-c5db61734329 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:32.726816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2e50b057-8da3-4259-bdc6-c5db61734329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:32.734700 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1360/2718] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:32.738746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0f062-19b1-433b-86fb-51d5491f224b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:32.748613 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0f062-19b1-433b-86fb-51d5491f224b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:32.753243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb468ae-1a01-4509-a3b1-966841f402ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:32.753892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb468ae-1a01-4509-a3b1-966841f402ed admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:32.754207 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb468ae-1a01-4509-a3b1-966841f402ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:32.754487 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb468ae-1a01-4509-a3b1-966841f402ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:32.755215 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb468ae-1a01-4509-a3b1-966841f402ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:31:32.755529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb468ae-1a01-4509-a3b1-966841f402ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:32.757661 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb468ae-1a01-4509-a3b1-966841f402ed admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:32.769234 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1359/2719] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:31:32.773863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50b057-8da3-4259-bdc6-c5db61734329 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:32.783125 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50b057-8da3-4259-bdc6-c5db61734329 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:32.787852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e508a-b241-4ad8-8d2a-ac6c3bc8cc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:32.788510 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e508a-b241-4ad8-8d2a-ac6c3bc8cc07 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:32.788792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e508a-b241-4ad8-8d2a-ac6c3bc8cc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:32.789067 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e508a-b241-4ad8-8d2a-ac6c3bc8cc07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:32.789748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e508a-b241-4ad8-8d2a-ac6c3bc8cc07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:32.791638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e508a-b241-4ad8-8d2a-ac6c3bc8cc07 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:32.816801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1361/2720] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:32 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:32.821342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb468ae-1a01-4509-a3b1-966841f402ed admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:32.831680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb468ae-1a01-4509-a3b1-966841f402ed admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:32.889235 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457a077-83cc-428b-bfbc-89f7d59215b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:32.889906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a077-83cc-428b-bfbc-89f7d59215b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:32.890199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a077-83cc-428b-bfbc-89f7d59215b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:32.890481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a077-83cc-428b-bfbc-89f7d59215b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:32.891172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457a077-83cc-428b-bfbc-89f7d59215b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:32.893154 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457a077-83cc-428b-bfbc-89f7d59215b4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:32.912662 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1360/2721] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:32 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:32.916755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e508a-b241-4ad8-8d2a-ac6c3bc8cc07 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:32.926993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e508a-b241-4ad8-8d2a-ac6c3bc8cc07 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:32.932194 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679441fb-9be4-4aaf-87c4-45019b45ab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:32.932850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679441fb-9be4-4aaf-87c4-45019b45ab1a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:32.933396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679441fb-9be4-4aaf-87c4-45019b45ab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:32.933396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679441fb-9be4-4aaf-87c4-45019b45ab1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:32.934129 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679441fb-9be4-4aaf-87c4-45019b45ab1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:32.935729 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679441fb-9be4-4aaf-87c4-45019b45ab1a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:32.947688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1362/2722] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:32.951481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457a077-83cc-428b-bfbc-89f7d59215b4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:32.961941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457a077-83cc-428b-bfbc-89f7d59215b4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:32.966576 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0be40-39cc-4c93-82ca-65917007fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:32.967258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0be40-39cc-4c93-82ca-65917007fa21 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:32.967548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0be40-39cc-4c93-82ca-65917007fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:32.967855 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0be40-39cc-4c93-82ca-65917007fa21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:32.968604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0be40-39cc-4c93-82ca-65917007fa21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:32.970200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0be40-39cc-4c93-82ca-65917007fa21 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:32.980082 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1361/2723] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:32.983986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679441fb-9be4-4aaf-87c4-45019b45ab1a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:32.994411 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679441fb-9be4-4aaf-87c4-45019b45ab1a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:32.999209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbd1b0-3b16-4f35-8df1-4828f6ac9584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:33.000112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbd1b0-3b16-4f35-8df1-4828f6ac9584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:33.000404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbd1b0-3b16-4f35-8df1-4828f6ac9584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:33.000685 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbd1b0-3b16-4f35-8df1-4828f6ac9584 admin admin] PATH_INFO: `/v3/projects/7a62903da92c492eb78efcda786ee8f3/users/9aac4222fdd442599675535860e5f5ee/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:33.015970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbd1b0-3b16-4f35-8df1-4828f6ac9584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a62903da92c492eb78efcda786ee8f3, user_id=9aac4222fdd442599675535860e5f5ee, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:33.018663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbd1b0-3b16-4f35-8df1-4828f6ac9584 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:33.032175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1363/2724] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:32 2022] PUT /identity/v3/projects/7a62903da92c492eb78efcda786ee8f3/users/9aac4222fdd442599675535860e5f5ee/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:33.043021 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13529170-ecbb-4987-9cd7-c54992ff0de9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:33.043258 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13529170-ecbb-4987-9cd7-c54992ff0de9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:33.043545 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13529170-ecbb-4987-9cd7-c54992ff0de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:33.070987 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-13529170-ecbb-4987-9cd7-c54992ff0de9 None None] MFA Rules not processed for user `9aac4222fdd442599675535860e5f5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:33.072217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-13529170-ecbb-4987-9cd7-c54992ff0de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:33.129031 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:33.138252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1362/2725] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:33.140776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbd1b0-3b16-4f35-8df1-4828f6ac9584 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:33.201660 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbd1b0-3b16-4f35-8df1-4828f6ac9584 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:33.206255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f05bc5-0a00-4cb6-9543-b6f6b5e99d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:33.206898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f05bc5-0a00-4cb6-9543-b6f6b5e99d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:33.207183 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f05bc5-0a00-4cb6-9543-b6f6b5e99d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:33.207478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f05bc5-0a00-4cb6-9543-b6f6b5e99d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:33.208200 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f05bc5-0a00-4cb6-9543-b6f6b5e99d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:33.210132 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f05bc5-0a00-4cb6-9543-b6f6b5e99d2b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:33.234329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1364/2726] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:33 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:33.238329 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13529170-ecbb-4987-9cd7-c54992ff0de9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:33.250044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13529170-ecbb-4987-9cd7-c54992ff0de9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:33.306594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0638f6-4ab0-49ea-bfe1-dc3acd3c4af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:33.307194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0638f6-4ab0-49ea-bfe1-dc3acd3c4af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:33.307485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0638f6-4ab0-49ea-bfe1-dc3acd3c4af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:33.307768 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0638f6-4ab0-49ea-bfe1-dc3acd3c4af8 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:33.308505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0638f6-4ab0-49ea-bfe1-dc3acd3c4af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:33.310444 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0638f6-4ab0-49ea-bfe1-dc3acd3c4af8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:33.330287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1363/2727] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:33 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:33.334274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f05bc5-0a00-4cb6-9543-b6f6b5e99d2b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:33.344478 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f05bc5-0a00-4cb6-9543-b6f6b5e99d2b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:33.349326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c0ac5-d721-4e28-9ecf-2c8ce7c48333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:33.350013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c0ac5-d721-4e28-9ecf-2c8ce7c48333 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:33.350341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c0ac5-d721-4e28-9ecf-2c8ce7c48333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:33.351120 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c0ac5-d721-4e28-9ecf-2c8ce7c48333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:33.351852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c0ac5-d721-4e28-9ecf-2c8ce7c48333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:33.353473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c0ac5-d721-4e28-9ecf-2c8ce7c48333 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:33.363967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1365/2728] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:33.368491 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0638f6-4ab0-49ea-bfe1-dc3acd3c4af8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:33.378264 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0638f6-4ab0-49ea-bfe1-dc3acd3c4af8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:33.382877 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa68cf-e0ee-4928-86e2-448ec673d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:33.383745 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa68cf-e0ee-4928-86e2-448ec673d645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:33.384057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa68cf-e0ee-4928-86e2-448ec673d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:33.384345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa68cf-e0ee-4928-86e2-448ec673d645 admin admin] PATH_INFO: `/v3/projects/0a8de8f8544d4b1fa86bba64a20ff57e/users/7ac0255f92f64087b75cec1d039d6c5f/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:33.398941 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa68cf-e0ee-4928-86e2-448ec673d645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8de8f8544d4b1fa86bba64a20ff57e, user_id=7ac0255f92f64087b75cec1d039d6c5f, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:33.401676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa68cf-e0ee-4928-86e2-448ec673d645 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:33.414847 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1364/2729] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:33 2022] PUT /identity/v3/projects/0a8de8f8544d4b1fa86bba64a20ff57e/users/7ac0255f92f64087b75cec1d039d6c5f/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:33.418802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c0ac5-d721-4e28-9ecf-2c8ce7c48333 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:33.428842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c0ac5-d721-4e28-9ecf-2c8ce7c48333 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:33.467302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:33.487231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfac7e5-4e78-4e30-8bc2-cb0c424e71b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:33.487924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac7e5-4e78-4e30-8bc2-cb0c424e71b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:33.488241 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac7e5-4e78-4e30-8bc2-cb0c424e71b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:33.488520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfac7e5-4e78-4e30-8bc2-cb0c424e71b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:33.489237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfac7e5-4e78-4e30-8bc2-cb0c424e71b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:33.490836 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfac7e5-4e78-4e30-8bc2-cb0c424e71b3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:33.500863 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1366/2730] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:33.504819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa68cf-e0ee-4928-86e2-448ec673d645 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:33.515757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa68cf-e0ee-4928-86e2-448ec673d645 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:33.520320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b34979-da9c-4802-b525-16599bcd6ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:33.521228 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b34979-da9c-4802-b525-16599bcd6ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:33.521510 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b34979-da9c-4802-b525-16599bcd6ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:33.521820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b34979-da9c-4802-b525-16599bcd6ff0 admin admin] PATH_INFO: `/v3/projects/0a8de8f8544d4b1fa86bba64a20ff57e/users/7ac0255f92f64087b75cec1d039d6c5f/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:33.524363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b34979-da9c-4802-b525-16599bcd6ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8de8f8544d4b1fa86bba64a20ff57e, user_id=7ac0255f92f64087b75cec1d039d6c5f, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:33.526998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b34979-da9c-4802-b525-16599bcd6ff0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:33.537163 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1365/2731] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:33 2022] PUT /identity/v3/projects/0a8de8f8544d4b1fa86bba64a20ff57e/users/7ac0255f92f64087b75cec1d039d6c5f/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:33.547028 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d7682-e2d0-4fda-8b70-0a7516a225ad None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:33.547321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d7682-e2d0-4fda-8b70-0a7516a225ad None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:33.547602 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d7682-e2d0-4fda-8b70-0a7516a225ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:33.574201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-833d7682-e2d0-4fda-8b70-0a7516a225ad None None] MFA Rules not processed for user `7ac0255f92f64087b75cec1d039d6c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:33.575381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-833d7682-e2d0-4fda-8b70-0a7516a225ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:33.644303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1367/2732] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:33.655334 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b34979-da9c-4802-b525-16599bcd6ff0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:33.657110 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-48b34979-da9c-4802-b525-16599bcd6ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:33.713387 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b34979-da9c-4802-b525-16599bcd6ff0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:33.717015 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed36e8-b4d8-4051-b3d6-feededa3b254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:33.717653 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed36e8-b4d8-4051-b3d6-feededa3b254 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:33.717938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed36e8-b4d8-4051-b3d6-feededa3b254 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:33.718217 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed36e8-b4d8-4051-b3d6-feededa3b254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:33.727062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed36e8-b4d8-4051-b3d6-feededa3b254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:33.728517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed36e8-b4d8-4051-b3d6-feededa3b254 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:33.737771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1366/2733] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:33.807043 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d7682-e2d0-4fda-8b70-0a7516a225ad None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:33.816872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d7682-e2d0-4fda-8b70-0a7516a225ad None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:33.821106 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1be30-5fd1-4f3c-b270-fac968106fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:33.821751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1be30-5fd1-4f3c-b270-fac968106fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:33.822040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1be30-5fd1-4f3c-b270-fac968106fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:33.822328 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1be30-5fd1-4f3c-b270-fac968106fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:33.878792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1be30-5fd1-4f3c-b270-fac968106fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:33.880284 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1be30-5fd1-4f3c-b270-fac968106fa1 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:33.890607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1368/2734] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:34.147191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed36e8-b4d8-4051-b3d6-feededa3b254 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:34.198204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:34.210223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed36e8-b4d8-4051-b3d6-feededa3b254 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:34.214719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:34.215578 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:34.215864 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:34.216176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] PATH_INFO: `/v3/users/9aac4222fdd442599675535860e5f5ee` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:34.217349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aac4222fdd442599675535860e5f5ee)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:34.219251 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:34.265796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aac4222fdd442599675535860e5f5ee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.278555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aac4222fdd442599675535860e5f5ee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.285822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aac4222fdd442599675535860e5f5ee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.286466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aac4222fdd442599675535860e5f5ee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.293851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aac4222fdd442599675535860e5f5ee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.299670 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1367/2735] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:34 2022] DELETE /identity/v3/users/9aac4222fdd442599675535860e5f5ee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:34.304819 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef994-3893-4db3-a9eb-233de4d73cbd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:34.305276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef994-3893-4db3-a9eb-233de4d73cbd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:34.305417 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef994-3893-4db3-a9eb-233de4d73cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:34.322040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-008ef994-3893-4db3-a9eb-233de4d73cbd None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:34.323303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-008ef994-3893-4db3-a9eb-233de4d73cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:34.373761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:34.382647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1369/2736] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:34.392516 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:34.393909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:34.451118 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0de48-24aa-49fd-8257-d4e5b8419b03 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:34.454776 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc244d7-64fb-4ada-98dd-3b6c21b1fd96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:34.455415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc244d7-64fb-4ada-98dd-3b6c21b1fd96 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:34.455704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc244d7-64fb-4ada-98dd-3b6c21b1fd96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:34.455993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc244d7-64fb-4ada-98dd-3b6c21b1fd96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:34.465757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc244d7-64fb-4ada-98dd-3b6c21b1fd96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:34.467186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc244d7-64fb-4ada-98dd-3b6c21b1fd96 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:34.477536 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1368/2737] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:34.745668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef994-3893-4db3-a9eb-233de4d73cbd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:34.747191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-008ef994-3893-4db3-a9eb-233de4d73cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:34.759667 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef994-3893-4db3-a9eb-233de4d73cbd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:34.764776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:34.765640 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:34.765920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:34.766194 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] PATH_INFO: `/v3/projects/7a62903da92c492eb78efcda786ee8f3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:34.767376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a62903da92c492eb78efcda786ee8f3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:34.769321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:34.816850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a62903da92c492eb78efcda786ee8f3', 'request_id': 'req-2b3d2d9e-9544-4028-9249-1d4da813be26'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.822973 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a62903da92c492eb78efcda786ee8f3', 'request_id': 'req-2b3d2d9e-9544-4028-9249-1d4da813be26'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.828459 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a62903da92c492eb78efcda786ee8f3', 'request_id': 'req-2b3d2d9e-9544-4028-9249-1d4da813be26'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.841008 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] The token cache is being invalidate because project 7a62903da92c492eb78efcda786ee8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:34.841311 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.841906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.843430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1370/2738] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:34 2022] DELETE /identity/v3/projects/7a62903da92c492eb78efcda786ee8f3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:34.847382 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc244d7-64fb-4ada-98dd-3b6c21b1fd96 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:34.857737 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc244d7-64fb-4ada-98dd-3b6c21b1fd96 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:34.913860 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bb847-8dd2-4745-9a9d-404e03a811b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:34.914717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bb847-8dd2-4745-9a9d-404e03a811b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:34.914997 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bb847-8dd2-4745-9a9d-404e03a811b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:34.915268 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bb847-8dd2-4745-9a9d-404e03a811b8 admin admin] PATH_INFO: `/v3/users/7ac0255f92f64087b75cec1d039d6c5f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:34.916461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bb847-8dd2-4745-9a9d-404e03a811b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac0255f92f64087b75cec1d039d6c5f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:34.918403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bb847-8dd2-4745-9a9d-404e03a811b8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:34.934279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:34.965316 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b09bb847-8dd2-4745-9a9d-404e03a811b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac0255f92f64087b75cec1d039d6c5f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.978296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b09bb847-8dd2-4745-9a9d-404e03a811b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac0255f92f64087b75cec1d039d6c5f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.987602 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b09bb847-8dd2-4745-9a9d-404e03a811b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac0255f92f64087b75cec1d039d6c5f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.988292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b09bb847-8dd2-4745-9a9d-404e03a811b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac0255f92f64087b75cec1d039d6c5f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:34.996427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b09bb847-8dd2-4745-9a9d-404e03a811b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac0255f92f64087b75cec1d039d6c5f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:35.002603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1369/2739] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:34 2022] DELETE /identity/v3/users/7ac0255f92f64087b75cec1d039d6c5f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:35.293193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:35.294716 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:35.309247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d2d9e-9544-4028-9249-1d4da813be26 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:35.371772 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:35.372664 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:35.372949 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:35.373227 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] PATH_INFO: `/v3/projects/0a8de8f8544d4b1fa86bba64a20ff57e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:35.374413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8de8f8544d4b1fa86bba64a20ff57e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:35.376448 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:35.426053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8de8f8544d4b1fa86bba64a20ff57e', 'request_id': 'req-6edb08c3-3945-423c-9d9b-ce7ce372656b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:35.432182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8de8f8544d4b1fa86bba64a20ff57e', 'request_id': 'req-6edb08c3-3945-423c-9d9b-ce7ce372656b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:35.437759 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8de8f8544d4b1fa86bba64a20ff57e', 'request_id': 'req-6edb08c3-3945-423c-9d9b-ce7ce372656b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:35.449828 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] The token cache is being invalidate because project 0a8de8f8544d4b1fa86bba64a20ff57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:35.450281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:35.450908 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6edb08c3-3945-423c-9d9b-ce7ce372656b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:35.452506 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1371/2740] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:35 2022] DELETE /identity/v3/projects/0a8de8f8544d4b1fa86bba64a20ff57e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:35.457365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa502921-651e-4ff1-ab4a-36d8e54aafff None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:35.457658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa502921-651e-4ff1-ab4a-36d8e54aafff None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:35.457938 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa502921-651e-4ff1-ab4a-36d8e54aafff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:35.478008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fa502921-651e-4ff1-ab4a-36d8e54aafff None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:35.479196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fa502921-651e-4ff1-ab4a-36d8e54aafff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:35.537628 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1370/2741] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:35.545604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1924a3-5644-40b7-ac78-a4d0da0b4e2b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:35.545898 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1924a3-5644-40b7-ac78-a4d0da0b4e2b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:35.546181 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1924a3-5644-40b7-ac78-a4d0da0b4e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:35.565167 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bb1924a3-5644-40b7-ac78-a4d0da0b4e2b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:35.566373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bb1924a3-5644-40b7-ac78-a4d0da0b4e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:35.574734 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1372/2742] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:31:35.578831 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa502921-651e-4ff1-ab4a-36d8e54aafff None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:35.589074 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa502921-651e-4ff1-ab4a-36d8e54aafff None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:35.593692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46ffb5-c069-45ca-b5b4-9cc68c12be19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:35.594357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46ffb5-c069-45ca-b5b4-9cc68c12be19 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:35.594625 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46ffb5-c069-45ca-b5b4-9cc68c12be19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:35.594906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46ffb5-c069-45ca-b5b4-9cc68c12be19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:35.595630 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46ffb5-c069-45ca-b5b4-9cc68c12be19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:31:35.595939 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46ffb5-c069-45ca-b5b4-9cc68c12be19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:35.597639 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46ffb5-c069-45ca-b5b4-9cc68c12be19 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:35.610047 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1371/2743] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:31:35.614392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1924a3-5644-40b7-ac78-a4d0da0b4e2b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:35.623495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1924a3-5644-40b7-ac78-a4d0da0b4e2b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:35.628113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c4c2f-c76e-4996-9127-bfa2a4b74747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:35.628756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4c2f-c76e-4996-9127-bfa2a4b74747 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:35.629040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4c2f-c76e-4996-9127-bfa2a4b74747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:35.629333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c4c2f-c76e-4996-9127-bfa2a4b74747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:35.630004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c4c2f-c76e-4996-9127-bfa2a4b74747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:35.632426 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c4c2f-c76e-4996-9127-bfa2a4b74747 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:35.635555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:35.659903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1373/2744] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:35 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:35.664065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46ffb5-c069-45ca-b5b4-9cc68c12be19 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:35.673925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46ffb5-c069-45ca-b5b4-9cc68c12be19 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:35.729146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbebb78-fd6c-4425-8fed-da5207374a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:35.729741 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbebb78-fd6c-4425-8fed-da5207374a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:35.730035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbebb78-fd6c-4425-8fed-da5207374a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:35.730314 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbebb78-fd6c-4425-8fed-da5207374a69 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:35.731007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbebb78-fd6c-4425-8fed-da5207374a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:35.732974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbebb78-fd6c-4425-8fed-da5207374a69 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:35.752052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1372/2745] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:35 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:35.756305 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c4c2f-c76e-4996-9127-bfa2a4b74747 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:35.767277 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c4c2f-c76e-4996-9127-bfa2a4b74747 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:35.771802 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b24f3a-136d-415b-b044-aa22a0429a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:35.773096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24f3a-136d-415b-b044-aa22a0429a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:35.773380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24f3a-136d-415b-b044-aa22a0429a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:35.773653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24f3a-136d-415b-b044-aa22a0429a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:35.774401 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b24f3a-136d-415b-b044-aa22a0429a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:35.775990 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b24f3a-136d-415b-b044-aa22a0429a33 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:35.786943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1374/2746] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:35.790975 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbebb78-fd6c-4425-8fed-da5207374a69 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:35.801282 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbebb78-fd6c-4425-8fed-da5207374a69 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:35.806016 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5439ea0-2c1f-4ee5-8686-2b766c148427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:35.807139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5439ea0-2c1f-4ee5-8686-2b766c148427 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:35.807139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5439ea0-2c1f-4ee5-8686-2b766c148427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:35.807348 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5439ea0-2c1f-4ee5-8686-2b766c148427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:35.808117 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5439ea0-2c1f-4ee5-8686-2b766c148427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:35.809761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5439ea0-2c1f-4ee5-8686-2b766c148427 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:35.815728 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:35.822703 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1373/2747] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:35.826809 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b24f3a-136d-415b-b044-aa22a0429a33 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:35.838303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b24f3a-136d-415b-b044-aa22a0429a33 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:35.843353 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3648d-f6ec-46eb-9d41-18f2ff75f429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:35.844192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3648d-f6ec-46eb-9d41-18f2ff75f429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:35.844479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3648d-f6ec-46eb-9d41-18f2ff75f429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:35.844776 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3648d-f6ec-46eb-9d41-18f2ff75f429 admin admin] PATH_INFO: `/v3/projects/3b09c75ca6014fc58b380ffc796ddc0d/users/8e485052f84a4257a353610afd08f798/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:35.861040 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3648d-f6ec-46eb-9d41-18f2ff75f429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b09c75ca6014fc58b380ffc796ddc0d, user_id=8e485052f84a4257a353610afd08f798, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:35.863708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3648d-f6ec-46eb-9d41-18f2ff75f429 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:35.877430 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1375/2748] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:35 2022] PUT /identity/v3/projects/3b09c75ca6014fc58b380ffc796ddc0d/users/8e485052f84a4257a353610afd08f798/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:35.943562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e2aa4-a469-415d-b27c-743973280308 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:35.944143 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e2aa4-a469-415d-b27c-743973280308 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:35.944902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e2aa4-a469-415d-b27c-743973280308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:35.971065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7e8e2aa4-a469-415d-b27c-743973280308 None None] MFA Rules not processed for user `8e485052f84a4257a353610afd08f798`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:35.972423 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7e8e2aa4-a469-415d-b27c-743973280308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:36.038789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1374/2749] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:36.050009 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3648d-f6ec-46eb-9d41-18f2ff75f429 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:36.051710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d4f3648d-f6ec-46eb-9d41-18f2ff75f429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:36.108345 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3648d-f6ec-46eb-9d41-18f2ff75f429 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:36.111943 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073024f-48fa-42aa-993e-beee633be84e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:36.112631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073024f-48fa-42aa-993e-beee633be84e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:36.112914 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073024f-48fa-42aa-993e-beee633be84e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:36.113188 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073024f-48fa-42aa-993e-beee633be84e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:36.122103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073024f-48fa-42aa-993e-beee633be84e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:36.123559 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073024f-48fa-42aa-993e-beee633be84e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:36.138657 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1376/2750] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:36.180336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e2aa4-a469-415d-b27c-743973280308 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:36.248740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e2aa4-a469-415d-b27c-743973280308 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:36.254146 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:36.255320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:36.255664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:36.255950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] PATH_INFO: `/v3/users/8e485052f84a4257a353610afd08f798` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:36.257364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e485052f84a4257a353610afd08f798)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:36.259308 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:36.318903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e485052f84a4257a353610afd08f798'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:36.331867 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e485052f84a4257a353610afd08f798'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:36.341300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e485052f84a4257a353610afd08f798'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:36.341919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e485052f84a4257a353610afd08f798'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:36.349590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e485052f84a4257a353610afd08f798'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:36.356583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1375/2751] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:36 2022] DELETE /identity/v3/users/8e485052f84a4257a353610afd08f798 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:36.360868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61df9b-186b-423e-9c8b-ef01f52cbe16 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:36.361356 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61df9b-186b-423e-9c8b-ef01f52cbe16 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:36.361609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61df9b-186b-423e-9c8b-ef01f52cbe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:36.378458 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2c61df9b-186b-423e-9c8b-ef01f52cbe16 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:36.379711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2c61df9b-186b-423e-9c8b-ef01f52cbe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:36.441704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1377/2752] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 12:31:36.452279 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:36.453769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:36.465726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:36.517336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77ffdb-3ddd-4664-904a-140936af438f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:36.521109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906e091-1096-43e0-bafa-db5f764022fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:36.521758 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906e091-1096-43e0-bafa-db5f764022fa service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:36.522045 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906e091-1096-43e0-bafa-db5f764022fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:36.522354 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906e091-1096-43e0-bafa-db5f764022fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:36.532625 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906e091-1096-43e0-bafa-db5f764022fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:36.534127 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906e091-1096-43e0-bafa-db5f764022fa service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:36.544517 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1376/2753] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:36.808681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61df9b-186b-423e-9c8b-ef01f52cbe16 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:36.810465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2c61df9b-186b-423e-9c8b-ef01f52cbe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:36.823192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61df9b-186b-423e-9c8b-ef01f52cbe16 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:36.827902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:36.828814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:36.829147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:36.829373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] PATH_INFO: `/v3/projects/3b09c75ca6014fc58b380ffc796ddc0d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:36.830587 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b09c75ca6014fc58b380ffc796ddc0d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:36.832563 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:36.879020 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:36.880279 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b09c75ca6014fc58b380ffc796ddc0d', 'request_id': 'req-4b245d30-083c-4e07-9563-514bffa549f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:36.888654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b09c75ca6014fc58b380ffc796ddc0d', 'request_id': 'req-4b245d30-083c-4e07-9563-514bffa549f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:36.894337 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b09c75ca6014fc58b380ffc796ddc0d', 'request_id': 'req-4b245d30-083c-4e07-9563-514bffa549f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:36.907692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] The token cache is being invalidate because project 3b09c75ca6014fc58b380ffc796ddc0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:36.907980 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:36.908654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4b245d30-083c-4e07-9563-514bffa549f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:36.910221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1378/2754] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:36 2022] DELETE /identity/v3/projects/3b09c75ca6014fc58b380ffc796ddc0d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:36.915835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f464b1-3b3e-4b22-984c-fce204f55251 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:36.916162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f464b1-3b3e-4b22-984c-fce204f55251 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:36.916449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f464b1-3b3e-4b22-984c-fce204f55251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:36.933512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b5f464b1-3b3e-4b22-984c-fce204f55251 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:36.934717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b5f464b1-3b3e-4b22-984c-fce204f55251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:36.994631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1377/2755] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:37.002372 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968bb24-c258-486e-8a0d-d87e7a1ec0d9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:37.002695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968bb24-c258-486e-8a0d-d87e7a1ec0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:37.002981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968bb24-c258-486e-8a0d-d87e7a1ec0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:37.021860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d968bb24-c258-486e-8a0d-d87e7a1ec0d9 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:37.023708 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d968bb24-c258-486e-8a0d-d87e7a1ec0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:37.031453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1379/2756] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:37.035467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f464b1-3b3e-4b22-984c-fce204f55251 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:37.045306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f464b1-3b3e-4b22-984c-fce204f55251 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:37.049903 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76075447-7ac9-4f23-8ddb-a274e863004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:37.050554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76075447-7ac9-4f23-8ddb-a274e863004a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:37.050843 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76075447-7ac9-4f23-8ddb-a274e863004a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:37.051128 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76075447-7ac9-4f23-8ddb-a274e863004a admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:37.051914 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76075447-7ac9-4f23-8ddb-a274e863004a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:31:37.052209 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76075447-7ac9-4f23-8ddb-a274e863004a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:37.053810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76075447-7ac9-4f23-8ddb-a274e863004a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:37.065295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1378/2757] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:31:37.069955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968bb24-c258-486e-8a0d-d87e7a1ec0d9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:37.079024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968bb24-c258-486e-8a0d-d87e7a1ec0d9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:37.083669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c7e66-598c-447c-b62b-3c248a2f9fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:37.084348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c7e66-598c-447c-b62b-3c248a2f9fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:37.084637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c7e66-598c-447c-b62b-3c248a2f9fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:37.085532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c7e66-598c-447c-b62b-3c248a2f9fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:37.086224 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c7e66-598c-447c-b62b-3c248a2f9fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:37.088168 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c7e66-598c-447c-b62b-3c248a2f9fd8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:37.113259 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1380/2758] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:37 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:37.117242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76075447-7ac9-4f23-8ddb-a274e863004a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:37.127067 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76075447-7ac9-4f23-8ddb-a274e863004a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:37.182796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48488f7e-fc93-46c2-a0ff-472c621140d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:37.183452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488f7e-fc93-46c2-a0ff-472c621140d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:37.183735 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488f7e-fc93-46c2-a0ff-472c621140d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:37.184010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488f7e-fc93-46c2-a0ff-472c621140d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:37.184726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48488f7e-fc93-46c2-a0ff-472c621140d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:37.186645 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48488f7e-fc93-46c2-a0ff-472c621140d1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:37.206002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1379/2759] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:37 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:37.210704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c7e66-598c-447c-b62b-3c248a2f9fd8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:37.220959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c7e66-598c-447c-b62b-3c248a2f9fd8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:37.225617 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd566f44-14b8-4456-be7f-9525f5bb2be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:37.226255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd566f44-14b8-4456-be7f-9525f5bb2be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:37.226543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd566f44-14b8-4456-be7f-9525f5bb2be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:37.226843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd566f44-14b8-4456-be7f-9525f5bb2be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:37.227555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd566f44-14b8-4456-be7f-9525f5bb2be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:37.229184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd566f44-14b8-4456-be7f-9525f5bb2be8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:37.239420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1381/2760] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 12:31:37.243457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48488f7e-fc93-46c2-a0ff-472c621140d1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:37.253266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48488f7e-fc93-46c2-a0ff-472c621140d1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:37.258414 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586dcef-2a11-4346-bd04-3ee3fff86ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:37.259056 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586dcef-2a11-4346-bd04-3ee3fff86ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:37.259341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586dcef-2a11-4346-bd04-3ee3fff86ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:37.259619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586dcef-2a11-4346-bd04-3ee3fff86ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:37.260408 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586dcef-2a11-4346-bd04-3ee3fff86ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:37.261995 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586dcef-2a11-4346-bd04-3ee3fff86ff7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:37.272094 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1380/2761] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:37.276423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd566f44-14b8-4456-be7f-9525f5bb2be8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:37.286215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd566f44-14b8-4456-be7f-9525f5bb2be8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:37.291005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0763299-4921-4701-9e52-741a7eb32bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:37.291796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0763299-4921-4701-9e52-741a7eb32bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:37.292118 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0763299-4921-4701-9e52-741a7eb32bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:37.292400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0763299-4921-4701-9e52-741a7eb32bbe admin admin] PATH_INFO: `/v3/projects/2fb5c7c2a1b24ae88202e779891a8b7d/users/404a4513e82d4fc2bbd9358443e939ca/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:37.307206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0763299-4921-4701-9e52-741a7eb32bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb5c7c2a1b24ae88202e779891a8b7d, user_id=404a4513e82d4fc2bbd9358443e939ca, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:37.309940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0763299-4921-4701-9e52-741a7eb32bbe admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:37.324673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1382/2762] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:37 2022] PUT /identity/v3/projects/2fb5c7c2a1b24ae88202e779891a8b7d/users/404a4513e82d4fc2bbd9358443e939ca/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:37.334940 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de3c6-d1b4-4cf5-ae1a-a4ac86711ebd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:37.335733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de3c6-d1b4-4cf5-ae1a-a4ac86711ebd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:37.336029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de3c6-d1b4-4cf5-ae1a-a4ac86711ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:37.362783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d69de3c6-d1b4-4cf5-ae1a-a4ac86711ebd None None] MFA Rules not processed for user `404a4513e82d4fc2bbd9358443e939ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:37.364068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d69de3c6-d1b4-4cf5-ae1a-a4ac86711ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:37.370168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:37.433611 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1381/2763] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:37.445658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0763299-4921-4701-9e52-741a7eb32bbe admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:37.447355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a0763299-4921-4701-9e52-741a7eb32bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:37.505103 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0763299-4921-4701-9e52-741a7eb32bbe admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:37.509498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f58ab-e447-43f6-b6e2-8101c2c28af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:37.510177 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f58ab-e447-43f6-b6e2-8101c2c28af0 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:37.510464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f58ab-e447-43f6-b6e2-8101c2c28af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:37.510746 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f58ab-e447-43f6-b6e2-8101c2c28af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:37.519471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f58ab-e447-43f6-b6e2-8101c2c28af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:37.520962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f58ab-e447-43f6-b6e2-8101c2c28af0 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:37.530034 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1383/2764] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:39.564532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69de3c6-d1b4-4cf5-ae1a-a4ac86711ebd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:39.565946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d69de3c6-d1b4-4cf5-ae1a-a4ac86711ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:39.631216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69de3c6-d1b4-4cf5-ae1a-a4ac86711ebd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:39.635890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:39.636791 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:39.637103 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:39.637385 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] PATH_INFO: `/v3/users/4937eaa419b748ba9d8c6ba186f22c44` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:39.638822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4937eaa419b748ba9d8c6ba186f22c44)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:39.640788 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:39.687781 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4937eaa419b748ba9d8c6ba186f22c44'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:39.699509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4937eaa419b748ba9d8c6ba186f22c44'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:39.706583 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4937eaa419b748ba9d8c6ba186f22c44'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:39.707216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4937eaa419b748ba9d8c6ba186f22c44'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:39.714766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4937eaa419b748ba9d8c6ba186f22c44'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:39.720594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1382/2765] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:39 2022] DELETE /identity/v3/users/4937eaa419b748ba9d8c6ba186f22c44 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:39.725068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b94102-067d-4c29-942a-e533f8132987 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:39.725601 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b94102-067d-4c29-942a-e533f8132987 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:39.725704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b94102-067d-4c29-942a-e533f8132987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:39.742191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-13b94102-067d-4c29-942a-e533f8132987 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:39.743877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-13b94102-067d-4c29-942a-e533f8132987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:39.801170 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1384/2766] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:39.811139 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:39.812584 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:39.843892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:39.871344 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fd8d3-a9dd-444f-b248-72fbb9dba659 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:39.875143 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f1483-dfd4-47e4-b50f-83915bf0da74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:39.875777 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f1483-dfd4-47e4-b50f-83915bf0da74 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:39.876091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f1483-dfd4-47e4-b50f-83915bf0da74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:39.876371 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f1483-dfd4-47e4-b50f-83915bf0da74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:39.885916 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f1483-dfd4-47e4-b50f-83915bf0da74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:39.887336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f1483-dfd4-47e4-b50f-83915bf0da74 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:39.896926 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1383/2767] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:40.158822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b94102-067d-4c29-942a-e533f8132987 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:40.160643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-13b94102-067d-4c29-942a-e533f8132987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:40.173806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b94102-067d-4c29-942a-e533f8132987 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:40.178824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:40.179698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:40.180060 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:40.180927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] PATH_INFO: `/v3/projects/d23fe3aecd0b4bba9f559799646bd143` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:40.182182 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23fe3aecd0b4bba9f559799646bd143)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:40.184240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:40.196485 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:40.235121 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23fe3aecd0b4bba9f559799646bd143', 'request_id': 'req-0b2413c3-5450-49df-8852-44de7aeb9139'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:40.241333 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23fe3aecd0b4bba9f559799646bd143', 'request_id': 'req-0b2413c3-5450-49df-8852-44de7aeb9139'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:40.247373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23fe3aecd0b4bba9f559799646bd143', 'request_id': 'req-0b2413c3-5450-49df-8852-44de7aeb9139'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:40.259665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] The token cache is being invalidate because project d23fe3aecd0b4bba9f559799646bd143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:40.259955 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:40.260620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b2413c3-5450-49df-8852-44de7aeb9139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:40.262201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1385/2768] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:40 2022] DELETE /identity/v3/projects/d23fe3aecd0b4bba9f559799646bd143 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 12:31:40.267378 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4b3af-393c-4b1b-a347-175ffbb86f5c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:40.267673 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4b3af-393c-4b1b-a347-175ffbb86f5c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:40.267954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4b3af-393c-4b1b-a347-175ffbb86f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:40.285260 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-aef4b3af-393c-4b1b-a347-175ffbb86f5c None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:40.286461 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-aef4b3af-393c-4b1b-a347-175ffbb86f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:40.344692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1384/2769] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:40.353781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b289e31-9140-4c26-9010-590c5a5b500f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:40.354073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b289e31-9140-4c26-9010-590c5a5b500f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:40.354355 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b289e31-9140-4c26-9010-590c5a5b500f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:40.373096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2b289e31-9140-4c26-9010-590c5a5b500f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:40.374290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2b289e31-9140-4c26-9010-590c5a5b500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:40.382039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1386/2770] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:40.386272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4b3af-393c-4b1b-a347-175ffbb86f5c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:40.396282 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4b3af-393c-4b1b-a347-175ffbb86f5c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:40.401399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd698d2-9f46-4209-9b72-dfacf4d220cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:40.402046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd698d2-9f46-4209-9b72-dfacf4d220cd admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:40.402335 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd698d2-9f46-4209-9b72-dfacf4d220cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:40.402615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd698d2-9f46-4209-9b72-dfacf4d220cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:40.403346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd698d2-9f46-4209-9b72-dfacf4d220cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 12:31:40.403658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd698d2-9f46-4209-9b72-dfacf4d220cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:40.405312 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd698d2-9f46-4209-9b72-dfacf4d220cd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:40.417340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1385/2771] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 12:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 12:31:40.421389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b289e31-9140-4c26-9010-590c5a5b500f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:40.430486 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b289e31-9140-4c26-9010-590c5a5b500f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:40.435063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa15b8-7e3a-4988-b453-b1ebdd938b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:40.435711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa15b8-7e3a-4988-b453-b1ebdd938b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:40.435994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa15b8-7e3a-4988-b453-b1ebdd938b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:40.436303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa15b8-7e3a-4988-b453-b1ebdd938b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:40.436985 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa15b8-7e3a-4988-b453-b1ebdd938b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:40.438910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa15b8-7e3a-4988-b453-b1ebdd938b69 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:40.464532 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1387/2772] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 12:31:40 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 12:31:40.468505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd698d2-9f46-4209-9b72-dfacf4d220cd admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:40.478983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd698d2-9f46-4209-9b72-dfacf4d220cd admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:40.535320 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc8ee-8af4-4553-bcc5-4036a2be9906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:40.535980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc8ee-8af4-4553-bcc5-4036a2be9906 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:40.536307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc8ee-8af4-4553-bcc5-4036a2be9906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:40.536589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc8ee-8af4-4553-bcc5-4036a2be9906 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:40.537278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cc8ee-8af4-4553-bcc5-4036a2be9906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:40.539208 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cc8ee-8af4-4553-bcc5-4036a2be9906 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:40.558189 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1386/2773] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 12:31:40 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 12:31:40.562248 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa15b8-7e3a-4988-b453-b1ebdd938b69 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:40.572403 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa15b8-7e3a-4988-b453-b1ebdd938b69 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:40.576942 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6741211-3f71-4bc1-b529-fd9f443504ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:40.577593 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6741211-3f71-4bc1-b529-fd9f443504ff admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:40.577879 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6741211-3f71-4bc1-b529-fd9f443504ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:40.578158 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6741211-3f71-4bc1-b529-fd9f443504ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:40.578918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6741211-3f71-4bc1-b529-fd9f443504ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:40.580539 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6741211-3f71-4bc1-b529-fd9f443504ff admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:40.591389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1388/2774] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:40.594966 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc8ee-8af4-4553-bcc5-4036a2be9906 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:40.605346 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc8ee-8af4-4553-bcc5-4036a2be9906 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:40.610772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483f68d-f56a-4798-b037-ba5b87f53cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:40.611457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483f68d-f56a-4798-b037-ba5b87f53cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:40.611743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483f68d-f56a-4798-b037-ba5b87f53cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:40.612044 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483f68d-f56a-4798-b037-ba5b87f53cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:40.612780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483f68d-f56a-4798-b037-ba5b87f53cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:40.614360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483f68d-f56a-4798-b037-ba5b87f53cb8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:40.624501 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1387/2775] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 12:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 12:31:40.628648 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6741211-3f71-4bc1-b529-fd9f443504ff admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:40.639138 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6741211-3f71-4bc1-b529-fd9f443504ff admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:40.643786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaec5b-6d97-47bc-9caf-a2a892a23ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:40.644692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaec5b-6d97-47bc-9caf-a2a892a23ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:40.644982 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaec5b-6d97-47bc-9caf-a2a892a23ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:40.645262 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaec5b-6d97-47bc-9caf-a2a892a23ecb admin admin] PATH_INFO: `/v3/projects/cf5a529edc9940039d18b49bd785bcbb/users/ecfa2641a153411f8663f8a9324c3e19/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:40.660249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaec5b-6d97-47bc-9caf-a2a892a23ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5a529edc9940039d18b49bd785bcbb, user_id=ecfa2641a153411f8663f8a9324c3e19, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:40.662891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaec5b-6d97-47bc-9caf-a2a892a23ecb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:40.676104 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1389/2776] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 12:31:40 2022] PUT /identity/v3/projects/cf5a529edc9940039d18b49bd785bcbb/users/ecfa2641a153411f8663f8a9324c3e19/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:40.736384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2d87e-b251-4ee5-bf67-1d8bc8b8b45e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:40.736676 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2d87e-b251-4ee5-bf67-1d8bc8b8b45e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:40.736958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2d87e-b251-4ee5-bf67-1d8bc8b8b45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:40.763749 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bac2d87e-b251-4ee5-bf67-1d8bc8b8b45e None None] MFA Rules not processed for user `ecfa2641a153411f8663f8a9324c3e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:40.765025 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bac2d87e-b251-4ee5-bf67-1d8bc8b8b45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:40.788322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:40.833837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1388/2777] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:40.844185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaec5b-6d97-47bc-9caf-a2a892a23ecb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:40.846018 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c6eaec5b-6d97-47bc-9caf-a2a892a23ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:40.902396 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaec5b-6d97-47bc-9caf-a2a892a23ecb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:40.906061 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee1ba-a36c-4def-a8c1-24483c87a922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:40.906718 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee1ba-a36c-4def-a8c1-24483c87a922 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:40.906988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee1ba-a36c-4def-a8c1-24483c87a922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:40.907267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ee1ba-a36c-4def-a8c1-24483c87a922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:40.916041 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ee1ba-a36c-4def-a8c1-24483c87a922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:40.917488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ee1ba-a36c-4def-a8c1-24483c87a922 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:40.926201 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1390/2778] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:42.269471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dbc65-def2-4929-a50a-01ce52eea7e3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:42.269960 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dbc65-def2-4929-a50a-01ce52eea7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:42.270059 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dbc65-def2-4929-a50a-01ce52eea7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:42.288976 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-758dbc65-def2-4929-a50a-01ce52eea7e3 None None] MFA Rules not processed for user `ecfa2641a153411f8663f8a9324c3e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:42.290192 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-758dbc65-def2-4929-a50a-01ce52eea7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:42.297114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1389/2779] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:43.507941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee1ba-a36c-4def-a8c1-24483c87a922 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:43.509547 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7f0ee1ba-a36c-4def-a8c1-24483c87a922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:43.555902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:43.584921 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ee1ba-a36c-4def-a8c1-24483c87a922 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:43.590451 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278a2f-f493-49fc-aa02-3bc4765cb27f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:43.591090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278a2f-f493-49fc-aa02-3bc4765cb27f service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:43.591373 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278a2f-f493-49fc-aa02-3bc4765cb27f service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:43.591649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278a2f-f493-49fc-aa02-3bc4765cb27f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:43.593404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-68278a2f-f493-49fc-aa02-3bc4765cb27f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:43.605376 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68278a2f-f493-49fc-aa02-3bc4765cb27f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:43.607108 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68278a2f-f493-49fc-aa02-3bc4765cb27f service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:43.618145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1391/2780] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:44.563185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dbc65-def2-4929-a50a-01ce52eea7e3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:44.564652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-758dbc65-def2-4929-a50a-01ce52eea7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:44.635183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dbc65-def2-4929-a50a-01ce52eea7e3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:44.639980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:44.640907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:44.641191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:44.641466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] PATH_INFO: `/v3/users/404a4513e82d4fc2bbd9358443e939ca` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:44.642663 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=404a4513e82d4fc2bbd9358443e939ca)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:44.644616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:44.696519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404a4513e82d4fc2bbd9358443e939ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:44.710028 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404a4513e82d4fc2bbd9358443e939ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:44.718484 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404a4513e82d4fc2bbd9358443e939ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:44.719169 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404a4513e82d4fc2bbd9358443e939ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:44.729027 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404a4513e82d4fc2bbd9358443e939ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:44.735231 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1390/2781] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:31:44 2022] DELETE /identity/v3/users/404a4513e82d4fc2bbd9358443e939ca => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:44.741055 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcd9af-e3bc-42df-bc26-6495aececd47 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:44.741556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcd9af-e3bc-42df-bc26-6495aececd47 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:44.741669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcd9af-e3bc-42df-bc26-6495aececd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:44.759514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0fbcd9af-e3bc-42df-bc26-6495aececd47 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:44.760781 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0fbcd9af-e3bc-42df-bc26-6495aececd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:44.821386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1392/2782] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:44.831407 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:44.832900 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:44.877898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:44.896365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8cee4-a749-4f1d-a651-35a35d0ce8fe admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:44.900688 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b7fc3-c328-4ce0-9b95-3f98f9ef3d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:44.901370 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b7fc3-c328-4ce0-9b95-3f98f9ef3d7c service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:44.901658 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b7fc3-c328-4ce0-9b95-3f98f9ef3d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:44.901939 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b7fc3-c328-4ce0-9b95-3f98f9ef3d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:44.912130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b7fc3-c328-4ce0-9b95-3f98f9ef3d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:44.913603 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b7fc3-c328-4ce0-9b95-3f98f9ef3d7c service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:44.924861 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1391/2783] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:45.322869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcd9af-e3bc-42df-bc26-6495aececd47 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:45.324330 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0fbcd9af-e3bc-42df-bc26-6495aececd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:45.336244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcd9af-e3bc-42df-bc26-6495aececd47 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:45.341256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:45.342352 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:45.342638 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:45.342906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] PATH_INFO: `/v3/projects/2fb5c7c2a1b24ae88202e779891a8b7d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:45.344143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb5c7c2a1b24ae88202e779891a8b7d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:45.346250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:45.400413 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb5c7c2a1b24ae88202e779891a8b7d', 'request_id': 'req-f922ae3c-5f65-4e89-acc6-a41dc909b65f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:45.406913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb5c7c2a1b24ae88202e779891a8b7d', 'request_id': 'req-f922ae3c-5f65-4e89-acc6-a41dc909b65f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:45.413597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb5c7c2a1b24ae88202e779891a8b7d', 'request_id': 'req-f922ae3c-5f65-4e89-acc6-a41dc909b65f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:45.429749 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] The token cache is being invalidate because project 2fb5c7c2a1b24ae88202e779891a8b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:31:45.430743 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:45.431554 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f922ae3c-5f65-4e89-acc6-a41dc909b65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:31:45.440570 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1393/2784] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:31:45 2022] DELETE /identity/v3/projects/2fb5c7c2a1b24ae88202e779891a8b7d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:31:54.621513 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b7fc3-c328-4ce0-9b95-3f98f9ef3d7c service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:54.622922 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b43b7fc3-c328-4ce0-9b95-3f98f9ef3d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:54.683455 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b7fc3-c328-4ce0-9b95-3f98f9ef3d7c service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:54.732220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742a218-042c-4332-a626-2afe4abac2ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:54.732874 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742a218-042c-4332-a626-2afe4abac2ba service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:54.733161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742a218-042c-4332-a626-2afe4abac2ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:54.733442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742a218-042c-4332-a626-2afe4abac2ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:54.735211 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0742a218-042c-4332-a626-2afe4abac2ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:54.796400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742a218-042c-4332-a626-2afe4abac2ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:54.797800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742a218-042c-4332-a626-2afe4abac2ba service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:54.809016 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1392/2785] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:31:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:31:55.425423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:57.300369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f64fb-c8bf-411a-908f-b76a8322d07a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:57.300923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f64fb-c8bf-411a-908f-b76a8322d07a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:57.300923 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f64fb-c8bf-411a-908f-b76a8322d07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:57.319520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-399f64fb-c8bf-411a-908f-b76a8322d07a None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:57.320880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-399f64fb-c8bf-411a-908f-b76a8322d07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:57.376453 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1394/2786] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:31:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:57.422790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742a218-042c-4332-a626-2afe4abac2ba service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:57.424677 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0742a218-042c-4332-a626-2afe4abac2ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:57.488230 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:31:57.508902 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742a218-042c-4332-a626-2afe4abac2ba service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:57.515065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f783a3-36ca-48c4-b727-e29190f95898 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:57.515714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f783a3-36ca-48c4-b727-e29190f95898 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:57.516001 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f783a3-36ca-48c4-b727-e29190f95898 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:57.516315 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f783a3-36ca-48c4-b727-e29190f95898 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:57.527059 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f783a3-36ca-48c4-b727-e29190f95898 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:57.528740 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f783a3-36ca-48c4-b727-e29190f95898 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:57.537185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1393/2787] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:31:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:31:58.070095 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44837cc-6655-4cf8-9df0-9a53d10584fc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:58.070389 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44837cc-6655-4cf8-9df0-9a53d10584fc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:58.070676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44837cc-6655-4cf8-9df0-9a53d10584fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:58.089402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a44837cc-6655-4cf8-9df0-9a53d10584fc None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:58.090616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a44837cc-6655-4cf8-9df0-9a53d10584fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:58.097815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1395/2788] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 12:31:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:58.110224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f783a3-36ca-48c4-b727-e29190f95898 service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:58.121495 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f783a3-36ca-48c4-b727-e29190f95898 service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:58.126540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad8174-63ad-4696-81ba-3ddbf91bcec1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:58.127172 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad8174-63ad-4696-81ba-3ddbf91bcec1 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:58.127462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad8174-63ad-4696-81ba-3ddbf91bcec1 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:58.127774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad8174-63ad-4696-81ba-3ddbf91bcec1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:58.136592 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad8174-63ad-4696-81ba-3ddbf91bcec1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:58.138481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad8174-63ad-4696-81ba-3ddbf91bcec1 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:58.146761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1394/2789] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:31:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:31:58.332838 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ea6fa-49c3-4c8b-b108-5f523cef74af None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:58.333321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ea6fa-49c3-4c8b-b108-5f523cef74af None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:58.333442 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ea6fa-49c3-4c8b-b108-5f523cef74af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:58.351698 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e83ea6fa-49c3-4c8b-b108-5f523cef74af None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:58.352926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e83ea6fa-49c3-4c8b-b108-5f523cef74af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:58.359940 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1396/2790] 10.222.0.66 () {58 vars in 1009 bytes} [Wed Jun 22 12:31:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:58.372899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad8174-63ad-4696-81ba-3ddbf91bcec1 service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:58.385509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad8174-63ad-4696-81ba-3ddbf91bcec1 service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:58.391160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc94180-0436-470a-a305-ea246b2bf0bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:58.391800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94180-0436-470a-a305-ea246b2bf0bd service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:58.392113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94180-0436-470a-a305-ea246b2bf0bd service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:58.392392 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94180-0436-470a-a305-ea246b2bf0bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:58.401281 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc94180-0436-470a-a305-ea246b2bf0bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:58.402879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc94180-0436-470a-a305-ea246b2bf0bd service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:58.410873 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1395/2791] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:31:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:31:58.719493 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bd4a9-0245-40b9-b839-60e46b9f38f2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:58.720010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bd4a9-0245-40b9-b839-60e46b9f38f2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:58.720326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bd4a9-0245-40b9-b839-60e46b9f38f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:58.738208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-149bd4a9-0245-40b9-b839-60e46b9f38f2 None None] MFA Rules not processed for user `d8a79dc2ab494cb6aaf3b1f4001b7524`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:31:58.739408 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-149bd4a9-0245-40b9-b839-60e46b9f38f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:31:58.746631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1397/2792] 10.222.0.66 () {58 vars in 967 bytes} [Wed Jun 22 12:31:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:31:58.759132 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc94180-0436-470a-a305-ea246b2bf0bd service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:31:58.769956 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc94180-0436-470a-a305-ea246b2bf0bd service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:31:58.775161 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a335d9-1e47-4e21-b281-07b640849b4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254b5c1a59e94596bf942192b4a30ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:31:58.775793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a335d9-1e47-4e21-b281-07b640849b4a service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:31:58.776112 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a335d9-1e47-4e21-b281-07b640849b4a service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:31:58.776396 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a335d9-1e47-4e21-b281-07b640849b4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:31:58.784403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a335d9-1e47-4e21-b281-07b640849b4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:31:58.785968 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a335d9-1e47-4e21-b281-07b640849b4a service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:31:58.794893 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1396/2793] 10.222.0.66 () {60 vars in 1384 bytes} [Wed Jun 22 12:31:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 12:32:08.733147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=34 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:32:08.791594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=27 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:32:54.008049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ae450-d475-4d8b-aa57-9e70f97b187a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:32:54.008590 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ae450-d475-4d8b-aa57-9e70f97b187a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:32:54.008590 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ae450-d475-4d8b-aa57-9e70f97b187a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:32:54.029662 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-029ae450-d475-4d8b-aa57-9e70f97b187a None None] MFA Rules not processed for user `234e88b4b0134a09898d0ed3c02eda63`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:32:54.031433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-029ae450-d475-4d8b-aa57-9e70f97b187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:32:54.099799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1398/2794] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:33:04.086544 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=25 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:33:41.242403 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a335d9-1e47-4e21-b281-07b640849b4a service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:33:41.243811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-10a335d9-1e47-4e21-b281-07b640849b4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:33:41.256324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a335d9-1e47-4e21-b281-07b640849b4a service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:33:41.259908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da566bf1-e099-495a-9c0c-27ca0df17f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:33:41.260570 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da566bf1-e099-495a-9c0c-27ca0df17f89 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:33:41.260898 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da566bf1-e099-495a-9c0c-27ca0df17f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:33:41.261183 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da566bf1-e099-495a-9c0c-27ca0df17f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:33:41.263151 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-da566bf1-e099-495a-9c0c-27ca0df17f89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:33:41.332499 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da566bf1-e099-495a-9c0c-27ca0df17f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:33:41.333937 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da566bf1-e099-495a-9c0c-27ca0df17f89 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:33:41.345472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1397/2795] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:33:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:33:42.732922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ae450-d475-4d8b-aa57-9e70f97b187a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:33:42.734339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-029ae450-d475-4d8b-aa57-9e70f97b187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:33:42.791882 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ae450-d475-4d8b-aa57-9e70f97b187a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:33:42.796114 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7a357-5a9b-485e-92bc-ae0059b44151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:33:42.796770 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7a357-5a9b-485e-92bc-ae0059b44151 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:33:42.797433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7a357-5a9b-485e-92bc-ae0059b44151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:33:42.797433 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7a357-5a9b-485e-92bc-ae0059b44151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:33:42.799092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b8a7a357-5a9b-485e-92bc-ae0059b44151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:33:42.813607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7a357-5a9b-485e-92bc-ae0059b44151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:33:42.815021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7a357-5a9b-485e-92bc-ae0059b44151 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:33:42.826755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1399/2796] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:33:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:33:51.340526 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=34 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:33:52.821643 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=26 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:34:34.799910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da566bf1-e099-495a-9c0c-27ca0df17f89 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:34:34.801366 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-da566bf1-e099-495a-9c0c-27ca0df17f89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:34:34.813368 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da566bf1-e099-495a-9c0c-27ca0df17f89 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:34:34.817057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c5bb1-7f78-4601-80f2-fc05b89d67f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:34:34.817709 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c5bb1-7f78-4601-80f2-fc05b89d67f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:34:34.817993 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c5bb1-7f78-4601-80f2-fc05b89d67f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:34:34.818274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c5bb1-7f78-4601-80f2-fc05b89d67f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:34:34.820070 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-565c5bb1-7f78-4601-80f2-fc05b89d67f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:34:34.831219 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c5bb1-7f78-4601-80f2-fc05b89d67f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:34:34.832657 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c5bb1-7f78-4601-80f2-fc05b89d67f3 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:34:34.841026 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1398/2797] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:34:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:34:44.837203 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:35:47.798210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7a357-5a9b-485e-92bc-ae0059b44151 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:35:47.799649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b8a7a357-5a9b-485e-92bc-ae0059b44151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:35:47.814308 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7a357-5a9b-485e-92bc-ae0059b44151 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:35:47.819810 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede831ab-6e2f-43ae-b03f-988c9bba90be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:35:47.820496 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede831ab-6e2f-43ae-b03f-988c9bba90be service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:35:47.820782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede831ab-6e2f-43ae-b03f-988c9bba90be service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:35:47.821062 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede831ab-6e2f-43ae-b03f-988c9bba90be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:35:47.822778 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ede831ab-6e2f-43ae-b03f-988c9bba90be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:35:47.833440 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede831ab-6e2f-43ae-b03f-988c9bba90be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:35:47.835021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede831ab-6e2f-43ae-b03f-988c9bba90be service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:35:47.843907 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1400/2798] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:35:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:35:57.839792 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:36:41.736263 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c5bb1-7f78-4601-80f2-fc05b89d67f3 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:36:41.775060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c5bb1-7f78-4601-80f2-fc05b89d67f3 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:36:41.778727 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242802f8-7bb0-4e77-8901-59e2682128d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:36:41.779367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242802f8-7bb0-4e77-8901-59e2682128d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:36:41.779655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242802f8-7bb0-4e77-8901-59e2682128d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:36:41.779935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242802f8-7bb0-4e77-8901-59e2682128d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:36:41.781793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-242802f8-7bb0-4e77-8901-59e2682128d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:36:41.861005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242802f8-7bb0-4e77-8901-59e2682128d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:36:41.862446 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242802f8-7bb0-4e77-8901-59e2682128d4 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:36:41.871914 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1399/2799] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:36:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:36:51.867830 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=50 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:36:55.540491 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede831ab-6e2f-43ae-b03f-988c9bba90be service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:36:55.560491 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede831ab-6e2f-43ae-b03f-988c9bba90be service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:36:55.564153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe00176-babc-4806-9dbe-2b6bf433f04e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:36:55.564738 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00176-babc-4806-9dbe-2b6bf433f04e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:36:55.565030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00176-babc-4806-9dbe-2b6bf433f04e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:36:55.565309 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00176-babc-4806-9dbe-2b6bf433f04e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:36:55.573806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe00176-babc-4806-9dbe-2b6bf433f04e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:36:55.575236 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe00176-babc-4806-9dbe-2b6bf433f04e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:36:55.602654 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1401/2800] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:36:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:37:05.599410 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=18 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:37:30.064754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242802f8-7bb0-4e77-8901-59e2682128d4 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:37:30.066327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-242802f8-7bb0-4e77-8901-59e2682128d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:37:30.167029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242802f8-7bb0-4e77-8901-59e2682128d4 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:37:30.171978 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b87d86-8ae3-4e83-afb5-fae0f10b3785 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:37:30.172655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b87d86-8ae3-4e83-afb5-fae0f10b3785 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:37:30.172934 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b87d86-8ae3-4e83-afb5-fae0f10b3785 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:37:30.173210 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b87d86-8ae3-4e83-afb5-fae0f10b3785 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:37:30.174949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-46b87d86-8ae3-4e83-afb5-fae0f10b3785 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:37:30.186523 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b87d86-8ae3-4e83-afb5-fae0f10b3785 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:37:30.188213 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b87d86-8ae3-4e83-afb5-fae0f10b3785 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:37:30.197956 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1400/2801] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:37:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:37:40.193759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=44 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:37:59.440946 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe00176-babc-4806-9dbe-2b6bf433f04e service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:37:59.442383 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bfe00176-babc-4806-9dbe-2b6bf433f04e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:37:59.538276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe00176-babc-4806-9dbe-2b6bf433f04e service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:37:59.543457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:37:59.544349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:37:59.544634 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:37:59.544910 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] PATH_INFO: `/v3/users/ecfa2641a153411f8663f8a9324c3e19` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:37:59.546097 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecfa2641a153411f8663f8a9324c3e19)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:37:59.548003 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:37:59.591257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecfa2641a153411f8663f8a9324c3e19'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:37:59.603635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecfa2641a153411f8663f8a9324c3e19'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:37:59.610798 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecfa2641a153411f8663f8a9324c3e19'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:37:59.611423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecfa2641a153411f8663f8a9324c3e19'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:37:59.618252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecfa2641a153411f8663f8a9324c3e19'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:37:59.624005 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1402/2802] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:37:59 2022] DELETE /identity/v3/users/ecfa2641a153411f8663f8a9324c3e19 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:37:59.628623 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1542-af01-42ad-bd3c-a43f069ee0ff None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:37:59.629135 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1542-af01-42ad-bd3c-a43f069ee0ff None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:37:59.629257 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1542-af01-42ad-bd3c-a43f069ee0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:37:59.656930 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-666e1542-af01-42ad-bd3c-a43f069ee0ff None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:37:59.658131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-666e1542-af01-42ad-bd3c-a43f069ee0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:37:59.720327 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1401/2803] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:37:59.730572 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:37:59.731986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:37:59.786692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:37:59.810437 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dc8c1-5aca-4282-bbef-4b473c19c5c2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:37:59.814096 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b7cb-fbc9-452c-958f-7ca5a138fe05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:37:59.814738 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b7cb-fbc9-452c-958f-7ca5a138fe05 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:37:59.815021 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b7cb-fbc9-452c-958f-7ca5a138fe05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:37:59.815298 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06b7cb-fbc9-452c-958f-7ca5a138fe05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:37:59.824844 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06b7cb-fbc9-452c-958f-7ca5a138fe05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:37:59.826270 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06b7cb-fbc9-452c-958f-7ca5a138fe05 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:37:59.836454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1403/2804] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:38:00.006265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e1542-af01-42ad-bd3c-a43f069ee0ff None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:38:00.008357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-666e1542-af01-42ad-bd3c-a43f069ee0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:38:00.020765 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e1542-af01-42ad-bd3c-a43f069ee0ff None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:38:00.025480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:38:00.026341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:38:00.026631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:38:00.026910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] PATH_INFO: `/v3/projects/cf5a529edc9940039d18b49bd785bcbb` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:38:00.028144 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5a529edc9940039d18b49bd785bcbb)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:38:00.030068 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:38:00.077272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5a529edc9940039d18b49bd785bcbb', 'request_id': 'req-06008704-1c8e-49ed-9dab-f2c2da2eee19'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:38:00.083306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5a529edc9940039d18b49bd785bcbb', 'request_id': 'req-06008704-1c8e-49ed-9dab-f2c2da2eee19'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:38:00.088784 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5a529edc9940039d18b49bd785bcbb', 'request_id': 'req-06008704-1c8e-49ed-9dab-f2c2da2eee19'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:38:00.100929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] The token cache is being invalidate because project cf5a529edc9940039d18b49bd785bcbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:38:00.101218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:38:00.101838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:38:00.103358 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1402/2805] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:38:00 2022] DELETE /identity/v3/projects/cf5a529edc9940039d18b49bd785bcbb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:38:09.831421 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=12 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:38:10.097950 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:39:40.805346 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b7cb-fbc9-452c-958f-7ca5a138fe05 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:39:40.808625 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-be06b7cb-fbc9-452c-958f-7ca5a138fe05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:39:40.820287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06b7cb-fbc9-452c-958f-7ca5a138fe05 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:39:40.871515 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9bb58-2b6d-4ab9-8914-ce0a528fb8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:39:40.872194 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9bb58-2b6d-4ab9-8914-ce0a528fb8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:39:40.872483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9bb58-2b6d-4ab9-8914-ce0a528fb8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:39:40.872762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9bb58-2b6d-4ab9-8914-ce0a528fb8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:39:40.874520 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-97b9bb58-2b6d-4ab9-8914-ce0a528fb8d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:39:40.884348 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9bb58-2b6d-4ab9-8914-ce0a528fb8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:39:40.886019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9bb58-2b6d-4ab9-8914-ce0a528fb8d0 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:39:40.894354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1404/2806] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:39:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:39:50.890402 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=26 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:40:48.414488 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:40:48.416519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:40:48.484450 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06008704-1c8e-49ed-9dab-f2c2da2eee19 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:40:48.488041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3afa7-3076-40da-b0d7-b719d0e5afcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:40:48.488683 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3afa7-3076-40da-b0d7-b719d0e5afcf service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:40:48.488969 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3afa7-3076-40da-b0d7-b719d0e5afcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:40:48.489243 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3afa7-3076-40da-b0d7-b719d0e5afcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:40:48.490981 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e4a3afa7-3076-40da-b0d7-b719d0e5afcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:40:48.569911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3afa7-3076-40da-b0d7-b719d0e5afcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:40:48.571386 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3afa7-3076-40da-b0d7-b719d0e5afcf service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:40:48.590065 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1403/2807] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:40:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:40:58.587552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=66 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:41:55.980273 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9bb58-2b6d-4ab9-8914-ce0a528fb8d0 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:41:55.981651 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-97b9bb58-2b6d-4ab9-8914-ce0a528fb8d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:41:55.993336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9bb58-2b6d-4ab9-8914-ce0a528fb8d0 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:41:55.996843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd866e2-1538-4cdf-96b4-45115e69e769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:41:55.997474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd866e2-1538-4cdf-96b4-45115e69e769 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:41:55.997755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd866e2-1538-4cdf-96b4-45115e69e769 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:41:55.998385 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd866e2-1538-4cdf-96b4-45115e69e769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:41:55.999763 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3fd866e2-1538-4cdf-96b4-45115e69e769 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:41:56.076688 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd866e2-1538-4cdf-96b4-45115e69e769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:41:56.078173 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd866e2-1538-4cdf-96b4-45115e69e769 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:41:56.088890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1405/2808] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:41:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:42:06.083944 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=33 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:42:40.097759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3afa7-3076-40da-b0d7-b719d0e5afcf service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:42:40.099156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e4a3afa7-3076-40da-b0d7-b719d0e5afcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:42:40.173012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3afa7-3076-40da-b0d7-b719d0e5afcf service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:42:40.178086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679ff8c-56b3-4fa3-a947-29443c64adce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:42:40.178733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679ff8c-56b3-4fa3-a947-29443c64adce service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:42:40.179022 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679ff8c-56b3-4fa3-a947-29443c64adce service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:42:40.179350 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679ff8c-56b3-4fa3-a947-29443c64adce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:42:40.181156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8679ff8c-56b3-4fa3-a947-29443c64adce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:42:40.192908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679ff8c-56b3-4fa3-a947-29443c64adce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:42:40.194580 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679ff8c-56b3-4fa3-a947-29443c64adce service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:42:40.204580 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1404/2809] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:42:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:42:50.200290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=32 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:43:56.699338 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd866e2-1538-4cdf-96b4-45115e69e769 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:43:56.700891 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3fd866e2-1538-4cdf-96b4-45115e69e769 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:43:56.826800 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd866e2-1538-4cdf-96b4-45115e69e769 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:43:56.833169 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08ca7c-0eba-48fa-9ed0-36f9fa87af11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:43:56.834068 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08ca7c-0eba-48fa-9ed0-36f9fa87af11 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:43:56.834228 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08ca7c-0eba-48fa-9ed0-36f9fa87af11 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:43:56.834460 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08ca7c-0eba-48fa-9ed0-36f9fa87af11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:43:56.836291 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ff08ca7c-0eba-48fa-9ed0-36f9fa87af11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:43:56.849870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08ca7c-0eba-48fa-9ed0-36f9fa87af11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:43:56.852603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08ca7c-0eba-48fa-9ed0-36f9fa87af11 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:43:56.863420 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1406/2810] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:43:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:43:56.890704 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679ff8c-56b3-4fa3-a947-29443c64adce service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:43:56.892551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8679ff8c-56b3-4fa3-a947-29443c64adce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:43:56.905440 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679ff8c-56b3-4fa3-a947-29443c64adce service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:43:56.909186 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17909995-edd3-439c-874a-45d5f946c659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:43:56.909810 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17909995-edd3-439c-874a-45d5f946c659 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:43:56.910091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17909995-edd3-439c-874a-45d5f946c659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:43:56.910401 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17909995-edd3-439c-874a-45d5f946c659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:43:56.912273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-17909995-edd3-439c-874a-45d5f946c659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:43:56.926641 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17909995-edd3-439c-874a-45d5f946c659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:43:56.928113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17909995-edd3-439c-874a-45d5f946c659 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:43:56.939616 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1405/2811] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:43:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:43:58.134126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08ca7c-0eba-48fa-9ed0-36f9fa87af11 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:43:58.143958 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08ca7c-0eba-48fa-9ed0-36f9fa87af11 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:43:58.148134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24445e3-851e-4533-a632-60f749a4eb68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:43:58.148782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24445e3-851e-4533-a632-60f749a4eb68 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:43:58.149074 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24445e3-851e-4533-a632-60f749a4eb68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:43:58.149386 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24445e3-851e-4533-a632-60f749a4eb68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:43:58.151193 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e24445e3-851e-4533-a632-60f749a4eb68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:43:58.165659 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24445e3-851e-4533-a632-60f749a4eb68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:43:58.167668 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24445e3-851e-4533-a632-60f749a4eb68 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:43:58.184597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1407/2812] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:43:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:44:06.934439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:44:08.175784 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=52 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:44:48.799743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17909995-edd3-439c-874a-45d5f946c659 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:44:48.809115 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17909995-edd3-439c-874a-45d5f946c659 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:44:48.812754 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110e595-e51a-4df9-b6f5-3e58b2eea883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:44:48.813388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110e595-e51a-4df9-b6f5-3e58b2eea883 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:44:48.813669 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110e595-e51a-4df9-b6f5-3e58b2eea883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:44:48.813944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110e595-e51a-4df9-b6f5-3e58b2eea883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:44:48.821392 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110e595-e51a-4df9-b6f5-3e58b2eea883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:44:48.822811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110e595-e51a-4df9-b6f5-3e58b2eea883 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:44:48.830899 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1406/2813] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:44:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:44:58.827291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:45:48.101904 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24445e3-851e-4533-a632-60f749a4eb68 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:45:48.111395 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24445e3-851e-4533-a632-60f749a4eb68 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:45:48.115238 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e7d2e-4c57-4198-becd-b6baed63b593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:45:48.115887 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7d2e-4c57-4198-becd-b6baed63b593 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:45:48.116215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7d2e-4c57-4198-becd-b6baed63b593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:45:48.116498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e7d2e-4c57-4198-becd-b6baed63b593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:45:48.126514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e7d2e-4c57-4198-becd-b6baed63b593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:45:48.128267 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e7d2e-4c57-4198-becd-b6baed63b593 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:45:48.137959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1408/2814] 10.222.0.66 () {60 vars in 1396 bytes} [Wed Jun 22 12:45:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:45:58.133427 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:46:56.055389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110e595-e51a-4df9-b6f5-3e58b2eea883 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:46:56.091856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110e595-e51a-4df9-b6f5-3e58b2eea883 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:46:56.097364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fa693-e555-4804-9789-74c9b638fdbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:46:56.098003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fa693-e555-4804-9789-74c9b638fdbc service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:46:56.098296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fa693-e555-4804-9789-74c9b638fdbc service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:46:56.098581 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fa693-e555-4804-9789-74c9b638fdbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:46:56.106454 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fa693-e555-4804-9789-74c9b638fdbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:46:56.108050 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fa693-e555-4804-9789-74c9b638fdbc service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:46:56.135529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1407/2815] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:46:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:47:06.132909 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=24 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:47:43.084000 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e7d2e-4c57-4198-becd-b6baed63b593 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:47:43.085436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-072e7d2e-4c57-4198-becd-b6baed63b593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:47:43.172483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e7d2e-4c57-4198-becd-b6baed63b593 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:47:43.177508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea033633-2a3b-4fc5-8657-6ef1aef0456d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:47:43.178146 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea033633-2a3b-4fc5-8657-6ef1aef0456d service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:47:43.178428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea033633-2a3b-4fc5-8657-6ef1aef0456d service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:47:43.178703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea033633-2a3b-4fc5-8657-6ef1aef0456d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:47:43.187294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea033633-2a3b-4fc5-8657-6ef1aef0456d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:47:43.188915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea033633-2a3b-4fc5-8657-6ef1aef0456d service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:47:43.199191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1409/2816] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:47:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:47:53.194487 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=37 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:48:57.223438 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fa693-e555-4804-9789-74c9b638fdbc service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:48:57.242150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fa693-e555-4804-9789-74c9b638fdbc service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:48:57.245725 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d338-1231-42a8-8700-8a10b2b80821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:48:57.246360 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d338-1231-42a8-8700-8a10b2b80821 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:48:57.246655 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d338-1231-42a8-8700-8a10b2b80821 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:48:57.246935 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d338-1231-42a8-8700-8a10b2b80821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:48:57.257775 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051d338-1231-42a8-8700-8a10b2b80821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:48:57.259216 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051d338-1231-42a8-8700-8a10b2b80821 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:48:57.271416 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1408/2817] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:48:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:48:58.267913 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea033633-2a3b-4fc5-8657-6ef1aef0456d service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:48:58.277327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea033633-2a3b-4fc5-8657-6ef1aef0456d service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:48:58.281537 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88172e9-ae18-44d8-b226-10b767ccc04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:48:58.282208 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88172e9-ae18-44d8-b226-10b767ccc04f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:48:58.282492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88172e9-ae18-44d8-b226-10b767ccc04f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:48:58.282773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88172e9-ae18-44d8-b226-10b767ccc04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:48:58.293231 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88172e9-ae18-44d8-b226-10b767ccc04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:48:58.295276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88172e9-ae18-44d8-b226-10b767ccc04f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:48:58.306152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1410/2818] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:48:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:49:07.266322 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=10 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:49:08.301474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:50:49.245697 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d338-1231-42a8-8700-8a10b2b80821 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:50:49.257585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d338-1231-42a8-8700-8a10b2b80821 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:50:49.263040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ef985-7c3e-4f2f-9396-a519ad84dce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:50:49.263674 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ef985-7c3e-4f2f-9396-a519ad84dce8 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:50:49.263958 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ef985-7c3e-4f2f-9396-a519ad84dce8 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:50:49.264266 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ef985-7c3e-4f2f-9396-a519ad84dce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:50:49.266607 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e16ef985-7c3e-4f2f-9396-a519ad84dce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:50:49.343695 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ef985-7c3e-4f2f-9396-a519ad84dce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:50:49.345911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ef985-7c3e-4f2f-9396-a519ad84dce8 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:50:49.364187 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1409/2819] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:50:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:50:59.361460 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=41 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:51:47.634644 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4605a1-3a42-4488-be64-1240275b40de None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:51:47.635122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4605a1-3a42-4488-be64-1240275b40de None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:51:47.635122 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4605a1-3a42-4488-be64-1240275b40de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:51:47.671927 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3c4605a1-3a42-4488-be64-1240275b40de None None] MFA Rules not processed for user `234e88b4b0134a09898d0ed3c02eda63`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:51:47.673161 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3c4605a1-3a42-4488-be64-1240275b40de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:51:47.680126 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1411/2820] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:51:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:51:47.982633 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ef985-7c3e-4f2f-9396-a519ad84dce8 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:51:48.036009 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ef985-7c3e-4f2f-9396-a519ad84dce8 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:51:48.039604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb44b76-9fa9-4566-ba13-c105057d227e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:51:48.040332 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb44b76-9fa9-4566-ba13-c105057d227e service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:51:48.040621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb44b76-9fa9-4566-ba13-c105057d227e service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:51:48.040905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb44b76-9fa9-4566-ba13-c105057d227e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:51:48.042685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4cb44b76-9fa9-4566-ba13-c105057d227e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:51:48.063816 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb44b76-9fa9-4566-ba13-c105057d227e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:51:48.065293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb44b76-9fa9-4566-ba13-c105057d227e service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:51:48.073250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1410/2821] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:51:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:51:49.398293 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4605a1-3a42-4488-be64-1240275b40de None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:51:49.410828 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4605a1-3a42-4488-be64-1240275b40de None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:51:49.415873 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83174b5-cd20-4635-8926-35eaef6a9728 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:51:49.416558 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83174b5-cd20-4635-8926-35eaef6a9728 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:51:49.416843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83174b5-cd20-4635-8926-35eaef6a9728 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:51:49.417123 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83174b5-cd20-4635-8926-35eaef6a9728 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:51:49.418992 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b83174b5-cd20-4635-8926-35eaef6a9728 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:51:49.431006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83174b5-cd20-4635-8926-35eaef6a9728 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:51:49.432628 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83174b5-cd20-4635-8926-35eaef6a9728 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:51:49.443610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1412/2822] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:51:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:51:51.179819 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb44b76-9fa9-4566-ba13-c105057d227e service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:51:51.188919 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb44b76-9fa9-4566-ba13-c105057d227e service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:51:51.192594 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b64063-1588-4d68-98fc-09d25e29dc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:51:51.193247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64063-1588-4d68-98fc-09d25e29dc7a service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:51:51.193529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64063-1588-4d68-98fc-09d25e29dc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:51:51.193805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64063-1588-4d68-98fc-09d25e29dc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:51:51.195712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b1b64063-1588-4d68-98fc-09d25e29dc7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:51:51.207048 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b64063-1588-4d68-98fc-09d25e29dc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:51:51.208552 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b64063-1588-4d68-98fc-09d25e29dc7a service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:51:51.217929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1411/2823] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 12:51:51.927829 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83174b5-cd20-4635-8926-35eaef6a9728 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:51:51.950760 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83174b5-cd20-4635-8926-35eaef6a9728 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:51:51.956782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890c54d-e3b4-4bce-b269-22ed132a4994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:51:51.957457 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890c54d-e3b4-4bce-b269-22ed132a4994 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:51:51.957774 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890c54d-e3b4-4bce-b269-22ed132a4994 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:51:51.958053 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890c54d-e3b4-4bce-b269-22ed132a4994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:51:51.968304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890c54d-e3b4-4bce-b269-22ed132a4994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:51:51.970028 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890c54d-e3b4-4bce-b269-22ed132a4994 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:51:51.981489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1413/2824] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:51:57.626965 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b64063-1588-4d68-98fc-09d25e29dc7a service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:51:57.641447 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b64063-1588-4d68-98fc-09d25e29dc7a service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:51:57.647482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1df99-3a71-45d5-beca-4a7ea7aa8472 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:51:57.648253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1df99-3a71-45d5-beca-4a7ea7aa8472 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:51:57.648540 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1df99-3a71-45d5-beca-4a7ea7aa8472 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:51:57.648820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1df99-3a71-45d5-beca-4a7ea7aa8472 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:51:57.650663 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dce1df99-3a71-45d5-beca-4a7ea7aa8472 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:51:57.664194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1df99-3a71-45d5-beca-4a7ea7aa8472 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:51:57.666034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1df99-3a71-45d5-beca-4a7ea7aa8472 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:51:57.677844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1412/2825] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:51:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:51:58.607850 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890c54d-e3b4-4bce-b269-22ed132a4994 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:51:58.609441 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6890c54d-e3b4-4bce-b269-22ed132a4994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:51:58.689619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890c54d-e3b4-4bce-b269-22ed132a4994 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:51:58.693967 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc29d1a-2703-4f77-ade9-6999cb7f4a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:51:58.694619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc29d1a-2703-4f77-ade9-6999cb7f4a5c service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:51:58.695818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc29d1a-2703-4f77-ade9-6999cb7f4a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:51:58.696136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc29d1a-2703-4f77-ade9-6999cb7f4a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:51:58.698030 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fcc29d1a-2703-4f77-ade9-6999cb7f4a5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:51:58.769782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc29d1a-2703-4f77-ade9-6999cb7f4a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:51:58.771232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc29d1a-2703-4f77-ade9-6999cb7f4a5c service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:51:58.780690 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1414/2826] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:51:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:52:07.672457 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=43 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:52:08.776160 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=80 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:52:45.040967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1df99-3a71-45d5-beca-4a7ea7aa8472 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:52:45.042529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dce1df99-3a71-45d5-beca-4a7ea7aa8472 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:52:45.108220 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1df99-3a71-45d5-beca-4a7ea7aa8472 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:52:45.113664 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0180ab-6131-4964-8498-0cd21d7d5477 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:52:45.114294 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0180ab-6131-4964-8498-0cd21d7d5477 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:52:45.114579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0180ab-6131-4964-8498-0cd21d7d5477 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:52:45.114852 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0180ab-6131-4964-8498-0cd21d7d5477 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:52:45.116712 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cb0180ab-6131-4964-8498-0cd21d7d5477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:52:45.128530 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0180ab-6131-4964-8498-0cd21d7d5477 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:52:45.130091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0180ab-6131-4964-8498-0cd21d7d5477 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:52:45.139998 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1413/2827] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:52:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:52:55.135626 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=32 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:53:35.929755 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcd52a-df14-49b1-a834-5f86bbbebd73 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:53:35.930332 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcd52a-df14-49b1-a834-5f86bbbebd73 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:53:35.930492 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcd52a-df14-49b1-a834-5f86bbbebd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:53:35.947596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-17dcd52a-df14-49b1-a834-5f86bbbebd73 None None] MFA Rules not processed for user `234e88b4b0134a09898d0ed3c02eda63`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 12:53:35.948843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-17dcd52a-df14-49b1-a834-5f86bbbebd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:53:35.956382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1415/2828] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 12:53:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 12:53:45.942773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:55:48.584520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0180ab-6131-4964-8498-0cd21d7d5477 service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:55:48.586274 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cb0180ab-6131-4964-8498-0cd21d7d5477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:55:48.598049 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0180ab-6131-4964-8498-0cd21d7d5477 service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:55:48.601645 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b1fa0-69a3-482c-bf2f-b6e9d1196231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:55:48.602278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1fa0-69a3-482c-bf2f-b6e9d1196231 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:55:48.602562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1fa0-69a3-482c-bf2f-b6e9d1196231 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:55:48.602841 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1fa0-69a3-482c-bf2f-b6e9d1196231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:55:48.611730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b1fa0-69a3-482c-bf2f-b6e9d1196231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:55:48.613195 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b1fa0-69a3-482c-bf2f-b6e9d1196231 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:55:48.622078 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1414/2829] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:55:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:55:58.617912 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:55:59.444687 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcd52a-df14-49b1-a834-5f86bbbebd73 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:55:59.446294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-17dcd52a-df14-49b1-a834-5f86bbbebd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:55:59.458423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcd52a-df14-49b1-a834-5f86bbbebd73 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:55:59.462004 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dab51-89f9-4294-836d-aaa6af50ff66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:55:59.462647 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dab51-89f9-4294-836d-aaa6af50ff66 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:55:59.462934 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dab51-89f9-4294-836d-aaa6af50ff66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:55:59.463217 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dab51-89f9-4294-836d-aaa6af50ff66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:55:59.465052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-929dab51-89f9-4294-836d-aaa6af50ff66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:55:59.549890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dab51-89f9-4294-836d-aaa6af50ff66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:55:59.551343 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dab51-89f9-4294-836d-aaa6af50ff66 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:55:59.569938 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1416/2830] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:56:02.643838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b1fa0-69a3-482c-bf2f-b6e9d1196231 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:56:02.660452 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b1fa0-69a3-482c-bf2f-b6e9d1196231 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:56:02.666687 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382c8ab-0fc9-4621-bc72-1ea61a12ca7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:56:02.667468 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c8ab-0fc9-4621-bc72-1ea61a12ca7d service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:56:02.667858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c8ab-0fc9-4621-bc72-1ea61a12ca7d service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:56:02.668276 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c8ab-0fc9-4621-bc72-1ea61a12ca7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:56:02.670295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8382c8ab-0fc9-4621-bc72-1ea61a12ca7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:56:02.682840 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382c8ab-0fc9-4621-bc72-1ea61a12ca7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:56:02.685409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382c8ab-0fc9-4621-bc72-1ea61a12ca7d service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:56:02.703480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1415/2831] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:56:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:56:05.705210 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dab51-89f9-4294-836d-aaa6af50ff66 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:56:05.718892 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dab51-89f9-4294-836d-aaa6af50ff66 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:56:05.724441 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ceb611-28b5-44a4-8cd9-babb933115f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:56:05.725349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceb611-28b5-44a4-8cd9-babb933115f1 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:56:05.725835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceb611-28b5-44a4-8cd9-babb933115f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:56:05.726438 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceb611-28b5-44a4-8cd9-babb933115f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:56:05.728954 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f2ceb611-28b5-44a4-8cd9-babb933115f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:56:05.746427 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ceb611-28b5-44a4-8cd9-babb933115f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:56:05.749084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ceb611-28b5-44a4-8cd9-babb933115f1 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:56:05.768561 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1417/2832] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:56:05.781666 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382c8ab-0fc9-4621-bc72-1ea61a12ca7d service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:56:05.783130 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8382c8ab-0fc9-4621-bc72-1ea61a12ca7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:56:05.798041 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382c8ab-0fc9-4621-bc72-1ea61a12ca7d service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:56:05.802717 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:56:05.803559 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:56:05.803851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:56:05.804177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] PATH_INFO: `/v3/users/ce4e586b71bf48d98c0974edfa7ce644` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:56:05.805648 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4e586b71bf48d98c0974edfa7ce644)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:56:05.812079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:56:05.869464 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4e586b71bf48d98c0974edfa7ce644'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:05.881185 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4e586b71bf48d98c0974edfa7ce644'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:05.888980 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4e586b71bf48d98c0974edfa7ce644'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:05.889586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4e586b71bf48d98c0974edfa7ce644'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:05.896701 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4e586b71bf48d98c0974edfa7ce644'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:05.902471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1416/2833] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:56:05 2022] DELETE /identity/v3/users/ce4e586b71bf48d98c0974edfa7ce644 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:56:06.077449 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ceb611-28b5-44a4-8cd9-babb933115f1 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:56:06.091842 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ceb611-28b5-44a4-8cd9-babb933115f1 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:56:06.149607 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:56:06.150474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:56:06.150761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:56:06.151039 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] PATH_INFO: `/v3/projects/c77d08077c39475bbb73e39fc6a40f04` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:56:06.152255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77d08077c39475bbb73e39fc6a40f04)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:56:06.154814 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:56:06.203889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77d08077c39475bbb73e39fc6a40f04', 'request_id': 'req-a31614ef-8edc-47c6-94e2-c233b6b2a339'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.210764 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77d08077c39475bbb73e39fc6a40f04', 'request_id': 'req-a31614ef-8edc-47c6-94e2-c233b6b2a339'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.212367 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:56:06.219875 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77d08077c39475bbb73e39fc6a40f04', 'request_id': 'req-a31614ef-8edc-47c6-94e2-c233b6b2a339'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.234606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] The token cache is being invalidate because project c77d08077c39475bbb73e39fc6a40f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:56:06.234903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.235583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.237246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1418/2834] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:56:06 2022] DELETE /identity/v3/projects/c77d08077c39475bbb73e39fc6a40f04 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:56:06.241388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:56:06.242904 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:56:06.257229 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c34b1-98d6-423d-b002-366ee3baa97b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:56:06.317828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:56:06.318964 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:56:06.319318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:56:06.319656 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] PATH_INFO: `/v3/users/4affee8c2a454541aeddf4f6dc00e5b6` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:56:06.334532 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4affee8c2a454541aeddf4f6dc00e5b6)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:56:06.336633 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:56:06.385924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4affee8c2a454541aeddf4f6dc00e5b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.389500 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:56:06.402005 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4affee8c2a454541aeddf4f6dc00e5b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.409335 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4affee8c2a454541aeddf4f6dc00e5b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.409945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4affee8c2a454541aeddf4f6dc00e5b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.416854 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4affee8c2a454541aeddf4f6dc00e5b6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.422997 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1417/2835] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 12:56:06 2022] DELETE /identity/v3/users/4affee8c2a454541aeddf4f6dc00e5b6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:56:06.594377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:56:06.595815 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:56:06.609049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31614ef-8edc-47c6-94e2-c233b6b2a339 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:56:06.666920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:56:06.667779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:56:06.668098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:56:06.668380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] PATH_INFO: `/v3/projects/45395f868c4645b09f761aa6cc41799b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:56:06.679134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45395f868c4645b09f761aa6cc41799b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:56:06.681107 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:56:06.727648 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45395f868c4645b09f761aa6cc41799b', 'request_id': 'req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.734604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45395f868c4645b09f761aa6cc41799b', 'request_id': 'req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.739941 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45395f868c4645b09f761aa6cc41799b', 'request_id': 'req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.752093 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] The token cache is being invalidate because project 45395f868c4645b09f761aa6cc41799b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 12:56:06.752381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.752998 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 12:56:06.754503 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1419/2836] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 12:56:06 2022] DELETE /identity/v3/projects/45395f868c4645b09f761aa6cc41799b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 12:56:16.420294 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=11,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:56:16.749233 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=10,keystone:SELECT=59,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:56:58.771481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:56:58.772954 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:56:58.831631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84178c-e82e-4420-8a7e-91db7348cb2c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:56:58.880668 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd857e-bc70-445a-b37b-7183b6ad03c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:56:58.881306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd857e-bc70-445a-b37b-7183b6ad03c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:56:58.881585 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd857e-bc70-445a-b37b-7183b6ad03c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:56:58.881858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd857e-bc70-445a-b37b-7183b6ad03c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:56:58.883625 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cabd857e-bc70-445a-b37b-7183b6ad03c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:56:58.892834 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd857e-bc70-445a-b37b-7183b6ad03c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:56:58.894551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd857e-bc70-445a-b37b-7183b6ad03c5 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:56:58.902361 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1418/2837] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:56:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:57:08.898829 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=46 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 12:57:52.058089 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 12:57:52.059481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:57:52.197649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c8b40-b63f-4e2f-bed8-b6af93920cd9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 12:57:52.202799 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850d69f-cc13-483c-abdd-3c28c85ecda3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 12:57:52.203489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850d69f-cc13-483c-abdd-3c28c85ecda3 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 12:57:52.203779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850d69f-cc13-483c-abdd-3c28c85ecda3 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 12:57:52.204152 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850d69f-cc13-483c-abdd-3c28c85ecda3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 12:57:52.205924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8850d69f-cc13-483c-abdd-3c28c85ecda3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 12:57:52.217186 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850d69f-cc13-483c-abdd-3c28c85ecda3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 12:57:52.218824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850d69f-cc13-483c-abdd-3c28c85ecda3 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 12:57:52.228677 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1420/2838] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 12:57:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 12:58:02.224428 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=63 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:00:20.154481 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd857e-bc70-445a-b37b-7183b6ad03c5 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:00:20.155890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cabd857e-bc70-445a-b37b-7183b6ad03c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:00:20.205307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd857e-bc70-445a-b37b-7183b6ad03c5 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:00:20.208895 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dd975-8583-41f3-b48a-765f0e0287ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:00:20.209553 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dd975-8583-41f3-b48a-765f0e0287ff service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:00:20.209820 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dd975-8583-41f3-b48a-765f0e0287ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:00:20.210099 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dd975-8583-41f3-b48a-765f0e0287ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:00:20.211866 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-676dd975-8583-41f3-b48a-765f0e0287ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:00:20.300913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dd975-8583-41f3-b48a-765f0e0287ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:00:20.302349 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dd975-8583-41f3-b48a-765f0e0287ff service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:00:20.322052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1419/2839] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:00:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:00:21.551199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850d69f-cc13-483c-abdd-3c28c85ecda3 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:00:21.562098 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850d69f-cc13-483c-abdd-3c28c85ecda3 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:00:21.565959 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a3034-1d05-4545-adab-2cd21d8c5c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:00:21.566627 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3034-1d05-4545-adab-2cd21d8c5c66 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:00:21.567013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3034-1d05-4545-adab-2cd21d8c5c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:00:21.567302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3034-1d05-4545-adab-2cd21d8c5c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:00:21.569429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0a5a3034-1d05-4545-adab-2cd21d8c5c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:00:21.584918 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a3034-1d05-4545-adab-2cd21d8c5c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:00:21.586583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a3034-1d05-4545-adab-2cd21d8c5c66 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:00:21.599254 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1421/2840] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:00:21.778533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dd975-8583-41f3-b48a-765f0e0287ff service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:00:21.781393 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-676dd975-8583-41f3-b48a-765f0e0287ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:00:21.798507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dd975-8583-41f3-b48a-765f0e0287ff service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:00:21.804290 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7793-ea29-4c65-ab9c-d0b0bad0bf0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df703568a334eea9550ac643d87b5fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:00:21.805111 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7793-ea29-4c65-ab9c-d0b0bad0bf0a service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:00:21.805431 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7793-ea29-4c65-ab9c-d0b0bad0bf0a service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:00:21.805793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7793-ea29-4c65-ab9c-d0b0bad0bf0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:00:21.807789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7c0b7793-ea29-4c65-ab9c-d0b0bad0bf0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:00:21.822105 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b7793-ea29-4c65-ab9c-d0b0bad0bf0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:00:21.824402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b7793-ea29-4c65-ab9c-d0b0bad0bf0a service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:00:21.836845 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1420/2841] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 13:00:31.593614 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:00:31.831296 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=69 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:00:49.648631 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a3034-1d05-4545-adab-2cd21d8c5c66 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:00:49.650066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0a5a3034-1d05-4545-adab-2cd21d8c5c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:00:49.705052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a3034-1d05-4545-adab-2cd21d8c5c66 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:00:49.708583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927fa53-c579-4c1f-9ee0-5f6356e74802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:00:49.709219 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927fa53-c579-4c1f-9ee0-5f6356e74802 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:00:49.709505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927fa53-c579-4c1f-9ee0-5f6356e74802 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:00:49.709785 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927fa53-c579-4c1f-9ee0-5f6356e74802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:00:49.711508 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7927fa53-c579-4c1f-9ee0-5f6356e74802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:00:49.793163 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927fa53-c579-4c1f-9ee0-5f6356e74802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:00:49.794704 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927fa53-c579-4c1f-9ee0-5f6356e74802 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:00:49.814066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1422/2842] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:00:59.811341 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=61 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:02:59.021844 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7793-ea29-4c65-ab9c-d0b0bad0bf0a service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:02:59.033002 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7793-ea29-4c65-ab9c-d0b0bad0bf0a service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:02:59.037858 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa927218-7e22-4f62-8d31-c3ca20869fcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:02:59.038492 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927218-7e22-4f62-8d31-c3ca20869fcb service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:02:59.038774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927218-7e22-4f62-8d31-c3ca20869fcb service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:02:59.039046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa927218-7e22-4f62-8d31-c3ca20869fcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:02:59.047949 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa927218-7e22-4f62-8d31-c3ca20869fcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:02:59.049561 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa927218-7e22-4f62-8d31-c3ca20869fcb service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:02:59.059953 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1421/2843] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:02:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:03:09.055089 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:05:50.419869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927fa53-c579-4c1f-9ee0-5f6356e74802 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:05:50.421375 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7927fa53-c579-4c1f-9ee0-5f6356e74802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:05:50.453866 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927fa53-c579-4c1f-9ee0-5f6356e74802 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:05:50.457494 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1be53-3781-4c1e-95ed-7ff50b84408b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:05:50.458136 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1be53-3781-4c1e-95ed-7ff50b84408b service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:05:50.458423 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1be53-3781-4c1e-95ed-7ff50b84408b service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:05:50.458706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1be53-3781-4c1e-95ed-7ff50b84408b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:05:50.467703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1be53-3781-4c1e-95ed-7ff50b84408b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:05:50.469192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1be53-3781-4c1e-95ed-7ff50b84408b service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:05:50.478071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1423/2844] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:05:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:06:00.473988 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=15 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:08:05.005925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa927218-7e22-4f62-8d31-c3ca20869fcb service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:08:05.007336 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-aa927218-7e22-4f62-8d31-c3ca20869fcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:08:05.114615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa927218-7e22-4f62-8d31-c3ca20869fcb service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:08:05.119574 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc14e7-45eb-44dc-a79e-8ce2d3216b31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:08:05.120734 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc14e7-45eb-44dc-a79e-8ce2d3216b31 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:08:05.121018 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc14e7-45eb-44dc-a79e-8ce2d3216b31 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:08:05.121292 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc14e7-45eb-44dc-a79e-8ce2d3216b31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:08:05.123138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-60fc14e7-45eb-44dc-a79e-8ce2d3216b31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:08:05.134150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc14e7-45eb-44dc-a79e-8ce2d3216b31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:08:05.135713 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc14e7-45eb-44dc-a79e-8ce2d3216b31 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:08:05.146278 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1422/2845] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:08:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:08:15.142131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=50 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:10:50.468600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1be53-3781-4c1e-95ed-7ff50b84408b service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:10:50.470213 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f6d1be53-3781-4c1e-95ed-7ff50b84408b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:10:50.556636 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1be53-3781-4c1e-95ed-7ff50b84408b service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:10:50.560709 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ce3dd-94bf-47dd-bfc8-007520219750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:10:50.561498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce3dd-94bf-47dd-bfc8-007520219750 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:10:50.561786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce3dd-94bf-47dd-bfc8-007520219750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:10:50.562074 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce3dd-94bf-47dd-bfc8-007520219750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:10:50.564066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cf4ce3dd-94bf-47dd-bfc8-007520219750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:10:50.643783 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ce3dd-94bf-47dd-bfc8-007520219750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:10:50.645260 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ce3dd-94bf-47dd-bfc8-007520219750 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:10:50.664263 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1424/2846] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:10:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:11:00.661565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=74 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:24.440604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc14e7-45eb-44dc-a79e-8ce2d3216b31 service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:24.442010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-60fc14e7-45eb-44dc-a79e-8ce2d3216b31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:24.550119 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc14e7-45eb-44dc-a79e-8ce2d3216b31 service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:24.553780 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff09ce2-8753-4539-b207-2324f6198c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:24.554418 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff09ce2-8753-4539-b207-2324f6198c6d service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:24.554702 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff09ce2-8753-4539-b207-2324f6198c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:24.555010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff09ce2-8753-4539-b207-2324f6198c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:24.556769 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fff09ce2-8753-4539-b207-2324f6198c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:24.638321 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff09ce2-8753-4539-b207-2324f6198c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:24.639759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff09ce2-8753-4539-b207-2324f6198c6d service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:24.658804 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1423/2847] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:12:27.629684 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ce3dd-94bf-47dd-bfc8-007520219750 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:27.631957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cf4ce3dd-94bf-47dd-bfc8-007520219750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:27.648865 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ce3dd-94bf-47dd-bfc8-007520219750 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:27.654748 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf7624-fb4b-4592-a1c1-615d1929285e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:27.655501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf7624-fb4b-4592-a1c1-615d1929285e service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:27.655860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf7624-fb4b-4592-a1c1-615d1929285e service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:27.656239 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf7624-fb4b-4592-a1c1-615d1929285e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:27.658255 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2ccf7624-fb4b-4592-a1c1-615d1929285e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:27.671557 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf7624-fb4b-4592-a1c1-615d1929285e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:27.673626 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf7624-fb4b-4592-a1c1-615d1929285e service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:27.686331 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1425/2848] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:12:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:12:27.704471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff09ce2-8753-4539-b207-2324f6198c6d service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:27.706505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fff09ce2-8753-4539-b207-2324f6198c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:27.723187 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff09ce2-8753-4539-b207-2324f6198c6d service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:27.728007 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaf0ed-8588-447e-8c1c-7d75ee783468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:27.728905 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaf0ed-8588-447e-8c1c-7d75ee783468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:27.729194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaf0ed-8588-447e-8c1c-7d75ee783468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:27.729473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaf0ed-8588-447e-8c1c-7d75ee783468 admin admin] PATH_INFO: `/v3/users/234e88b4b0134a09898d0ed3c02eda63` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:27.730650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaf0ed-8588-447e-8c1c-7d75ee783468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=234e88b4b0134a09898d0ed3c02eda63)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:27.732605 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaf0ed-8588-447e-8c1c-7d75ee783468 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:27.762306 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:27.782201 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-63eaf0ed-8588-447e-8c1c-7d75ee783468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '234e88b4b0134a09898d0ed3c02eda63'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:27.794037 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-63eaf0ed-8588-447e-8c1c-7d75ee783468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '234e88b4b0134a09898d0ed3c02eda63'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:27.800890 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-63eaf0ed-8588-447e-8c1c-7d75ee783468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '234e88b4b0134a09898d0ed3c02eda63'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:27.801575 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-63eaf0ed-8588-447e-8c1c-7d75ee783468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '234e88b4b0134a09898d0ed3c02eda63'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:27.809249 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-63eaf0ed-8588-447e-8c1c-7d75ee783468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '234e88b4b0134a09898d0ed3c02eda63'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:27.815269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1424/2849] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 13:12:27 2022] DELETE /identity/v3/users/234e88b4b0134a09898d0ed3c02eda63 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:27.991711 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf7624-fb4b-4592-a1c1-615d1929285e service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:28.005673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf7624-fb4b-4592-a1c1-615d1929285e service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:28.064674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:28.065466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.065752 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.066033 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] PATH_INFO: `/v3/projects/e679e233fe7040bcad87c6bc63cd796b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.067215 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e679e233fe7040bcad87c6bc63cd796b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:28.069165 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:28.113839 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e679e233fe7040bcad87c6bc63cd796b', 'request_id': 'req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:28.120475 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e679e233fe7040bcad87c6bc63cd796b', 'request_id': 'req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:28.125961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e679e233fe7040bcad87c6bc63cd796b', 'request_id': 'req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:28.138065 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] The token cache is being invalidate because project e679e233fe7040bcad87c6bc63cd796b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 13:12:28.138354 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:28.138972 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3e824f4f-f98d-47b0-97a9-e2ac2d3e721a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:28.140583 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1426/2850] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 13:12:27 2022] DELETE /identity/v3/projects/e679e233fe7040bcad87c6bc63cd796b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:28.146233 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a54d70-8f46-425a-9f0d-0c50379fc2b7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.146530 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a54d70-8f46-425a-9f0d-0c50379fc2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.146818 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a54d70-8f46-425a-9f0d-0c50379fc2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.202761 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-18a54d70-8f46-425a-9f0d-0c50379fc2b7 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:28.203974 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-18a54d70-8f46-425a-9f0d-0c50379fc2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:28.263783 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1425/2851] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:28.271565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73acc1-1890-4ac2-8ddc-0cad589884a6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.271864 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73acc1-1890-4ac2-8ddc-0cad589884a6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.272191 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73acc1-1890-4ac2-8ddc-0cad589884a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.290314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1a73acc1-1890-4ac2-8ddc-0cad589884a6 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:28.291514 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1a73acc1-1890-4ac2-8ddc-0cad589884a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:28.299369 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1427/2852] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:28.303796 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a54d70-8f46-425a-9f0d-0c50379fc2b7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:28.313400 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a54d70-8f46-425a-9f0d-0c50379fc2b7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:28.318042 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81e1e7-100d-4568-b00a-36fbb6cfc7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:28.319250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81e1e7-100d-4568-b00a-36fbb6cfc7ed admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.319539 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81e1e7-100d-4568-b00a-36fbb6cfc7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.319822 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81e1e7-100d-4568-b00a-36fbb6cfc7ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.320591 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81e1e7-100d-4568-b00a-36fbb6cfc7ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 13:12:28.320907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81e1e7-100d-4568-b00a-36fbb6cfc7ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:28.322503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81e1e7-100d-4568-b00a-36fbb6cfc7ed admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:28.333992 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1426/2853] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 13:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 13:12:28.337787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73acc1-1890-4ac2-8ddc-0cad589884a6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:28.346782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73acc1-1890-4ac2-8ddc-0cad589884a6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:28.351425 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7610c-4f52-4614-a86a-e210a1ffc8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:28.352090 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7610c-4f52-4614-a86a-e210a1ffc8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.352387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7610c-4f52-4614-a86a-e210a1ffc8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.352669 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7610c-4f52-4614-a86a-e210a1ffc8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.353352 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7610c-4f52-4614-a86a-e210a1ffc8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:28.355252 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7610c-4f52-4614-a86a-e210a1ffc8e1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:28.391013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1428/2854] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 13:12:28 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:28.395168 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81e1e7-100d-4568-b00a-36fbb6cfc7ed admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:28.405743 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81e1e7-100d-4568-b00a-36fbb6cfc7ed admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:28.461288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6ded2-5589-4fc7-be0e-7fd97ea62ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:28.461944 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6ded2-5589-4fc7-be0e-7fd97ea62ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.462227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6ded2-5589-4fc7-be0e-7fd97ea62ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.462503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6ded2-5589-4fc7-be0e-7fd97ea62ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.463199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6ded2-5589-4fc7-be0e-7fd97ea62ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:28.465149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6ded2-5589-4fc7-be0e-7fd97ea62ed2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:28.472619 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:28.487253 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1427/2855] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 13:12:28 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:28.489329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7610c-4f52-4614-a86a-e210a1ffc8e1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:28.500250 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7610c-4f52-4614-a86a-e210a1ffc8e1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:28.504868 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f14d9d-d418-459a-b937-c2c4cb502d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:28.506164 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f14d9d-d418-459a-b937-c2c4cb502d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.506464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f14d9d-d418-459a-b937-c2c4cb502d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.506747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f14d9d-d418-459a-b937-c2c4cb502d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.507474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f14d9d-d418-459a-b937-c2c4cb502d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:28.509112 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f14d9d-d418-459a-b937-c2c4cb502d74 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:28.518957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1429/2856] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:28.522888 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6ded2-5589-4fc7-be0e-7fd97ea62ed2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:28.532994 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6ded2-5589-4fc7-be0e-7fd97ea62ed2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:28.537598 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab34f6-2942-496e-9beb-f13d10f727a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:28.538246 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab34f6-2942-496e-9beb-f13d10f727a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.538528 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab34f6-2942-496e-9beb-f13d10f727a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.538805 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab34f6-2942-496e-9beb-f13d10f727a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.539565 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab34f6-2942-496e-9beb-f13d10f727a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:28.541181 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab34f6-2942-496e-9beb-f13d10f727a9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:28.551620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1428/2857] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:28.555970 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f14d9d-d418-459a-b937-c2c4cb502d74 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:28.565751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f14d9d-d418-459a-b937-c2c4cb502d74 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:28.571135 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbe9ac-cd53-4701-a113-74f67f73cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:28.571957 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbe9ac-cd53-4701-a113-74f67f73cc51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.572274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbe9ac-cd53-4701-a113-74f67f73cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.572552 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbe9ac-cd53-4701-a113-74f67f73cc51 admin admin] PATH_INFO: `/v3/projects/0114b523dbe14f12b2b815cd72ccef82/users/92289a47f8ed4bda801d71f4ce718340/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.586926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbe9ac-cd53-4701-a113-74f67f73cc51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0114b523dbe14f12b2b815cd72ccef82, user_id=92289a47f8ed4bda801d71f4ce718340, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:28.589598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbe9ac-cd53-4701-a113-74f67f73cc51 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:28.604079 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1430/2858] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 13:12:28 2022] PUT /identity/v3/projects/0114b523dbe14f12b2b815cd72ccef82/users/92289a47f8ed4bda801d71f4ce718340/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:28.614337 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720bb55-b5ea-41f7-a834-ad11c517009c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.614631 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720bb55-b5ea-41f7-a834-ad11c517009c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.615528 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720bb55-b5ea-41f7-a834-ad11c517009c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.641372 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1720bb55-b5ea-41f7-a834-ad11c517009c None None] MFA Rules not processed for user `92289a47f8ed4bda801d71f4ce718340`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:28.642573 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1720bb55-b5ea-41f7-a834-ad11c517009c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:28.704795 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1429/2859] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:28.709596 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbe9ac-cd53-4701-a113-74f67f73cc51 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:28.715302 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:28.777889 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbe9ac-cd53-4701-a113-74f67f73cc51 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:28.782529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91d933-3392-4af5-b38d-92eb5174a129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:28.783185 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d933-3392-4af5-b38d-92eb5174a129 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.783471 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d933-3392-4af5-b38d-92eb5174a129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.783747 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d933-3392-4af5-b38d-92eb5174a129 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.784474 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91d933-3392-4af5-b38d-92eb5174a129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:28.786381 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91d933-3392-4af5-b38d-92eb5174a129 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:28.821387 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1431/2860] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 13:12:28 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:28.825242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720bb55-b5ea-41f7-a834-ad11c517009c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:28.836295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720bb55-b5ea-41f7-a834-ad11c517009c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:28.898234 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c218ca3-c94a-4614-9b93-24c82d632c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:28.899029 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c218ca3-c94a-4614-9b93-24c82d632c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.899338 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c218ca3-c94a-4614-9b93-24c82d632c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.899606 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c218ca3-c94a-4614-9b93-24c82d632c54 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.900604 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c218ca3-c94a-4614-9b93-24c82d632c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:28.902533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c218ca3-c94a-4614-9b93-24c82d632c54 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:28.922131 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1430/2861] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 13:12:28 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:28.926051 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91d933-3392-4af5-b38d-92eb5174a129 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:28.936899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91d933-3392-4af5-b38d-92eb5174a129 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:28.941609 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8c1fe-b82e-4674-ad2f-499c377c5acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:28.942266 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8c1fe-b82e-4674-ad2f-499c377c5acd admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.942553 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8c1fe-b82e-4674-ad2f-499c377c5acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.942835 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8c1fe-b82e-4674-ad2f-499c377c5acd admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.943594 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8c1fe-b82e-4674-ad2f-499c377c5acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:28.945237 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8c1fe-b82e-4674-ad2f-499c377c5acd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:28.955651 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1432/2862] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:28.960175 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c218ca3-c94a-4614-9b93-24c82d632c54 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:28.969955 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c218ca3-c94a-4614-9b93-24c82d632c54 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:28.975326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ab474-be20-4051-96f2-0ba0097e374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:28.976273 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ab474-be20-4051-96f2-0ba0097e374c admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:28.976560 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ab474-be20-4051-96f2-0ba0097e374c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:28.976838 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ab474-be20-4051-96f2-0ba0097e374c admin admin] PATH_INFO: `/v3/projects/b692c9558f9445188a72b94402821aed/users/062b71bc78fe45eebc110d56ccfe7901/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:28.991293 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ab474-be20-4051-96f2-0ba0097e374c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b692c9558f9445188a72b94402821aed, user_id=062b71bc78fe45eebc110d56ccfe7901, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:28.993986 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ab474-be20-4051-96f2-0ba0097e374c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:29.006462 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1431/2863] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 13:12:28 2022] PUT /identity/v3/projects/b692c9558f9445188a72b94402821aed/users/062b71bc78fe45eebc110d56ccfe7901/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 13:12:29.010384 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8c1fe-b82e-4674-ad2f-499c377c5acd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:29.020518 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8c1fe-b82e-4674-ad2f-499c377c5acd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:29.076144 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4b778-4500-4f14-9d89-755355638e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:29.076735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4b778-4500-4f14-9d89-755355638e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:29.077024 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4b778-4500-4f14-9d89-755355638e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:29.077303 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4b778-4500-4f14-9d89-755355638e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:29.078031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4b778-4500-4f14-9d89-755355638e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:29.079649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4b778-4500-4f14-9d89-755355638e51 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:29.090244 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1433/2864] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:29.094352 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ab474-be20-4051-96f2-0ba0097e374c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:29.105024 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ab474-be20-4051-96f2-0ba0097e374c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:29.109554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f622fde-6130-4c38-8656-c9ab34fb24bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:29.110471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f622fde-6130-4c38-8656-c9ab34fb24bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:29.110757 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f622fde-6130-4c38-8656-c9ab34fb24bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:29.111035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f622fde-6130-4c38-8656-c9ab34fb24bc admin admin] PATH_INFO: `/v3/projects/b692c9558f9445188a72b94402821aed/users/062b71bc78fe45eebc110d56ccfe7901/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:29.113021 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f622fde-6130-4c38-8656-c9ab34fb24bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b692c9558f9445188a72b94402821aed, user_id=062b71bc78fe45eebc110d56ccfe7901, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:29.115646 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f622fde-6130-4c38-8656-c9ab34fb24bc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:29.125692 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1432/2865] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 13:12:29 2022] PUT /identity/v3/projects/b692c9558f9445188a72b94402821aed/users/062b71bc78fe45eebc110d56ccfe7901/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:29.136897 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7c556-9955-4349-b403-e7e0266682b8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:29.137184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7c556-9955-4349-b403-e7e0266682b8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:29.137469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7c556-9955-4349-b403-e7e0266682b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:29.164740 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-54e7c556-9955-4349-b403-e7e0266682b8 None None] MFA Rules not processed for user `062b71bc78fe45eebc110d56ccfe7901`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:29.165947 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-54e7c556-9955-4349-b403-e7e0266682b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:29.229230 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:29.233512 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1434/2866] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:29.243889 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f622fde-6130-4c38-8656-c9ab34fb24bc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:29.245990 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2f622fde-6130-4c38-8656-c9ab34fb24bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:29.272538 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:29.304138 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f622fde-6130-4c38-8656-c9ab34fb24bc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:29.307696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39acb19-afc8-4877-93c5-8001ae67932e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:29.308357 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39acb19-afc8-4877-93c5-8001ae67932e service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:29.308640 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39acb19-afc8-4877-93c5-8001ae67932e service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:29.308917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39acb19-afc8-4877-93c5-8001ae67932e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:29.317772 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39acb19-afc8-4877-93c5-8001ae67932e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:29.319723 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39acb19-afc8-4877-93c5-8001ae67932e service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:29.329019 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1433/2867] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:12:29 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:12:29.468779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7c556-9955-4349-b403-e7e0266682b8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:29.530565 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7c556-9955-4349-b403-e7e0266682b8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:29.535018 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:29.535882 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:29.536209 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:29.536488 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] PATH_INFO: `/v3/users/92289a47f8ed4bda801d71f4ce718340` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:29.537658 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92289a47f8ed4bda801d71f4ce718340)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:29.539573 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:29.587044 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92289a47f8ed4bda801d71f4ce718340'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:29.598701 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92289a47f8ed4bda801d71f4ce718340'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:29.606052 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92289a47f8ed4bda801d71f4ce718340'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:29.606762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92289a47f8ed4bda801d71f4ce718340'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:29.613507 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92289a47f8ed4bda801d71f4ce718340'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:29.619257 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1435/2868] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 13:12:29 2022] DELETE /identity/v3/users/92289a47f8ed4bda801d71f4ce718340 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:29.623860 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f11a8-bd58-46d6-84df-9583ebe6085d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:29.624193 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f11a8-bd58-46d6-84df-9583ebe6085d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:29.624472 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f11a8-bd58-46d6-84df-9583ebe6085d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:29.642793 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f19f11a8-bd58-46d6-84df-9583ebe6085d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:29.644365 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f19f11a8-bd58-46d6-84df-9583ebe6085d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:29.702716 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1434/2869] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:29.713010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:29.714429 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:29.772352 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be296c7-c148-4f59-ae20-83bfc17865e4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:29.776214 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bce141-de93-4d98-adf3-370225a50ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:29.776852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bce141-de93-4d98-adf3-370225a50ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:29.777134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bce141-de93-4d98-adf3-370225a50ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:29.777410 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bce141-de93-4d98-adf3-370225a50ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:29.786392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bce141-de93-4d98-adf3-370225a50ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:29.787816 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bce141-de93-4d98-adf3-370225a50ea6 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:29.797067 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1436/2870] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:12:30.072589 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f11a8-bd58-46d6-84df-9583ebe6085d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:30.074147 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f19f11a8-bd58-46d6-84df-9583ebe6085d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:30.086727 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f11a8-bd58-46d6-84df-9583ebe6085d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:30.092158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:30.093045 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:30.093307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:30.093586 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] PATH_INFO: `/v3/projects/0114b523dbe14f12b2b815cd72ccef82` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:30.094924 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0114b523dbe14f12b2b815cd72ccef82)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:30.099159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:30.148879 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0114b523dbe14f12b2b815cd72ccef82', 'request_id': 'req-0c503bf2-779c-41be-ac96-4701e4d7f410'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.156442 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0114b523dbe14f12b2b815cd72ccef82', 'request_id': 'req-0c503bf2-779c-41be-ac96-4701e4d7f410'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.163406 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0114b523dbe14f12b2b815cd72ccef82', 'request_id': 'req-0c503bf2-779c-41be-ac96-4701e4d7f410'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.178946 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] The token cache is being invalidate because project 0114b523dbe14f12b2b815cd72ccef82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 13:12:30.179239 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.179921 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.181550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1435/2871] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 13:12:30 2022] DELETE /identity/v3/projects/0114b523dbe14f12b2b815cd72ccef82 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:30.185566 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bce141-de93-4d98-adf3-370225a50ea6 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:30.195806 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bce141-de93-4d98-adf3-370225a50ea6 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:30.214604 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:30.256653 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0ab5f-6b5d-4a2b-acdf-bc6373c251bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:30.257651 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ab5f-6b5d-4a2b-acdf-bc6373c251bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:30.258012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ab5f-6b5d-4a2b-acdf-bc6373c251bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:30.258370 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ab5f-6b5d-4a2b-acdf-bc6373c251bf admin admin] PATH_INFO: `/v3/users/062b71bc78fe45eebc110d56ccfe7901` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:30.259635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0ab5f-6b5d-4a2b-acdf-bc6373c251bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=062b71bc78fe45eebc110d56ccfe7901)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:30.261663 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0ab5f-6b5d-4a2b-acdf-bc6373c251bf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:30.308922 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-95f0ab5f-6b5d-4a2b-acdf-bc6373c251bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062b71bc78fe45eebc110d56ccfe7901'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.320501 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-95f0ab5f-6b5d-4a2b-acdf-bc6373c251bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062b71bc78fe45eebc110d56ccfe7901'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.328184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-95f0ab5f-6b5d-4a2b-acdf-bc6373c251bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062b71bc78fe45eebc110d56ccfe7901'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.328801 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-95f0ab5f-6b5d-4a2b-acdf-bc6373c251bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062b71bc78fe45eebc110d56ccfe7901'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.335610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-95f0ab5f-6b5d-4a2b-acdf-bc6373c251bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062b71bc78fe45eebc110d56ccfe7901'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.341527 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1437/2872] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 13:12:30 2022] DELETE /identity/v3/users/062b71bc78fe45eebc110d56ccfe7901 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:30.621979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:30.623430 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:30.638732 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c503bf2-779c-41be-ac96-4701e4d7f410 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:30.685675 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:30.699387 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:30.700364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:30.700674 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:30.700999 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] PATH_INFO: `/v3/projects/b692c9558f9445188a72b94402821aed` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:30.702199 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b692c9558f9445188a72b94402821aed)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:30.704196 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:30.749811 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b692c9558f9445188a72b94402821aed', 'request_id': 'req-5c79c47b-25d4-4421-a280-d7167c48364a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.755812 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b692c9558f9445188a72b94402821aed', 'request_id': 'req-5c79c47b-25d4-4421-a280-d7167c48364a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.766157 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b692c9558f9445188a72b94402821aed', 'request_id': 'req-5c79c47b-25d4-4421-a280-d7167c48364a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.773759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] The token cache is being invalidate because project b692c9558f9445188a72b94402821aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 13:12:30.774046 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.774659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5c79c47b-25d4-4421-a280-d7167c48364a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:30.776483 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1436/2873] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 13:12:30 2022] DELETE /identity/v3/projects/b692c9558f9445188a72b94402821aed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:30.782028 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ef9b6-7eeb-4edd-917d-290291f78fea None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:30.782497 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ef9b6-7eeb-4edd-917d-290291f78fea None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:30.782597 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ef9b6-7eeb-4edd-917d-290291f78fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:30.801454 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-079ef9b6-7eeb-4edd-917d-290291f78fea None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:30.802695 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-079ef9b6-7eeb-4edd-917d-290291f78fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:30.861028 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1438/2874] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:30.868814 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77d79a-9507-41ca-b011-9b13a5f39b19 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:30.869106 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77d79a-9507-41ca-b011-9b13a5f39b19 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:30.869388 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77d79a-9507-41ca-b011-9b13a5f39b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:30.887693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0e77d79a-9507-41ca-b011-9b13a5f39b19 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:30.888910 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0e77d79a-9507-41ca-b011-9b13a5f39b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:30.897221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1437/2875] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:30.901481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ef9b6-7eeb-4edd-917d-290291f78fea None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:30.910880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ef9b6-7eeb-4edd-917d-290291f78fea None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:30.915371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9487f1-18cc-4b36-b9e1-2cb9b8ac68c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:30.916031 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9487f1-18cc-4b36-b9e1-2cb9b8ac68c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:30.916336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9487f1-18cc-4b36-b9e1-2cb9b8ac68c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:30.916610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9487f1-18cc-4b36-b9e1-2cb9b8ac68c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:30.917326 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9487f1-18cc-4b36-b9e1-2cb9b8ac68c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 13:12:30.917630 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9487f1-18cc-4b36-b9e1-2cb9b8ac68c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:30.919198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9487f1-18cc-4b36-b9e1-2cb9b8ac68c6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:30.930382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1439/2876] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 13:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 13:12:30.934345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77d79a-9507-41ca-b011-9b13a5f39b19 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:30.943881 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77d79a-9507-41ca-b011-9b13a5f39b19 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:30.948369 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ef2d-75ba-4d40-be0c-009e2a4c9ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:30.949004 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ef2d-75ba-4d40-be0c-009e2a4c9ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:30.949287 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ef2d-75ba-4d40-be0c-009e2a4c9ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:30.949569 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ef2d-75ba-4d40-be0c-009e2a4c9ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:30.950255 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176ef2d-75ba-4d40-be0c-009e2a4c9ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:30.952159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176ef2d-75ba-4d40-be0c-009e2a4c9ae9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:30.977332 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1438/2877] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 13:12:30 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:30.981464 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9487f1-18cc-4b36-b9e1-2cb9b8ac68c6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:30.991225 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9487f1-18cc-4b36-b9e1-2cb9b8ac68c6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:31.016909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:31.048550 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1fe6-88ce-4c09-b41b-b0d802709ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:31.049205 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1fe6-88ce-4c09-b41b-b0d802709ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.049489 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1fe6-88ce-4c09-b41b-b0d802709ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.049765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1fe6-88ce-4c09-b41b-b0d802709ebd admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.050438 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb1fe6-88ce-4c09-b41b-b0d802709ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:31.052382 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb1fe6-88ce-4c09-b41b-b0d802709ebd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:31.071924 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1440/2878] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 13:12:30 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:31.075870 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ef2d-75ba-4d40-be0c-009e2a4c9ae9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:31.086880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ef2d-75ba-4d40-be0c-009e2a4c9ae9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:31.091482 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a03a2-43df-41be-8a6f-0b3d779bca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:31.092160 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a03a2-43df-41be-8a6f-0b3d779bca75 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.092449 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a03a2-43df-41be-8a6f-0b3d779bca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.092756 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a03a2-43df-41be-8a6f-0b3d779bca75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.093473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a03a2-43df-41be-8a6f-0b3d779bca75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:31.095060 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a03a2-43df-41be-8a6f-0b3d779bca75 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:31.106340 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1439/2879] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:31.110078 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1fe6-88ce-4c09-b41b-b0d802709ebd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:31.119786 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb1fe6-88ce-4c09-b41b-b0d802709ebd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:31.124375 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a407c-cf70-499e-a047-533faab35e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:31.125019 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a407c-cf70-499e-a047-533faab35e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.125306 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a407c-cf70-499e-a047-533faab35e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.125581 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a407c-cf70-499e-a047-533faab35e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.126329 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a407c-cf70-499e-a047-533faab35e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:31.127909 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a407c-cf70-499e-a047-533faab35e8e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:31.138143 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1441/2880] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:31.141959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a03a2-43df-41be-8a6f-0b3d779bca75 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:31.152727 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a03a2-43df-41be-8a6f-0b3d779bca75 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:31.157326 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83710773-8dd9-4ad9-b7f7-046c797c8b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:31.158190 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83710773-8dd9-4ad9-b7f7-046c797c8b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.158473 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83710773-8dd9-4ad9-b7f7-046c797c8b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.158752 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83710773-8dd9-4ad9-b7f7-046c797c8b26 admin admin] PATH_INFO: `/v3/projects/05e64e523e804861bc79435039d709aa/users/beee2b02997942a2a1c2dabef9c6a25c/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.173133 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83710773-8dd9-4ad9-b7f7-046c797c8b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e64e523e804861bc79435039d709aa, user_id=beee2b02997942a2a1c2dabef9c6a25c, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:31.175771 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83710773-8dd9-4ad9-b7f7-046c797c8b26 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:31.188544 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1440/2881] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 13:12:31 2022] PUT /identity/v3/projects/05e64e523e804861bc79435039d709aa/users/beee2b02997942a2a1c2dabef9c6a25c/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:31.199274 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245873d-b279-4195-81a6-e7456e86d53c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.199498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245873d-b279-4195-81a6-e7456e86d53c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.199782 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245873d-b279-4195-81a6-e7456e86d53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.225965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4245873d-b279-4195-81a6-e7456e86d53c None None] MFA Rules not processed for user `beee2b02997942a2a1c2dabef9c6a25c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:31.227192 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4245873d-b279-4195-81a6-e7456e86d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:31.289606 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1442/2882] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:31.293906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83710773-8dd9-4ad9-b7f7-046c797c8b26 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:31.353486 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83710773-8dd9-4ad9-b7f7-046c797c8b26 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:31.358082 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffa2dd-f0e1-4563-9d9b-f4bf0c279657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:31.358724 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffa2dd-f0e1-4563-9d9b-f4bf0c279657 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.359010 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffa2dd-f0e1-4563-9d9b-f4bf0c279657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.359305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffa2dd-f0e1-4563-9d9b-f4bf0c279657 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.359971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffa2dd-f0e1-4563-9d9b-f4bf0c279657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:31.361892 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffa2dd-f0e1-4563-9d9b-f4bf0c279657 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:31.382114 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:31.389232 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1441/2883] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 13:12:31 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:31.392999 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245873d-b279-4195-81a6-e7456e86d53c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:31.404465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245873d-b279-4195-81a6-e7456e86d53c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:31.459888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db70e-5ed6-44b7-b4bc-e3c10d1506bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:31.460522 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db70e-5ed6-44b7-b4bc-e3c10d1506bb admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.460828 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db70e-5ed6-44b7-b4bc-e3c10d1506bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.461094 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db70e-5ed6-44b7-b4bc-e3c10d1506bb admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.461791 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0db70e-5ed6-44b7-b4bc-e3c10d1506bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:31.463710 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0db70e-5ed6-44b7-b4bc-e3c10d1506bb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:31.482881 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1443/2884] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 13:12:31 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:31.487081 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffa2dd-f0e1-4563-9d9b-f4bf0c279657 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:31.497696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffa2dd-f0e1-4563-9d9b-f4bf0c279657 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:31.502471 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65677348-ac96-49e3-b8e5-0f97bc1a61d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:31.503155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65677348-ac96-49e3-b8e5-0f97bc1a61d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.503439 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65677348-ac96-49e3-b8e5-0f97bc1a61d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.503714 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65677348-ac96-49e3-b8e5-0f97bc1a61d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.504505 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65677348-ac96-49e3-b8e5-0f97bc1a61d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:31.506698 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65677348-ac96-49e3-b8e5-0f97bc1a61d7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:31.517158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1442/2885] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:31.521431 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db70e-5ed6-44b7-b4bc-e3c10d1506bb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:31.531505 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db70e-5ed6-44b7-b4bc-e3c10d1506bb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:31.536083 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea7db6-0074-450e-8c4a-f96b92111487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:31.536961 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea7db6-0074-450e-8c4a-f96b92111487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.537249 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea7db6-0074-450e-8c4a-f96b92111487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.537523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea7db6-0074-450e-8c4a-f96b92111487 admin admin] PATH_INFO: `/v3/projects/c24088d3731441f4b773c79b495de347/users/e38cf814f1df44bfabc6abc4c6ec5cc6/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.551911 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea7db6-0074-450e-8c4a-f96b92111487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24088d3731441f4b773c79b495de347, user_id=e38cf814f1df44bfabc6abc4c6ec5cc6, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:31.555162 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea7db6-0074-450e-8c4a-f96b92111487 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:31.567666 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1444/2886] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 13:12:31 2022] PUT /identity/v3/projects/c24088d3731441f4b773c79b495de347/users/e38cf814f1df44bfabc6abc4c6ec5cc6/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 13:12:31.572227 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65677348-ac96-49e3-b8e5-0f97bc1a61d7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:31.581967 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65677348-ac96-49e3-b8e5-0f97bc1a61d7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:31.637869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e912f-1113-4073-b5dd-4b8143751d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:31.638519 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e912f-1113-4073-b5dd-4b8143751d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.638806 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e912f-1113-4073-b5dd-4b8143751d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.639087 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e912f-1113-4073-b5dd-4b8143751d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.639800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e912f-1113-4073-b5dd-4b8143751d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:31.641422 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e912f-1113-4073-b5dd-4b8143751d4c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:31.651238 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1443/2887] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:31.655281 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea7db6-0074-450e-8c4a-f96b92111487 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:31.660787 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:31.667779 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea7db6-0074-450e-8c4a-f96b92111487 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:31.672635 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b2486-73e3-4664-9ac1-5d09e027b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:31.673545 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2486-73e3-4664-9ac1-5d09e027b23b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.673824 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2486-73e3-4664-9ac1-5d09e027b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.674099 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2486-73e3-4664-9ac1-5d09e027b23b admin admin] PATH_INFO: `/v3/projects/c24088d3731441f4b773c79b495de347/users/e38cf814f1df44bfabc6abc4c6ec5cc6/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.676449 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2486-73e3-4664-9ac1-5d09e027b23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24088d3731441f4b773c79b495de347, user_id=e38cf814f1df44bfabc6abc4c6ec5cc6, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:31.679678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2486-73e3-4664-9ac1-5d09e027b23b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:31.689902 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1445/2888] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 13:12:31 2022] PUT /identity/v3/projects/c24088d3731441f4b773c79b495de347/users/e38cf814f1df44bfabc6abc4c6ec5cc6/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:31.746162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc325a46-f1c7-462a-9847-76a7133dd7b7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.746351 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc325a46-f1c7-462a-9847-76a7133dd7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.746636 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc325a46-f1c7-462a-9847-76a7133dd7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.772730 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bc325a46-f1c7-462a-9847-76a7133dd7b7 None None] MFA Rules not processed for user `e38cf814f1df44bfabc6abc4c6ec5cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:31.773929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bc325a46-f1c7-462a-9847-76a7133dd7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:31.843621 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1444/2889] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:31.854856 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b2486-73e3-4664-9ac1-5d09e027b23b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:31.856706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c37b2486-73e3-4664-9ac1-5d09e027b23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:31.917184 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b2486-73e3-4664-9ac1-5d09e027b23b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:31.921541 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129f594-90c7-4d53-a6b5-292b3ce2a07f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:31.922320 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f594-90c7-4d53-a6b5-292b3ce2a07f service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:31.922681 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f594-90c7-4d53-a6b5-292b3ce2a07f service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:31.923388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f594-90c7-4d53-a6b5-292b3ce2a07f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:31.933379 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129f594-90c7-4d53-a6b5-292b3ce2a07f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:31.934818 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129f594-90c7-4d53-a6b5-292b3ce2a07f service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:31.944190 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1446/2890] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:12:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:12:33.229409 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc325a46-f1c7-462a-9847-76a7133dd7b7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:33.290504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc325a46-f1c7-462a-9847-76a7133dd7b7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:33.294900 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:33.295759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:33.296066 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:33.296350 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] PATH_INFO: `/v3/users/beee2b02997942a2a1c2dabef9c6a25c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:33.297525 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beee2b02997942a2a1c2dabef9c6a25c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:33.299436 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:33.312000 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:33.345305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beee2b02997942a2a1c2dabef9c6a25c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:33.357375 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beee2b02997942a2a1c2dabef9c6a25c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:33.364674 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beee2b02997942a2a1c2dabef9c6a25c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:33.365907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beee2b02997942a2a1c2dabef9c6a25c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:33.372927 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beee2b02997942a2a1c2dabef9c6a25c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:33.378685 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1445/2891] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 13:12:33 2022] DELETE /identity/v3/users/beee2b02997942a2a1c2dabef9c6a25c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:33.383175 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e31d9-4343-4e28-b7c4-b9a3dab9585b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:33.383637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e31d9-4343-4e28-b7c4-b9a3dab9585b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:33.383724 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e31d9-4343-4e28-b7c4-b9a3dab9585b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:33.400586 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e78e31d9-4343-4e28-b7c4-b9a3dab9585b None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:33.401951 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e78e31d9-4343-4e28-b7c4-b9a3dab9585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:33.460765 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1447/2892] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:33.470367 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:33.471766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:33.528155 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e24a4-8186-4e13-9d40-06c8ad75bb98 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:33.531794 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb27b1d-49e2-42f2-a99d-f36d30ca98ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:33.532466 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb27b1d-49e2-42f2-a99d-f36d30ca98ab service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:33.532755 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb27b1d-49e2-42f2-a99d-f36d30ca98ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:33.533035 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb27b1d-49e2-42f2-a99d-f36d30ca98ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:33.542659 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb27b1d-49e2-42f2-a99d-f36d30ca98ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:33.544052 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb27b1d-49e2-42f2-a99d-f36d30ca98ab service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:33.553939 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1446/2893] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:12:33.824872 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e31d9-4343-4e28-b7c4-b9a3dab9585b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:33.826481 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e78e31d9-4343-4e28-b7c4-b9a3dab9585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:33.843069 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e31d9-4343-4e28-b7c4-b9a3dab9585b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:33.848827 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:33.850206 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:33.850465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:33.850749 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] PATH_INFO: `/v3/projects/05e64e523e804861bc79435039d709aa` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:33.851915 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e64e523e804861bc79435039d709aa)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:33.853877 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:33.899010 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e64e523e804861bc79435039d709aa', 'request_id': 'req-ca61b508-1ddd-4026-b2db-97e9ac33c080'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:33.905416 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e64e523e804861bc79435039d709aa', 'request_id': 'req-ca61b508-1ddd-4026-b2db-97e9ac33c080'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:33.910890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e64e523e804861bc79435039d709aa', 'request_id': 'req-ca61b508-1ddd-4026-b2db-97e9ac33c080'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:33.922861 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] The token cache is being invalidate because project 05e64e523e804861bc79435039d709aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 13:12:33.923149 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:33.923768 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:33.925312 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1448/2894] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 13:12:33 2022] DELETE /identity/v3/projects/05e64e523e804861bc79435039d709aa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:33.929869 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb27b1d-49e2-42f2-a99d-f36d30ca98ab service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:33.939324 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb27b1d-49e2-42f2-a99d-f36d30ca98ab service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:33.993746 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26634e31-6c63-424d-bf89-ea4428ea2b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:33.994601 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634e31-6c63-424d-bf89-ea4428ea2b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:33.994887 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634e31-6c63-424d-bf89-ea4428ea2b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:33.995162 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634e31-6c63-424d-bf89-ea4428ea2b75 admin admin] PATH_INFO: `/v3/users/e38cf814f1df44bfabc6abc4c6ec5cc6` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:33.996364 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26634e31-6c63-424d-bf89-ea4428ea2b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38cf814f1df44bfabc6abc4c6ec5cc6)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:33.998300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26634e31-6c63-424d-bf89-ea4428ea2b75 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:34.036548 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:34.048057 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-26634e31-6c63-424d-bf89-ea4428ea2b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38cf814f1df44bfabc6abc4c6ec5cc6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:34.060121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-26634e31-6c63-424d-bf89-ea4428ea2b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38cf814f1df44bfabc6abc4c6ec5cc6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:34.066921 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-26634e31-6c63-424d-bf89-ea4428ea2b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38cf814f1df44bfabc6abc4c6ec5cc6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:34.067460 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-26634e31-6c63-424d-bf89-ea4428ea2b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38cf814f1df44bfabc6abc4c6ec5cc6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:34.074194 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-26634e31-6c63-424d-bf89-ea4428ea2b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38cf814f1df44bfabc6abc4c6ec5cc6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:34.082963 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1447/2895] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 13:12:33 2022] DELETE /identity/v3/users/e38cf814f1df44bfabc6abc4c6ec5cc6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:34.355629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:34.357134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:34.372745 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61b508-1ddd-4026-b2db-97e9ac33c080 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:34.385318 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:34.433147 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:34.434011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:34.434297 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:34.434578 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] PATH_INFO: `/v3/projects/c24088d3731441f4b773c79b495de347` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:34.435756 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24088d3731441f4b773c79b495de347)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:34.437703 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:34.483180 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24088d3731441f4b773c79b495de347', 'request_id': 'req-3523dd60-76f3-4ef9-82bf-693998a0ab61'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:34.489205 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24088d3731441f4b773c79b495de347', 'request_id': 'req-3523dd60-76f3-4ef9-82bf-693998a0ab61'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:34.494769 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24088d3731441f4b773c79b495de347', 'request_id': 'req-3523dd60-76f3-4ef9-82bf-693998a0ab61'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:34.510071 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] The token cache is being invalidate because project c24088d3731441f4b773c79b495de347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 13:12:34.510364 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:34.510987 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3523dd60-76f3-4ef9-82bf-693998a0ab61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:34.512589 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1449/2896] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 13:12:34 2022] DELETE /identity/v3/projects/c24088d3731441f4b773c79b495de347 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:34.517425 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd81b84-0a12-4fa3-b6c8-77a3bf6a6f5f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:34.517894 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd81b84-0a12-4fa3-b6c8-77a3bf6a6f5f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:34.517983 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd81b84-0a12-4fa3-b6c8-77a3bf6a6f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:34.538563 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7cd81b84-0a12-4fa3-b6c8-77a3bf6a6f5f None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:34.539766 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7cd81b84-0a12-4fa3-b6c8-77a3bf6a6f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:34.598520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1448/2897] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:34.606075 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058a504-04df-4333-b870-25cfa4e2f75d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:34.606374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058a504-04df-4333-b870-25cfa4e2f75d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:34.606678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058a504-04df-4333-b870-25cfa4e2f75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:34.624543 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b058a504-04df-4333-b870-25cfa4e2f75d None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:34.625773 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b058a504-04df-4333-b870-25cfa4e2f75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:34.634221 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1450/2898] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:34.638200 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd81b84-0a12-4fa3-b6c8-77a3bf6a6f5f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:34.648514 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd81b84-0a12-4fa3-b6c8-77a3bf6a6f5f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:34.653375 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56e071-ab48-4e15-83d5-238d06d1dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:34.654023 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e071-ab48-4e15-83d5-238d06d1dff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:34.654310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e071-ab48-4e15-83d5-238d06d1dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:34.654590 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e071-ab48-4e15-83d5-238d06d1dff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:34.655318 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56e071-ab48-4e15-83d5-238d06d1dff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 13:12:34.655629 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56e071-ab48-4e15-83d5-238d06d1dff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:34.657269 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56e071-ab48-4e15-83d5-238d06d1dff1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:34.668654 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1449/2899] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 13:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 13:12:34.672774 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058a504-04df-4333-b870-25cfa4e2f75d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:34.681986 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058a504-04df-4333-b870-25cfa4e2f75d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:34.686673 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaafcd-c552-4f86-8ba7-9f8f1e2ed07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:34.687314 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaafcd-c552-4f86-8ba7-9f8f1e2ed07b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:34.687608 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaafcd-c552-4f86-8ba7-9f8f1e2ed07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:34.687888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaafcd-c552-4f86-8ba7-9f8f1e2ed07b admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:34.688632 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaafcd-c552-4f86-8ba7-9f8f1e2ed07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:34.690529 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaafcd-c552-4f86-8ba7-9f8f1e2ed07b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:34.716362 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1451/2900] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 13:12:34 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:34.720399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56e071-ab48-4e15-83d5-238d06d1dff1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:34.730264 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56e071-ab48-4e15-83d5-238d06d1dff1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:34.785650 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25dfd9-4523-4fb1-b6de-11d6632863cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:34.786313 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25dfd9-4523-4fb1-b6de-11d6632863cb admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:34.786600 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25dfd9-4523-4fb1-b6de-11d6632863cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:34.786880 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25dfd9-4523-4fb1-b6de-11d6632863cb admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:34.787566 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25dfd9-4523-4fb1-b6de-11d6632863cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:34.789529 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25dfd9-4523-4fb1-b6de-11d6632863cb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:34.809091 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1450/2901] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 13:12:34 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 13:12:34.812701 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaafcd-c552-4f86-8ba7-9f8f1e2ed07b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:34.823404 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaafcd-c552-4f86-8ba7-9f8f1e2ed07b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:34.828036 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892f66-e9cb-4ffc-a533-5ac78241ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:34.828713 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892f66-e9cb-4ffc-a533-5ac78241ce2c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:34.829002 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892f66-e9cb-4ffc-a533-5ac78241ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:34.829287 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892f66-e9cb-4ffc-a533-5ac78241ce2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:34.830018 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e892f66-e9cb-4ffc-a533-5ac78241ce2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:34.831624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e892f66-e9cb-4ffc-a533-5ac78241ce2c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:34.842728 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1452/2902] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:34.846726 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25dfd9-4523-4fb1-b6de-11d6632863cb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:34.857652 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25dfd9-4523-4fb1-b6de-11d6632863cb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:34.862156 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a73f2-3f48-482d-bd42-408bdc9d91bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:34.862835 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a73f2-3f48-482d-bd42-408bdc9d91bb admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:34.863121 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a73f2-3f48-482d-bd42-408bdc9d91bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:34.863402 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a73f2-3f48-482d-bd42-408bdc9d91bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:34.864176 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a73f2-3f48-482d-bd42-408bdc9d91bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:34.866392 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a73f2-3f48-482d-bd42-408bdc9d91bb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:34.876250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1451/2903] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:34.880356 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892f66-e9cb-4ffc-a533-5ac78241ce2c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:34.890319 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892f66-e9cb-4ffc-a533-5ac78241ce2c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:34.894978 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d418fd3-8669-4788-b2c0-e038d790fb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:34.895843 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418fd3-8669-4788-b2c0-e038d790fb89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:34.896154 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418fd3-8669-4788-b2c0-e038d790fb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:34.896434 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418fd3-8669-4788-b2c0-e038d790fb89 admin admin] PATH_INFO: `/v3/projects/2d5ce667f8f14a1a8c2be4f360fe1575/users/737c698faeef46bb9835cf04f6950cc6/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:34.910859 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d418fd3-8669-4788-b2c0-e038d790fb89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5ce667f8f14a1a8c2be4f360fe1575, user_id=737c698faeef46bb9835cf04f6950cc6, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:34.914006 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d418fd3-8669-4788-b2c0-e038d790fb89 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:34.927256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1453/2904] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 13:12:34 2022] PUT /identity/v3/projects/2d5ce667f8f14a1a8c2be4f360fe1575/users/737c698faeef46bb9835cf04f6950cc6/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:34.939236 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e488a-7879-488f-b146-a7d37951d0c1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:34.939533 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e488a-7879-488f-b146-a7d37951d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:34.939815 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e488a-7879-488f-b146-a7d37951d0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:34.967265 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8d0e488a-7879-488f-b146-a7d37951d0c1 None None] MFA Rules not processed for user `737c698faeef46bb9835cf04f6950cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:34.968512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8d0e488a-7879-488f-b146-a7d37951d0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:34.973509 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:35.034803 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1452/2905] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:35.039884 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d418fd3-8669-4788-b2c0-e038d790fb89 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:35.082926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:35.102629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d418fd3-8669-4788-b2c0-e038d790fb89 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:35.107468 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e0a09-1cc1-45be-81ef-f15a6570f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:35.108240 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e0a09-1cc1-45be-81ef-f15a6570f0aa admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:35.108480 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e0a09-1cc1-45be-81ef-f15a6570f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:35.108762 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e0a09-1cc1-45be-81ef-f15a6570f0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:35.109465 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e0a09-1cc1-45be-81ef-f15a6570f0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:35.111380 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e0a09-1cc1-45be-81ef-f15a6570f0aa admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:35.135676 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1454/2906] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 13:12:35 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:35.139675 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e488a-7879-488f-b146-a7d37951d0c1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:35.151003 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e488a-7879-488f-b146-a7d37951d0c1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:35.206247 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775d11-a443-43b7-ba3b-f19422ae0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:35.206971 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775d11-a443-43b7-ba3b-f19422ae0195 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:35.207257 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775d11-a443-43b7-ba3b-f19422ae0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:35.207555 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775d11-a443-43b7-ba3b-f19422ae0195 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:35.208250 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f775d11-a443-43b7-ba3b-f19422ae0195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:35.210693 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f775d11-a443-43b7-ba3b-f19422ae0195 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:35.230550 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1453/2907] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 13:12:35 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:35.234253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e0a09-1cc1-45be-81ef-f15a6570f0aa admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:35.244374 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e0a09-1cc1-45be-81ef-f15a6570f0aa admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:35.248994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c87e0-d681-4562-a253-1fd7a8dcbc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:35.249649 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c87e0-d681-4562-a253-1fd7a8dcbc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:35.249935 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c87e0-d681-4562-a253-1fd7a8dcbc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:35.250211 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c87e0-d681-4562-a253-1fd7a8dcbc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:35.250931 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c87e0-d681-4562-a253-1fd7a8dcbc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:35.252560 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c87e0-d681-4562-a253-1fd7a8dcbc27 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:35.262888 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1455/2908] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:35.266620 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775d11-a443-43b7-ba3b-f19422ae0195 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:35.277223 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775d11-a443-43b7-ba3b-f19422ae0195 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:35.281828 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f99b4-637f-4d43-ad64-2bd09f6e9864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:35.282696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f99b4-637f-4d43-ad64-2bd09f6e9864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:35.282977 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f99b4-637f-4d43-ad64-2bd09f6e9864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:35.283254 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f99b4-637f-4d43-ad64-2bd09f6e9864 admin admin] PATH_INFO: `/v3/projects/cccf08e13dac41828a84ce2edf596265/users/cea93e6a3bd84636ba4c318bb2ccefe2/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:35.298140 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f99b4-637f-4d43-ad64-2bd09f6e9864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccf08e13dac41828a84ce2edf596265, user_id=cea93e6a3bd84636ba4c318bb2ccefe2, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:35.300813 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f99b4-637f-4d43-ad64-2bd09f6e9864 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:35.314307 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1454/2909] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 13:12:35 2022] PUT /identity/v3/projects/cccf08e13dac41828a84ce2edf596265/users/cea93e6a3bd84636ba4c318bb2ccefe2/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:35.318603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c87e0-d681-4562-a253-1fd7a8dcbc27 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:35.328377 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c87e0-d681-4562-a253-1fd7a8dcbc27 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:35.387495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a36c1d-f46b-4ee2-89db-fb957407dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:35.388113 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a36c1d-f46b-4ee2-89db-fb957407dc24 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:35.388392 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a36c1d-f46b-4ee2-89db-fb957407dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:35.388670 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a36c1d-f46b-4ee2-89db-fb957407dc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:35.389391 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a36c1d-f46b-4ee2-89db-fb957407dc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:35.390981 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a36c1d-f46b-4ee2-89db-fb957407dc24 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:35.401629 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1456/2910] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:35.405615 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f99b4-637f-4d43-ad64-2bd09f6e9864 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:35.422397 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f99b4-637f-4d43-ad64-2bd09f6e9864 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:35.427008 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a667c45-8eef-455f-a1e5-22a2057f5308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:35.427907 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a667c45-8eef-455f-a1e5-22a2057f5308 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:35.428224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a667c45-8eef-455f-a1e5-22a2057f5308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:35.428504 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a667c45-8eef-455f-a1e5-22a2057f5308 admin admin] PATH_INFO: `/v3/projects/cccf08e13dac41828a84ce2edf596265/users/cea93e6a3bd84636ba4c318bb2ccefe2/roles/26d3e243af384e9bbee85bcefbb9a7c0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:35.430498 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a667c45-8eef-455f-a1e5-22a2057f5308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccf08e13dac41828a84ce2edf596265, user_id=cea93e6a3bd84636ba4c318bb2ccefe2, role_id=26d3e243af384e9bbee85bcefbb9a7c0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:35.433184 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a667c45-8eef-455f-a1e5-22a2057f5308 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:35.443897 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1455/2911] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 13:12:35 2022] PUT /identity/v3/projects/cccf08e13dac41828a84ce2edf596265/users/cea93e6a3bd84636ba4c318bb2ccefe2/roles/26d3e243af384e9bbee85bcefbb9a7c0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:35.453860 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603d99-1a0a-4180-8dff-07349f828553 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:35.454153 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603d99-1a0a-4180-8dff-07349f828553 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:35.454436 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603d99-1a0a-4180-8dff-07349f828553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:35.480296 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-75603d99-1a0a-4180-8dff-07349f828553 None None] MFA Rules not processed for user `cea93e6a3bd84636ba4c318bb2ccefe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:35.481479 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-75603d99-1a0a-4180-8dff-07349f828553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:35.549349 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1457/2912] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:35.560512 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a667c45-8eef-455f-a1e5-22a2057f5308 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:35.562272 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1a667c45-8eef-455f-a1e5-22a2057f5308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:35.618345 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a667c45-8eef-455f-a1e5-22a2057f5308 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:35.621929 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1162f-1d5b-4e4d-a2ff-022e257311b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeb4a8bcbc374f139db9e6e134b6d681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:35.622554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1162f-1d5b-4e4d-a2ff-022e257311b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:35.622837 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1162f-1d5b-4e4d-a2ff-022e257311b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:35.623113 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1162f-1d5b-4e4d-a2ff-022e257311b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:35.632389 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1162f-1d5b-4e4d-a2ff-022e257311b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:35.633800 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1162f-1d5b-4e4d-a2ff-022e257311b7 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:35.643062 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1456/2913] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:12:35.706678 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75603d99-1a0a-4180-8dff-07349f828553 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:35.747901 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:35.770327 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75603d99-1a0a-4180-8dff-07349f828553 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:35.774880 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:35.776013 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:35.776334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:35.776616 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] PATH_INFO: `/v3/users/737c698faeef46bb9835cf04f6950cc6` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:35.777823 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=737c698faeef46bb9835cf04f6950cc6)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:35.779751 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:35.828735 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737c698faeef46bb9835cf04f6950cc6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:35.840534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737c698faeef46bb9835cf04f6950cc6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:35.847712 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737c698faeef46bb9835cf04f6950cc6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:35.848339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737c698faeef46bb9835cf04f6950cc6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:35.855198 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737c698faeef46bb9835cf04f6950cc6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:35.861049 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1458/2914] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 13:12:35 2022] DELETE /identity/v3/users/737c698faeef46bb9835cf04f6950cc6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:35.866150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91505745-85e1-460a-a7d2-f292e6e406a1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:35.866437 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91505745-85e1-460a-a7d2-f292e6e406a1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:35.866715 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91505745-85e1-460a-a7d2-f292e6e406a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:35.872480 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:35.886680 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-91505745-85e1-460a-a7d2-f292e6e406a1 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:35.887886 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-91505745-85e1-460a-a7d2-f292e6e406a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:35.945917 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1457/2915] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:35.955555 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:35.957092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:36.013459 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8c088-283a-4814-ab48-5a82ed007ccb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:36.017092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f550f2-828e-4706-9956-f39f3812b074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:36.017733 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f550f2-828e-4706-9956-f39f3812b074 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:36.018022 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f550f2-828e-4706-9956-f39f3812b074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:36.018304 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f550f2-828e-4706-9956-f39f3812b074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:36.027469 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f550f2-828e-4706-9956-f39f3812b074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:36.028971 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f550f2-828e-4706-9956-f39f3812b074 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:36.038334 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1459/2916] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:12:36.301244 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91505745-85e1-460a-a7d2-f292e6e406a1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:36.303503 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-91505745-85e1-460a-a7d2-f292e6e406a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:36.315748 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91505745-85e1-460a-a7d2-f292e6e406a1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:36.321085 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:36.322191 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:36.322554 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:36.322908 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] PATH_INFO: `/v3/projects/2d5ce667f8f14a1a8c2be4f360fe1575` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:36.324218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5ce667f8f14a1a8c2be4f360fe1575)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:36.326203 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:36.373070 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5ce667f8f14a1a8c2be4f360fe1575', 'request_id': 'req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.379079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5ce667f8f14a1a8c2be4f360fe1575', 'request_id': 'req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.384520 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5ce667f8f14a1a8c2be4f360fe1575', 'request_id': 'req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.396150 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] The token cache is being invalidate because project 2d5ce667f8f14a1a8c2be4f360fe1575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 13:12:36.396479 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.397141 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.398790 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1458/2917] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 13:12:36 2022] DELETE /identity/v3/projects/2d5ce667f8f14a1a8c2be4f360fe1575 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:36.403484 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f550f2-828e-4706-9956-f39f3812b074 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:36.414365 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f550f2-828e-4706-9956-f39f3812b074 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:36.469432 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a10629-e818-41b2-88b6-42576272eb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:36.470289 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a10629-e818-41b2-88b6-42576272eb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:36.470574 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a10629-e818-41b2-88b6-42576272eb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:36.470852 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a10629-e818-41b2-88b6-42576272eb6e admin admin] PATH_INFO: `/v3/users/cea93e6a3bd84636ba4c318bb2ccefe2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:36.472063 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a10629-e818-41b2-88b6-42576272eb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea93e6a3bd84636ba4c318bb2ccefe2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:36.473984 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a10629-e818-41b2-88b6-42576272eb6e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:36.476066 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:36.521586 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c8a10629-e818-41b2-88b6-42576272eb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea93e6a3bd84636ba4c318bb2ccefe2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.533665 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c8a10629-e818-41b2-88b6-42576272eb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea93e6a3bd84636ba4c318bb2ccefe2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.540778 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c8a10629-e818-41b2-88b6-42576272eb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea93e6a3bd84636ba4c318bb2ccefe2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.541556 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c8a10629-e818-41b2-88b6-42576272eb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea93e6a3bd84636ba4c318bb2ccefe2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.548521 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c8a10629-e818-41b2-88b6-42576272eb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea93e6a3bd84636ba4c318bb2ccefe2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.554600 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1460/2918] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 13:12:36 2022] DELETE /identity/v3/users/cea93e6a3bd84636ba4c318bb2ccefe2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:36.828778 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:36.830384 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:36.843739 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28ce57-a5a6-45fc-9a4b-508ab37a6569 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:36.902295 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:36.903149 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:36.903434 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:36.903711 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] PATH_INFO: `/v3/projects/cccf08e13dac41828a84ce2edf596265` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:36.904945 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cccf08e13dac41828a84ce2edf596265)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:36.906859 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:36.938288 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:36.955289 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cccf08e13dac41828a84ce2edf596265', 'request_id': 'req-97eba00a-e2bb-49be-bcef-89022a1c58a8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.961959 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cccf08e13dac41828a84ce2edf596265', 'request_id': 'req-97eba00a-e2bb-49be-bcef-89022a1c58a8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.967475 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cccf08e13dac41828a84ce2edf596265', 'request_id': 'req-97eba00a-e2bb-49be-bcef-89022a1c58a8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.979286 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] The token cache is being invalidate because project cccf08e13dac41828a84ce2edf596265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 13:12:36.979578 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.980252 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-97eba00a-e2bb-49be-bcef-89022a1c58a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:12:36.981789 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1459/2919] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 13:12:36 2022] DELETE /identity/v3/projects/cccf08e13dac41828a84ce2edf596265 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:36.987598 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c954b2b-3489-47be-8790-ce2a25d40762 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:36.987899 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c954b2b-3489-47be-8790-ce2a25d40762 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:36.988232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c954b2b-3489-47be-8790-ce2a25d40762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:37.006076 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3c954b2b-3489-47be-8790-ce2a25d40762 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:37.007280 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3c954b2b-3489-47be-8790-ce2a25d40762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:37.071498 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1461/2920] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:37.079158 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bdee5-2e1a-43da-b3c9-2b984d6912e1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:37.079453 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bdee5-2e1a-43da-b3c9-2b984d6912e1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:37.079733 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bdee5-2e1a-43da-b3c9-2b984d6912e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:37.098109 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d76bdee5-2e1a-43da-b3c9-2b984d6912e1 None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:37.099300 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d76bdee5-2e1a-43da-b3c9-2b984d6912e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:37.107017 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1460/2921] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:37.111294 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c954b2b-3489-47be-8790-ce2a25d40762 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:37.121046 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c954b2b-3489-47be-8790-ce2a25d40762 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:37.125637 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197c108-79b9-40e8-9d38-c78920be0068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:37.126321 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197c108-79b9-40e8-9d38-c78920be0068 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:37.126610 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197c108-79b9-40e8-9d38-c78920be0068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:37.126890 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197c108-79b9-40e8-9d38-c78920be0068 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:37.127615 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197c108-79b9-40e8-9d38-c78920be0068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 13:12:37.127926 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197c108-79b9-40e8-9d38-c78920be0068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:37.129619 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197c108-79b9-40e8-9d38-c78920be0068 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:37.141793 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1462/2922] 10.222.0.66 () {58 vars in 1152 bytes} [Wed Jun 22 13:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 13:12:37.145759 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bdee5-2e1a-43da-b3c9-2b984d6912e1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:37.155696 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bdee5-2e1a-43da-b3c9-2b984d6912e1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:37.160305 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2970406-8250-4428-bb47-a080ece714c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:37.160942 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2970406-8250-4428-bb47-a080ece714c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:37.161221 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2970406-8250-4428-bb47-a080ece714c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:37.161497 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2970406-8250-4428-bb47-a080ece714c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:37.162177 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2970406-8250-4428-bb47-a080ece714c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:37.164148 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2970406-8250-4428-bb47-a080ece714c3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:37.188872 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1461/2923] 10.222.0.66 () {60 vars in 1152 bytes} [Wed Jun 22 13:12:37 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 13:12:37.193603 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197c108-79b9-40e8-9d38-c78920be0068 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:37.203686 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197c108-79b9-40e8-9d38-c78920be0068 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:37.260012 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade9231-e9c3-40ce-9a25-4bb93c3d793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:37.260707 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade9231-e9c3-40ce-9a25-4bb93c3d793e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:37.260994 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade9231-e9c3-40ce-9a25-4bb93c3d793e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:37.261276 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade9231-e9c3-40ce-9a25-4bb93c3d793e admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:37.261962 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade9231-e9c3-40ce-9a25-4bb93c3d793e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:37.263920 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade9231-e9c3-40ce-9a25-4bb93c3d793e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:37.273256 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:37.285851 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1463/2924] 10.222.0.66 () {60 vars in 1143 bytes} [Wed Jun 22 13:12:37 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 13:12:37.289706 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2970406-8250-4428-bb47-a080ece714c3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:37.300159 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2970406-8250-4428-bb47-a080ece714c3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:37.309256 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82942a7-4d35-4169-83f3-644516d02274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:37.309913 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82942a7-4d35-4169-83f3-644516d02274 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:37.310204 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82942a7-4d35-4169-83f3-644516d02274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:37.310485 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82942a7-4d35-4169-83f3-644516d02274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:37.311212 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82942a7-4d35-4169-83f3-644516d02274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:37.312848 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82942a7-4d35-4169-83f3-644516d02274 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:37.324316 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1462/2925] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 13:12:37.328092 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade9231-e9c3-40ce-9a25-4bb93c3d793e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:37.337796 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade9231-e9c3-40ce-9a25-4bb93c3d793e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:37.342322 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe7b01-61f2-41e0-bb21-cf1401673331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:37.342966 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe7b01-61f2-41e0-bb21-cf1401673331 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:37.343253 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe7b01-61f2-41e0-bb21-cf1401673331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:37.343534 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe7b01-61f2-41e0-bb21-cf1401673331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:37.344290 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe7b01-61f2-41e0-bb21-cf1401673331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:37.345870 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe7b01-61f2-41e0-bb21-cf1401673331 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:37.355674 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1464/2926] 10.222.0.66 () {58 vars in 1121 bytes} [Wed Jun 22 13:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 13:12:37.359218 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82942a7-4d35-4169-83f3-644516d02274 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:37.369579 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82942a7-4d35-4169-83f3-644516d02274 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:37.375034 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7fac6-3129-499a-b28e-9825890e9723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:37.375906 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7fac6-3129-499a-b28e-9825890e9723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:37.376224 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7fac6-3129-499a-b28e-9825890e9723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:37.376507 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7fac6-3129-499a-b28e-9825890e9723 admin admin] PATH_INFO: `/v3/projects/135c4eede17145fd86684ae395ffff34/users/d59586d0cb9f40a4b3c129e8f20c89ef/roles/dda86b29d55a42c48f50fdd9fc4d5b61` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:37.391642 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7fac6-3129-499a-b28e-9825890e9723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135c4eede17145fd86684ae395ffff34, user_id=d59586d0cb9f40a4b3c129e8f20c89ef, role_id=dda86b29d55a42c48f50fdd9fc4d5b61)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:37.394344 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7fac6-3129-499a-b28e-9825890e9723 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:37.408310 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1463/2927] 10.222.0.66 () {60 vars in 1482 bytes} [Wed Jun 22 13:12:37 2022] PUT /identity/v3/projects/135c4eede17145fd86684ae395ffff34/users/d59586d0cb9f40a4b3c129e8f20c89ef/roles/dda86b29d55a42c48f50fdd9fc4d5b61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:12:37.419519 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4371-eabe-4675-bb9b-39a186784520 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:37.419965 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4371-eabe-4675-bb9b-39a186784520 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:37.420174 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4371-eabe-4675-bb9b-39a186784520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:37.447134 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ad9e4371-eabe-4675-bb9b-39a186784520 None None] MFA Rules not processed for user `d59586d0cb9f40a4b3c129e8f20c89ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:12:37.448371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ad9e4371-eabe-4675-bb9b-39a186784520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:37.510400 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1465/2928] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:12:37.522411 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7fac6-3129-499a-b28e-9825890e9723 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:12:37.524124 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c4e7fac6-3129-499a-b28e-9825890e9723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:12:37.601719 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7fac6-3129-499a-b28e-9825890e9723 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:12:37.605341 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff32f18-a0d1-4737-b1c2-2dd7ae7b6222 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd82125a47ce044b389684b97c7097ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:12:37.605979 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32f18-a0d1-4737-b1c2-2dd7ae7b6222 service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:12:37.606271 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32f18-a0d1-4737-b1c2-2dd7ae7b6222 service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:12:37.606551 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32f18-a0d1-4737-b1c2-2dd7ae7b6222 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:12:37.615363 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff32f18-a0d1-4737-b1c2-2dd7ae7b6222 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:12:37.616851 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff32f18-a0d1-4737-b1c2-2dd7ae7b6222 service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:12:37.625562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1464/2929] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:12:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:12:47.507495 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=39 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:12:47.621562 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=76,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:13:04.145473 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e4371-eabe-4675-bb9b-39a186784520 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:13:04.209438 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e4371-eabe-4675-bb9b-39a186784520 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:13:04.214466 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:13:04.215339 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:13:04.215624 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:13:04.215906 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] PATH_INFO: `/v3/users/d59586d0cb9f40a4b3c129e8f20c89ef` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:13:04.217145 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59586d0cb9f40a4b3c129e8f20c89ef)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:13:04.219073 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:13:04.263983 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59586d0cb9f40a4b3c129e8f20c89ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:13:04.276523 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59586d0cb9f40a4b3c129e8f20c89ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:13:04.283706 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59586d0cb9f40a4b3c129e8f20c89ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:13:04.284371 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59586d0cb9f40a4b3c129e8f20c89ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:13:04.292084 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59586d0cb9f40a4b3c129e8f20c89ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:13:04.297882 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1466/2930] 10.222.0.66 () {58 vars in 1223 bytes} [Wed Jun 22 13:13:04 2022] DELETE /identity/v3/users/d59586d0cb9f40a4b3c129e8f20c89ef => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:13:04.302467 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7ce0d-b9c0-4b1b-9e84-3831e116992e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:13:04.302943 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7ce0d-b9c0-4b1b-9e84-3831e116992e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:13:04.303036 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7ce0d-b9c0-4b1b-9e84-3831e116992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:13:04.320303 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-17d7ce0d-b9c0-4b1b-9e84-3831e116992e None None] MFA Rules not processed for user `10bf47ad20914307a19e97e4ac11811c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 13:13:04.321508 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-17d7ce0d-b9c0-4b1b-9e84-3831e116992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:13:04.379075 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1465/2931] 10.222.0.66 () {58 vars in 957 bytes} [Wed Jun 22 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 13:13:04.388568 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:13:04.389993 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:13:04.447620 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f2288-2173-462b-8dc4-086a8248f897 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:13:04.451232 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbe31f-ad42-45e9-9ef6-94eaef96ba7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37002ecc6384dc08fca3ddf6ca2f9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:13:04.451869 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbe31f-ad42-45e9-9ef6-94eaef96ba7f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:13:04.452199 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbe31f-ad42-45e9-9ef6-94eaef96ba7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:13:04.452483 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbe31f-ad42-45e9-9ef6-94eaef96ba7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:13:04.461822 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbe31f-ad42-45e9-9ef6-94eaef96ba7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:13:04.463247 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbe31f-ad42-45e9-9ef6-94eaef96ba7f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:13:04.472585 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1467/2932] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:13:04.735427 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7ce0d-b9c0-4b1b-9e84-3831e116992e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:13:04.736925 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-17d7ce0d-b9c0-4b1b-9e84-3831e116992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:13:04.749242 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7ce0d-b9c0-4b1b-9e84-3831e116992e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:13:04.753911 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bf47ad20914307a19e97e4ac11811c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd14a2971f0418089231e7139d946ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:13:04.754774 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:13:04.755063 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:13:04.755342 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] PATH_INFO: `/v3/projects/135c4eede17145fd86684ae395ffff34` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:13:04.756597 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=135c4eede17145fd86684ae395ffff34)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:13:04.759040 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:13:04.806079 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135c4eede17145fd86684ae395ffff34', 'request_id': 'req-25dcf0db-8cf3-4736-949f-270ce6c7df52'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:13:04.812718 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135c4eede17145fd86684ae395ffff34', 'request_id': 'req-25dcf0db-8cf3-4736-949f-270ce6c7df52'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:13:04.818330 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135c4eede17145fd86684ae395ffff34', 'request_id': 'req-25dcf0db-8cf3-4736-949f-270ce6c7df52'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:13:04.831750 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] The token cache is being invalidate because project 135c4eede17145fd86684ae395ffff34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 13:13:04.832070 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:13:04.832856 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 13:13:04.834670 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1466/2933] 10.222.0.66 () {58 vars in 1232 bytes} [Wed Jun 22 13:13:04 2022] DELETE /identity/v3/projects/135c4eede17145fd86684ae395ffff34 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 13:13:06.039246 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbe31f-ad42-45e9-9ef6-94eaef96ba7f service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:13:06.040761 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0cbe31f-ad42-45e9-9ef6-94eaef96ba7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:13:06.066903 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:13:06.112336 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbe31f-ad42-45e9-9ef6-94eaef96ba7f service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:13:06.172072 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd8457-476b-499c-8bad-d2f805e8f28b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:13:06.172725 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd8457-476b-499c-8bad-d2f805e8f28b service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:13:06.173011 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd8457-476b-499c-8bad-d2f805e8f28b service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:13:06.173292 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd8457-476b-499c-8bad-d2f805e8f28b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:13:06.175032 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a3cd8457-476b-499c-8bad-d2f805e8f28b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:13:06.186767 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd8457-476b-499c-8bad-d2f805e8f28b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:13:06.188388 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd8457-476b-499c-8bad-d2f805e8f28b service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:13:06.198692 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1468/2934] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:13:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 13:13:14.828415 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:13:16.193914 dv-cinder-846977-1-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=48 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 13:18:10.020399 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 13:18:10.021785 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 13:18:10.083167 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcf0db-8cf3-4736-949f-270ce6c7df52 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 13:18:10.088086 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ba982-e122-45b5-8b5b-9a69c8a2a1fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89ae81d49214b75a747a6cfa3ddf0ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d3618da0c7548a7ac417bcccc7219d0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 13:18:10.088727 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ba982-e122-45b5-8b5b-9a69c8a2a1fe service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 13:18:10.089012 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ba982-e122-45b5-8b5b-9a69c8a2a1fe service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 13:18:10.089291 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ba982-e122-45b5-8b5b-9a69c8a2a1fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 13:18:10.098246 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ba982-e122-45b5-8b5b-9a69c8a2a1fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 13:18:10.099817 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ba982-e122-45b5-8b5b-9a69c8a2a1fe service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 13:18:10.109853 dv-cinder-846977-1-iscsi devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1467/2935] 10.222.0.66 () {60 vars in 1365 bytes} [Wed Jun 22 13:18:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)